Convert deep learning frameworks such as PyTorch and TensorFlow/Keras and run them directly from c++ - github

ONNX model files structure

ONNX files can be a bit confusing at first because a single model can be represented by one file or by a small set of related files, depending on how it was exported.

OpenCV DNN

supports loading many popular deep learning frameworks such as TensorFlow, (Py)Torch, DarkNet, Caffe, ONNX.

ONNX C++ Runtime

Windows distributions of this project may collect usage data and send it to Microsoft

What is ONNX C++ Runtime?

It is simply the C++ API of ONNX Runtime that allows you to:

• Load ONNX models in a C++ program
• Run inference on them
• Feed inputs and fetch outputs
• Configure execution providers (CPU, CUDA, etc.)
• Optimize models

Essentially, you can embed fast ML inference inside native C++ applications.