inference runtime library
C28944
concept
An inference runtime library is a software component that efficiently executes trained machine learning models on target hardware, managing model loading, optimization, and prediction workflows.
All labels observed (5)
| Label | Occurrences |
|---|---|
| AI inference runtime | 1 |
| deep learning inference toolkit | 1 |
| deep learning runtime | 1 |
| inference runtime library canonical | 1 |
| machine learning inference engine | 1 |
Instances (4)
| Instance | Via concept surface |
|---|---|
| NVIDIA TensorRT | — |
| Hexagon NN library | AI inference runtime |
| OpenVINO | deep learning inference toolkit |
| ONNX Runtime | machine learning inference engine |