ONNX Runtime

Also written: onnxruntime, ort

Microsoft's free inference engine for running ONNX model files, usable from Python, C#, Java, JavaScript and on phones. It can run a model faster per photo than PyTorch; in one test it was about three times faster.