Glossary: NLP with Transformers
ONNX Runtime
Also written: optimum-onnx, ONNX
An engine for serving models efficiently. It is the usual next step for serving at scale, through the `optimum-onnx` package or `backend="onnx"` in sentence-transformers.
Glossary: NLP with Transformers
Also written: optimum-onnx, ONNX
An engine for serving models efficiently. It is the usual next step for serving at scale, through the `optimum-onnx` package or `backend="onnx"` in sentence-transformers.