No project description provided
Project description
soyml
soyml: framework-independent ML model inference
soy - a prefix indicating that this is a subpar substitute for the real thing :)
pitch
machine learning models are often trained in one framework (e.g. pytorch) and deployed in another. there are many different inference-focused frameworks, but they all have different APIs. this makes it difficult to deploy models in a framework-agnostic way. soyml aims to solve this problem by providing a simple, framework-agnostic API for inference, abstracting away the details of the underlying framework, and just letting you turn inputs to outputs and nothing else.
features
currently supported backends:
- pytorch (
torch) - onnxruntime (
ort) - wonnx (
wonnx) - ncnn (
ncnn)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
