Common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
Project description
# DLR
DLR is a compact, common runtime for deep learning models and decision tree models compiled by [AWS SageMaker Neo](https://aws.amazon.com/sagemaker/neo/), [TVM](https://tvm.ai/), or [Treelite](https://treelite.readthedocs.io/en/latest/install.html). DLR uses the TVM runtime, Treelite runtime, NVIDIA TensorRT™, and can include other hardware-specific runtimes. DLR provides unified Python/C++ APIs for loading and running compiled models on various devices. DLR currently supports platforms from Intel, NVIDIA, and ARM, with support for Xilinx, Cadence, and Qualcomm coming soon.
## Documentation For instructions on installilng DLR, please refer to [Installing DLR](https://neo-ai-dlr.readthedocs.io/en/latest/install.html)
For instructions on using DLR, please refer to [Amazon SageMaker Neo – Train Your Machine Learning Models Once, Run Them Anywhere](https://aws.amazon.com/blogs/aws/amazon-sagemaker-neo-train-your-machine-learning-models-once-run-them-anywhere/)
Also check out the [API documentation](https://neo-ai-dlr.readthedocs.io/en/latest/)
## License
This library is licensed under the Apache License Version 2.0.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for dlr-1.0-py2.py3-none-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a3258614eb56091c7aa5a78da639aa404b14c1886085914000253bdfcf6117cc |
|
MD5 | d7215dd585c97be67b9a10dd9f324268 |
|
BLAKE2b-256 | ee748d7631acf4ee2833291cabd5e3e7098d115a0b768f36d7519b32f0695eb1 |