torchlambda is a tool to deploy PyTorch models on Amazon's AWS Lambda using AWS SDK for C++ and custom C++ runtime.
Using statically compiled dependencies whole package is shrunk to only 30MB.
Due to small size of compiled source code users can pass their models as AWS Lambda layers. Services like Amazon S3 are no longer necessary to load your model.
torchlambda has it's PyTorch & AWS dependencies always up to date because of continuous deployment run at 03:00 a.m.
every day.
| Docs | Deployment | Package | Python | PyTorch | Docker | CodeBeat | Images |
|---|---|---|---|---|---|---|---|
 |
 |
 |
 |
 |
 |
 |
 |
Comparison with other deployment tools
Improve this comparison's reliability via Pull Request, thanks. Also show guys below some love by visiting their projects (just click on the name).
| Trait / Tool | torchlambda | fastai Lambda | KubeFlow | Tensorflow Serving |
|---|---|---|---|---|
| Autoscaling | ✔️ | ✔️ | with Kubernetes | with Kubernetes |
| Light/Heavy load | Light | Light | Heavy/Both | Both |
| GPU Support | ❌ | ❌ | ✔️ | ✔️ |
| Serverless | ✔️ | ✔️ | ❌ | ❌ |
| Required services | AWS Lambda | AWS Lambda, AWS S3 | Kubernetes Cluster & cloud provider | Deployable in various settings |
| Multiple frameworks | ❌ | ❌ | ✔️ | ❌ |
| Latest framework 1 | ✔️ | ❌ | ❌ | ✔️ |
| Version (higher more mature) | CD | N/A | 1.0 | 2.1.0 |
| Customizable dependencies 2 | ✔️ | ❌ | ❌ | ❌ |
| Deployment size 3 | ~30Mb | +1Gb | N/A | ~67Mb4 |
Table Of Contents
Footnotes
1. Support for latest version of it's main DL framework or main frameworks if multiple supported
2. Project dependencies are easily customizable. In torchlambda it would be user
specified build procedures for libtorch and AWS C++ SDK
3. Necessary size of code and dependencies to deploy model
4. Based on Dockerfile size
1 maintainer
Metadata
1 maintainer
Release files for torchlambda 1586842928
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| torchlambda-1586842928.tar.gz | 21.5 kB | Without provenance | Details for torchlambda-1586842928.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| torchlambda-1586842928-py3-none-any.whl | Python 3 | none | any | Details for torchlambda-1586842928-py3-none-any.whl |
Total release size: 50.1 kB
Release files / torchlambda-1586842928.tar.gz
| Download URL | torchlambda-1586842928.tar.gz |
|---|---|
| Size | 21.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c02529c61b73fd6446d307daec2db57b0119277db9fe3c787d30a7bee94e0a5f
|
|
BLAKE2b-256 checksum How to use checksums |
6b74b5716261cd080d220ca29c85681d71ed921e3edd1cb0f39c8861b515798c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.7
|
Release files / torchlambda-1586842928-py3-none-any.whl
| Download URL | torchlambda-1586842928-py3-none-any.whl |
|---|---|
| Size | 28.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
0a4be81a8d8cc8c1a1a94a05b59f9ae11db99347abb1e7a4e8676b0f9a64f358
|
|
BLAKE2b-256 checksum How to use checksums |
5ddcc47b536707368877086d70492669ec12fbd1c77b7a73c62c279e1f0c496c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.7
|
Security for torchlambda 1586842928
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
