Open source library for creating PyTorch containers to run on Amazon SageMaker.
Project description
SageMaker PyTorch Inference Toolkit is an open-source library for serving PyTorch models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain PyTorch model types and utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests.
For training, see SageMaker PyTorch Training Toolkit.
For the Dockerfiles used for building SageMaker PyTorch Containers, see AWS Deep Learning Containers.
For information on running PyTorch jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.
For notebook examples: SageMaker Notebook Examples.
Contributing
Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.
License
SageMaker PyTorch Serving Container is licensed under the Apache 2.0 License. It is copyright 2018 Amazon .com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file sagemaker_pytorch_inference_test-2.0.18.dev0.tar.gz
.
File metadata
- Download URL: sagemaker_pytorch_inference_test-2.0.18.dev0.tar.gz
- Upload date:
- Size: 26.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e7bbe396b3329b7f22daa0d65c4aaa577d17c434e16fb3b5a4a1bd9277a7f27 |
|
MD5 | b3e942e44e49cdfa1342f1baa987d3e9 |
|
BLAKE2b-256 | 03a365ca47f73e5ab10627213d34f59cdbfd1afcc5a89a57a45f92cbd9eb5d49 |