Skip to main content

Open source library for creating PyTorch containers to run on Amazon SageMaker.

Project description

SageMaker PyTorch Inference Toolkit is an open-source library for serving PyTorch models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain PyTorch model types and utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests.

For training, see SageMaker PyTorch Training Toolkit.

For the Dockerfiles used for building SageMaker PyTorch Containers, see AWS Deep Learning Containers.

For information on running PyTorch jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.

For notebook examples: SageMaker Notebook Examples.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

License

SageMaker PyTorch Serving Container is licensed under the Apache 2.0 License. It is copyright 2018 Amazon .com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

File details

Details for the file sagemaker_pytorch_inference_test-2.0.18.dev0.tar.gz.

File metadata

File hashes

Hashes for sagemaker_pytorch_inference_test-2.0.18.dev0.tar.gz
Algorithm Hash digest
SHA256 3e7bbe396b3329b7f22daa0d65c4aaa577d17c434e16fb3b5a4a1bd9277a7f27
MD5 b3e942e44e49cdfa1342f1baa987d3e9
BLAKE2b-256 03a365ca47f73e5ab10627213d34f59cdbfd1afcc5a89a57a45f92cbd9eb5d49

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page