Skip to main content

Open source library for creating PyTorch containers to run on Amazon SageMaker.

Project description

SageMaker PyTorch Inference Toolkit is an open-source library for serving PyTorch models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain PyTorch model types and is responsible for starting up the TorchServe model server on SageMaker, which is responsible for handling inference requests.

For training, see SageMaker PyTorch Training Toolkit.

For the Dockerfiles used for building SageMaker PyTorch Containers, see AWS Deep Learning Containers.

For information on running PyTorch jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.

For notebook examples: SageMaker Notebook Examples.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

License

SageMaker PyTorch Serving Container is licensed under the Apache 2.0 License. It is copyright 2018 Amazon .com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sagemaker_pytorch_inference-2.0.24.tar.gz (22.3 kB view details)

Uploaded Source

File details

Details for the file sagemaker_pytorch_inference-2.0.24.tar.gz.

File metadata

  • Download URL: sagemaker_pytorch_inference-2.0.24.tar.gz
  • Upload date:
  • Size: 22.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.9.6 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.17 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.4 CPython/3.6.15

File hashes

Hashes for sagemaker_pytorch_inference-2.0.24.tar.gz
Algorithm Hash digest
SHA256 1024170c7e0e8186a0470eb415c819f680bc98c5b3f603a5d5acdef27a14d387
MD5 1c740e73ad8ed026dd232d8fd2cce286
BLAKE2b-256 a78fa27e4a6688d990dd2a9ae56cf1c83ea00f93dd3f455b42180a21237cf1d6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page