Skip to main content

SageMaker PyTorch Inference Toolkit is an open-source library for serving PyTorch models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain PyTorch model types and is responsible for starting up the TorchServe model server on SageMaker, which is responsible for handling inference requests.

For training, see SageMaker PyTorch Training Toolkit.

For the Dockerfiles used for building SageMaker PyTorch Containers, see AWS Deep Learning Containers.

For information on running PyTorch jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.

For notebook examples: SageMaker Notebook Examples.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

License

SageMaker PyTorch Serving Container is licensed under the Apache 2.0 License. It is copyright 2018 Amazon .com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/

Metadata

Release files for sagemaker-pytorch-inference 2.0.25

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sagemaker-pytorch-inference 2.0.25
File Size Uploaded
sagemaker_pytorch_inference-2.0.25.tar.gz 22.3 kB Details

Release files / sagemaker_pytorch_inference-2.0.25.tar.gz

Download URL sagemaker_pytorch_inference-2.0.25.tar.gz
Size 22.3 kB
Tags Source
SHA-256 checksum
How to use checksums
71ae0de6168715c1c9f7d9e5e4e1b3482e91ef901cf2048a8d0fbd5d77501ec1
BLAKE2b-256 checksum
How to use checksums
271b8c0367e6d07ca92b20462ffe43cc38914e70719b1e30f605ac6eb560eaed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.9.6 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.17 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.4 CPython/3.6.15

Release history Release notifications | RSS feed

This release

2.0.25 This release

1 release file

2.0.24

1 release file

2.0.23

1 release file

2.0.22

1 release file

2.0.21

1 release file

2.0.20

1 release file

2.0.19

1 release file

2.0.18

1 release file

2.0.17

1 release file

2.0.16

1 release file

2.0.15

1 release file

2.0.14

1 release file

2.0.13

1 release file

2.0.12

1 release file

2.0.11

1 release file

2.0.10

1 release file

2.0.9

1 release file

2.0.8

1 release file

2.0.7

1 release file

2.0.6

1 release file

2.0.5

1 release file

2.0.4

1 release file

2.0.3

1 release file

2.0.2

1 release file

2.0.1

1 release file

2.0.0

1 release file

1.5.1

1 release file

1.5.0

1 release file

1.4.4

1 release file

1.4.3

1 release file

1.4.2

1 release file

1.4.1

1 release file

1.4.0

1 release file

1.3.2

1 release file

1.3.1

1 release file

1.3.0

1 release file

1.2.1

1 release file

1.2.0

1 release file

1.1.1

1 release file

1.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page