Skip to main content

TorchServe is a flexible and easy to use tool for serving PyTorch models in production.

Use the TorchServe CLI, or the pre-configured Docker images, to start a service that sets up HTTP endpoints to handle model inference requests.

Installation

Full installation instructions are in the project repo: https://github.com/pytorch/serve/blob/master/README.md

Source code

You can check the latest source code as follows:

git clone https://github.com/pytorch/serve.git

Citation

If you use torchserve in a publication or project, please cite torchserve: https://github.com/pytorch/serve

Release files for torchserve 0.12.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for torchserve 0.12.0
File Interpreter ABI Platform
torchserve-0.12.0-py3-none-any.whl Python 3 none any Details

Release files / torchserve-0.12.0-py3-none-any.whl

Download URL torchserve-0.12.0-py3-none-any.whl
Size 42.2 MB
Tags Python 3
SHA-256 checksum
How to use checksums
db127160102d29f390964f758b7ecc5039d3d278fafc85bf9994c273b3ef6954
BLAKE2b-256 checksum
How to use checksums
07573e9d9579f6300c475c13e5cbaa38be93c8e44aecfb85dfd16825adb6e9c6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.9.19

Release history Release notifications | RSS feed

This release

0.12.0 This release

1 release file

0.11.1

1 release file

0.11.0

1 release file

0.10.0

1 release file

0.9.0

1 release file

0.8.2

1 release file

0.8.1

1 release file

0.8.0

1 release file

0.7.1

1 release file

0.7.0

1 release file

0.6.1

1 release file

0.6.0

1 release file

0.5.3

1 release file

0.5.2

1 release file

0.5.1

1 release file

0.5.0

1 release file

0.4.2

1 release file

0.4.1

1 release file

0.4.0

1 release file

0.3.1

1 release file

0.3.0

1 release file

0.2.2

1 release file

0.2.0

1 release file

0.1.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page