Skip to main content

On-device AI across mobile, embedded and edge for PyTorch

Project description

ExecuTorch is a PyTorch platform that provides infrastructure to run PyTorch programs everywhere from AR/VR wearables to standard on-device iOS and Android mobile deployments. One of the main goals for ExecuTorch is to enable wider customization and deployment capabilities of the PyTorch programs.

The executorch pip package is in alpha.

  • Required python version: ==3.10
  • Compatible systems: Linux x86_64, macOS aarch64

The prebuilt executorch.extension.pybindings.portable_lib module included in this package provides a way to run ExecuTorch .pte files, with some restrictions:

Please visit the ExecuTorch website for tutorials and documentation. Here are some starting points:

  • Getting Started
    • Set up the ExecuTorch environment and run PyTorch models locally.
  • Working with local LLMs
    • Learn how to use ExecuTorch to export and accelerate a large-language model from scratch.
  • Exporting to ExecuTorch
    • Learn the fundamentals of exporting a PyTorch nn.Module to ExecuTorch, and optimizing its performance using quantization and hardware delegation.
  • Running LLaMA on iOS and Android devices.
    • Build and run LLaMA in a demo mobile app, and learn how to integrate models with your own apps.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

executorch-0.2.1-cp311-cp311-manylinux1_x86_64.whl (12.6 MB view hashes)

Uploaded CPython 3.11

executorch-0.2.1-cp311-cp311-macosx_11_0_arm64.whl (12.4 MB view hashes)

Uploaded CPython 3.11 macOS 11.0+ ARM64

executorch-0.2.1-cp310-cp310-manylinux1_x86_64.whl (12.6 MB view hashes)

Uploaded CPython 3.10

executorch-0.2.1-cp310-cp310-macosx_11_0_arm64.whl (12.4 MB view hashes)

Uploaded CPython 3.10 macOS 11.0+ ARM64

executorch-0.2.1-cp39-cp39-manylinux1_x86_64.whl (12.6 MB view hashes)

Uploaded CPython 3.9

executorch-0.2.1-cp39-cp39-macosx_11_0_arm64.whl (12.4 MB view hashes)

Uploaded CPython 3.9 macOS 11.0+ ARM64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page