Metaflow_Logo_Horizontal_FullColor_Ribbon_Dark_RGB

Metaflow

Metaflow is a human-centric framework designed to help scientists and engineers build and manage real-life AI and ML systems. Serving teams of all sizes and scale, Metaflow streamlines the entire development lifecycle—from rapid prototyping in notebooks to reliable, maintainable production deployments—enabling teams to iterate quickly and deliver robust systems efficiently.

Originally developed at Netflix and now supported by Outerbounds, Metaflow is designed to boost the productivity for research and engineering teams working on a wide variety of projects, from classical statistics to state-of-the-art deep learning and foundation models. By unifying code, data, and compute at every stage, Metaflow ensures seamless, end-to-end management of real-world AI and ML systems.

Today, Metaflow powers thousands of AI and ML experiences across a diverse array of companies, large and small, including Amazon, Doordash, Dyson, Goldman Sachs, Ramp, and many others. At Netflix alone, Metaflow supports over 3000 AI and ML projects, executes hundreds of millions of data-intensive high-performance compute jobs processing petabytes of data and manages tens of petabytes of models and artifacts for hundreds of users across its AI, ML, data science, and engineering teams.

From prototype to production (and back)

Metaflow provides a simple and friendly pythonic API that covers foundational needs of AI and ML systems:

  1. Rapid local prototyping, support for notebooks, and built-in support for experiment tracking, versioning and visualization.
  2. Effortlessly scale horizontally and vertically in your cloud, utilizing both CPUs and GPUs, with fast data access for running massive embarrassingly parallel as well as gang-scheduled compute workloads reliably and efficiently.
  3. Easily manage dependencies and deploy with one-click to highly available production orchestrators with built in support for reactive orchestration.

For full documentation, check out our API Reference or see our Release Notes for the latest features and improvements.

Getting started

Getting up and running is easy. If you don't know where to start, Metaflow sandbox will have you running and exploring in seconds.

Installing Metaflow

To install Metaflow in your Python environment from PyPI:

pip install metaflow

Alternatively, using conda-forge:

conda install -c conda-forge metaflow

Once installed, a great way to get started is by following our tutorial. It walks you through creating and running your first Metaflow flow step by step.

For more details on Metaflow’s features and best practices, check out:

If you need help, don’t hesitate to reach out on our Slack community!

Deploying infrastructure for Metaflow in your cloud

While you can get started with Metaflow easily on your laptop, the main benefits of Metaflow lie in its ability to scale out to external compute clusters and to deploy to production-grade workflow orchestrators. To benefit from these features, follow this guide to configure Metaflow and the infrastructure behind it appropriately.

Get in touch

We'd love to hear from you. Join our community Slack workspace!

Contributing

We welcome contributions to Metaflow. Please see our contribution guide for more details.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

3 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for kevinob from gravatar.com kevinob Avatar for oavdeev from gravatar.com oavdeev Avatar for valay-ob from gravatar.com valay-ob

Credits

Author: Netflix, Outerbounds & the Metaflow Community

License

Apache License 2.0

Provides Extra

stubs dev

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ob_metaflow-2.19.37.1.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ob_metaflow-2.19.37.1-py2.py3-none-any.whl (1.8 MB view details)

Uploaded Python 2Python 3

File details

Details for the file ob_metaflow-2.19.37.1.tar.gz.

File metadata

  • Download URL: ob_metaflow-2.19.37.1.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.25

File hashes

Hashes for ob_metaflow-2.19.37.1.tar.gz
Algorithm Hash digest
SHA256 57cabfb1dcca63cde68d0fef334e8f400e84e0469fda7420af6eb1117f2471f9
MD5 283d3a685771a76da3ad5c8ec23f6c8b
BLAKE2b-256 a771e1ef6b337a40a688f3371b020edcf36715efdfc73f8ca7d0a1314cc2f54d

See more details on using hashes here.

File details

Details for the file ob_metaflow-2.19.37.1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for ob_metaflow-2.19.37.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 f6901d45995df0f14f1a3531846026832bce2a2e938003678ebe488c645824f6
MD5 d7800652af7efad42ec9b9f2cf434307
BLAKE2b-256 fa064678f528676af8fa0554817026e5983e42b2c7946048cdd36ac1b03850b4

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

2.19.37.1

2.19.36.1

2.19.35.1

2.19.34.1

2.19.33.1

2.19.32.3rc1 pre-release

2.19.32.3rc0 pre-release

2.19.32.2

2.19.32.1

2.19.31.1

2.19.30.1

2.19.29.2

2.19.29.1

2.19.28.2

2.19.28.1

2.19.27.1

2.19.26.1

2.19.25.1

2.19.24.1

2.19.23.1

2.19.22.1

2.19.21.2rc2 pre-release

2.19.21.2rc1 pre-release

2.19.21.2rc0 pre-release

2.19.21.1

2.19.20.1

2.19.19.2

2.19.19.1

2.19.18.1

2.19.17.1

2.19.15.4

2.19.15.3

2.19.15.2

2.19.15.1

2.19.14.1

2.19.13.1

2.19.12.3

2.19.11.1

2.19.9.2rc0 pre-release

2.19.9.1

2.19.8.1

2.19.7.1

2.19.7.1rc0 pre-release

2.19.5.1

2.19.4.1

2.19.3.1

2.19.2.1

2.19.1.1

2.19.0.1

2.18.13.1

2.18.12.1

2.18.11.1

2.18.10.1

2.18.9.2

2.18.9.1

2.18.7.5

2.18.7.4

2.18.7.2

2.18.7.1

2.18.5.1

2.18.4.1

2.18.3.2

2.18.3.1

2.18.2.1

2.18.1.1

2.18.0.1

2.17.3.1

2.17.1.0

2.17.0.1

2.16.8.2

2.16.8.2rc2 pre-release

2.16.8.2rc1 pre-release

2.16.8.2rc0 pre-release

2.16.8.1

2.16.6.5rc3 pre-release

2.16.6.5rc2 pre-release

2.16.6.5rc1 pre-release

2.16.6.4

2.16.6.4rc0 pre-release

2.16.6.3

2.16.6.2rc1 pre-release

2.16.6.1

2.16.5.1

2.16.4.8

2.16.4.6

2.16.4.5

2.16.4.4

2.16.4.3

2.16.4.2

2.16.4.1

2.16.3.2

2.16.3.1

2.16.2.1

2.16.1.1

2.16.0.1

2.15.21.5

2.15.21.5rc0 pre-release

2.15.21.4

2.15.21.3

2.15.21.2

2.15.21.1

2.15.18.1

2.15.17.1

2.15.15.1

2.15.14.1

2.15.13.1

2.15.11.2

2.15.11.1

2.15.10.1

2.15.7.2

2.15.7.1

2.15.6.1

2.15.5.1

2.15.3.1

2.15.0.1

2.14.3.1

2.14.2.1

2.14.0.2rc0 pre-release

2.14.0.1

2.13.10.1

2.13.9.2

2.13.9.1

2.13.8.1

2.13.7.1

2.13.6.1

2.13.4.1

2.13.3.1

2.13.2.1

2.13.1.1

2.13.0.1

2.12.39.1

2.12.36.3

2.12.36.2 yanked

2.12.36.1

2.12.35.1

2.12.33.1

2.12.32.1

2.12.30.2

2.12.30.1

2.12.27.1

2.12.26.1

2.12.25.2

2.12.25.1

2.12.24.1

2.12.23.1

2.12.22.1

2.12.20.1

2.12.19.1

2.12.18.2

2.12.18.1

2.12.17.1

2.12.16.1

2.12.15.1

2.12.14.1

2.12.12.0

2.12.11.0

2.12.10.2

2.12.10.1

2.12.10.1rc2 pre-release

2.12.10.1rc1 pre-release

2.12.9.1

2.12.7.2

2.12.7.1

2.12.6.1

2.12.5.2

2.12.5.1

2.12.4.2

2.12.4.1

2.12.1.1

2.12.0.1

2.11.16.2

2.11.16.1

2.11.15.3

2.11.15.2

2.11.15.1

2.11.14.1

2.11.13.1

2.11.10.3

2.11.10.2

2.11.10.1

2.11.9.1

2.11.8.1

2.11.4.9

2.11.4.8

2.11.4.2

2.11.4.1

2.11.0.4

2.11.0.3

2.11.0.2

2.11.0.1

2.10.11.1

2.10.10.1

2.10.9.2

2.10.9.1

2.10.7.4

2.10.7.3

2.10.7.2

2.10.7.1

2.10.3.1

2.10.2.7

2.10.2.6

2.10.1.6

2.9.10.1

2.9.8.2

2.9.7.2

2.9.4.1

2.9.4

2.9.1.3

2.8.4.2

2.8.4.1

2.8.3.1

2.8.1.1rc3 pre-release

2.8.1.1rc2 pre-release

2.8.1.1rc1 pre-release

2.8.1rc0 pre-release

2.8.0.1

2.7.22.1

2.7.21.5rc3 pre-release

2.7.21.5rc2 pre-release

2.7.21.5rc1 pre-release

2.7.21.5rc0 pre-release

2.7.21.4

2.7.21.3

2.7.21.2

2.7.21.1

2.7.21.1rc0 pre-release

2.7.19.7

2.7.19.6

2.7.19.5

2.7.13.5

2.7.13.4

2.7.13.3

2.7.13.2

2.7.13.1

2.7.13

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page