Prefect
Prefect is an orchestrator for data-intensive workflows. It's the simplest way to transform any Python function into a unit of work that can be observed and orchestrated. With Prefect, you can build resilient, dynamic workflows that react to the world around them and recover from unexpected changes. With just a few decorators, Prefect supercharges your code with features like automatic retries, distributed execution, scheduling, caching, and much more. Every activity is tracked and can be monitored with the Prefect server or Prefect Cloud dashboard.
from prefect import flow, task
from typing import List
import httpx
@task(retries=3)
def get_stars(repo: str):
url = f"https://api.github.com/repos/{repo}"
count = httpx.get(url).json()["stargazers_count"]
print(f"{repo} has {count} stars!")
@flow(name="GitHub Stars")
def github_stars(repos: List[str]):
for repo in repos:
get_stars(repo)
# run the flow!
github_stars(["PrefectHQ/Prefect"])
After running some flows, fire up the Prefect UI to see what happened:
prefect server start
From here, you can continue to use Prefect interactively or deploy your flows to remote environments, running on a scheduled or event-driven basis.
Getting Started
Prefect requires Python 3.8 or later. To install Prefect, run the following command in a shell or terminal session:
pip install prefect
Start by then exploring the core concepts of Prefect workflows, then follow one of our friendly tutorials to learn by example.
Join the community
Prefect is made possible by the fastest growing community of thousands of friendly data engineers. Join us in building a new kind of workflow system. The Prefect Slack community is a fantastic place to learn more about Prefect, ask questions, or get help with workflow design. The Prefect Discourse is a community-driven knowledge base to find answers to your Prefect-related questions. All community forums, including code contributions, issue discussions, and slack messages are subject to our Code of Conduct.
Contribute
See our documentation on contributing to Prefect.
Thanks for being part of the mission to build a new kind of workflow system and, of course, happy engineering!
3 maintainers
Release files for prefect 2.13.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| prefect-2.13.6.tar.gz | 2.4 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| prefect-2.13.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 5.0 MB
Release files / prefect-2.13.6.tar.gz
| Download URL | prefect-2.13.6.tar.gz |
|---|---|
| Size | 2.4 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e031edb8a9cf916658fed3c8bc796820742859e68eaed47627d12409e93d521f
|
|
BLAKE2b-256 checksum How to use checksums |
3cdc9b4456fb62a7ba5a90bafa7840390b6c1f6e70aebed2f3376d73fd3ba839
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|
Release files / prefect-2.13.6-py3-none-any.whl
| Download URL | prefect-2.13.6-py3-none-any.whl |
|---|---|
| Size | 2.6 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f2a6fc7fac5eb7b4987d0eea30470150630110c221409466ffa78ddc7126fa78
|
|
BLAKE2b-256 checksum How to use checksums |
a76df2affd7c772237f807b5cbe0edd6c45f946b7d0efbafcaf2b86f12fd9877
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|
