A data orchestrator for machine learning, analytics, and ETL.
Project description
Dagster
Dagster is a data orchestrator for machine learning, analytics, and ETL.
Dagster lets you define pipelines in terms of the data flow between reusable, logical components, then test locally and run anywhere. With a unified view of pipelines and the assets they produce, Dagster can schedule and orchestrate Pandas, Spark, SQL, or anything else that Python can invoke.
Dagster is designed for data platform engineers, data engineers, and full-stack data scientists. Building a data platform with Dagster makes your stakeholders more independent and your systems more robust. Developing data pipelines with Dagster makes testing easier and deploying faster.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dagster_custom-0.12.14.tar.gz
.
File metadata
- Download URL: dagster_custom-0.12.14.tar.gz
- Upload date:
- Size: 893.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5179bd1a30b827e7d555f3d52a13cb967ef0859c9128d9db987be6ba7e0600e0 |
|
MD5 | 5b2977939f9a4a9cffef4ec454f9a71f |
|
BLAKE2b-256 | b5f535f78118edcc2577a400f2aa62c7463c59dee68215fd826f6b159b89aac8 |
File details
Details for the file dagster_custom-0.12.14-py3-none-any.whl
.
File metadata
- Download URL: dagster_custom-0.12.14-py3-none-any.whl
- Upload date:
- Size: 1.2 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b94e6ac20182a1ff59e6f79ced0dc23d74b87e61a9d40144e450671e1dca86b6 |
|
MD5 | 53385c5bd06de593ae4a88ac35a4d52c |
|
BLAKE2b-256 | ff1f2d38715a75656fe73359f4ade2a61e3179ad6c42b19c4b92879fdceb564d |