Write maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develop locally, deploy to the cloud.
Project description
Join our community | Newsletter | Contact us | Docs | Blog | Website | YouTube
Ploomber is the fastest way to build data pipelines ⚡️. Use your favorite editor (Jupyter, VSCode, PyCharm) to develop interactively and deploy ☁️ without code changes (Kubernetes, Airflow, AWS Batch, and SLURM). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.
Installation
Compatible with Python 3.6 and higher.
Install with pip:
pip install ploomber
Or with conda:
conda install ploomber -c conda-forge
Getting started
Open a hosted JupyterLab instance:
or learn it locally in 2 minutes:
pip install ploomber --upgrade
python -m ploomber.onboard
What's next?
Ready to migrate your project? Click here.
Do you want to learn more? Check out the introductory tutorial.
Run more examples.
Community
Main Features
⚡️ Get started quickly
A simple YAML API to get started quickly, a powerful Python API for total flexibility.
https://user-images.githubusercontent.com/989250/150660813-fc289c6c-0ed5-432d-b6df-063ce98c0093.mp4
⏱ Shorter development cycles
Automatically cache your pipeline’s previous results and only re-compute tasks that have changed since your last execution.
https://user-images.githubusercontent.com/989250/150660820-9a3a0abd-5904-492b-97ff-5494285dfebf.mp4
☁️ Deploy anywhere
Run as a shell script in a single machine or distributively in Kubernetes, Airflow, AWS Batch, or SLURM.
https://user-images.githubusercontent.com/989250/150660830-3f81c9a2-5392-49e5-976d-cb8a38441ecb.mp4
📙 Automated migration from legacy notebooks
Bring your old monolithic notebooks, and we’ll automatically convert them into maintainable, modular pipelines.
https://user-images.githubusercontent.com/989250/150660840-b0c12f85-504c-4233-8c3d-6724d291f1aa.mp4
I want to migrate my notebook.
Resources
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ploomber-0.19.5.tar.gz.
File metadata
- Download URL: ploomber-0.19.5.tar.gz
- Upload date:
- Size: 280.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
79b311d0839492c621203b7d338b9e108b4e4f280dcc74b549e0b67c2c08312e
|
|
| MD5 |
af2bf214e1b4a4454baa9a118949419f
|
|
| BLAKE2b-256 |
f7d38e65a7780739f02f117654b7cca3211bad0a0a1d53fde37a32c69320ee46
|
File details
Details for the file ploomber-0.19.5-py3-none-any.whl.
File metadata
- Download URL: ploomber-0.19.5-py3-none-any.whl
- Upload date:
- Size: 327.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aec10bb24a4092061c6d259b32524ce9b9599949cd859d4e71a170bcaba70706
|
|
| MD5 |
f7ffdd19edee44a8c3f47905188f1eaa
|
|
| BLAKE2b-256 |
9f4ecc1e805c3a5b5c51a254f4d0dbda53d473398f04a6312aa18a096bf3bb5a
|
