Ordeq is a framework that simplifies IO and modularizes pipeline logic
Project description
Welcome to Ordeq!
Ordeq is a framework for developing data pipelines. It simplifies IO and modularizes pipeline logic. Ordeq elevates your proof-of-concept to a production-grade pipelines. See the introduction for an easy-to-follow example of how Ordeq can help.
Installation
Ordeq is lightweight with 0 dependencies.
To install Ordeq, run:
uv pip install ordeq
Integrations
Ordeq integrates seamlessly with existing tooling. It provides out-of-the-box integrations with 25+ popular libraries. In total, Ordeq offers over 100 IOs via these integrations.
You can install them as needed.
For example, for reading and writing data with Pandas, install the ordeq-pandas package:
uv pip install ordeq-pandas
Some of the available integrations:
Data processing
|
Pandas |
Spark |
Numpy |
Polars |
Ibis |
Joblib |
HuggingFace |
Pillow |
|
st |
Requests |
Pydantic |
DuckDB |
NetworkX |
TOML |
PyMuPDF |
ChromaDB |
Plotting
|
Matplotlib |
Altair |
Plotly Express |
Cloud storage
|
Google Cloud Storage |
Azure Storage Blob |
AWS S3 |
Boto3 |
Bigquery |
Have a look at the package overview and API reference for a list of available packages.
Documentation
Documentation is available at https://ing-bank.github.io/ordeq/.
Why consider Ordeq?
- Ordeq is the GenAI companion: it gives your project structure and consistency, such that GenAI can thrive
- It offers seamless integrations with existing data & ML tooling, such as Spark, Pandas, Pydantic and PyMuPDF, and adding new integrations is trivial
- It's actively developed and trusted by data scientists, engineers, analysts and machine learning engineers at ING
Learning Ordeq
To learn more about Ordeq, check out the following resources:
- See how Ordeq can help your project in the introduction
- Check out the core concepts to learn how to use Ordeq
- Explore the example projects to see how Ordeq is used
Visualizing pipelines
Ordeq makes it easy to visualize your pipelines like this with a single line of code. Read more in the documentation.
The following figure shows an example Ordeq pipeline of a Retrieval-Augmented Generation (RAG) pipeline visualized with Mermaid:
Acknowledgements
Ordeq builds upon design choices and ideas from Kedro and other frameworks. It has been developed at ING, with contributions from various individuals. Please refer to the acknowledgements section in the documentation for more details.
License
Ordeq is available under the MIT license. Please refer to the license and notice for more details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ordeq-1.4.2.tar.gz.
File metadata
- Download URL: ordeq-1.4.2.tar.gz
- Upload date:
- Size: 31.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aa59d57bdfd61e0465c32740d3f7d747799291d0c4fb18d2d77cabddacbd53ae
|
|
| MD5 |
8501d57a57ce32e7ea27dec22c3fd8a8
|
|
| BLAKE2b-256 |
6de65fc3c812185baa68101da580b5a1166e9eebb3d9dcffba48a16d7fb9e8f1
|
File details
Details for the file ordeq-1.4.2-py3-none-any.whl.
File metadata
- Download URL: ordeq-1.4.2-py3-none-any.whl
- Upload date:
- Size: 34.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a95e4dde1aaa393fc863df824be79deef7604244df4d52840f6391585f50dfb9
|
|
| MD5 |
d5f52cb2f7b30099f11860c4fde8b94a
|
|
| BLAKE2b-256 |
23ec7c18903c2a69ba3ad0e304356b7b883c5fd7a309afa003ad8ec707b30348
|