Skip to main content

Ordeq is a framework that simplifies IO and modularizes pipeline logic

Project description

Welcome to Ordeq!

Release Docs PyPI PyPI - Downloads License: MIT Static Badge

Ordeq is a framework for developing data pipelines. It simplifies IO and modularizes pipeline logic. Ordeq elevates your proof-of-concept to a production-grade pipelines. See the introduction for an easy-to-follow example of how Ordeq can help.

Installation

Ordeq is lightweight with 0 dependencies.

To install Ordeq, run:

uv pip install ordeq

Integrations

Ordeq integrates seamlessly with existing tooling. It provides out-of-the-box integrations with 25+ popular libraries. In total, Ordeq offers over 100 IOs via these integrations.

You can install them as needed. For example, for reading and writing data with Pandas, install the ordeq-pandas package:

uv pip install ordeq-pandas

Some of the available integrations:

Data processing

Pandas
Pandas
Spark
Spark
NumPy
Numpy
Polars
Polars
Ibis
Ibis
Joblib
Joblib
HuggingFace
HuggingFace
Pillow
Pillow
SentenceTransformers
st
Requests
Requests
Pydantic
Pydantic
DuckDB
DuckDB
Networkx
NetworkX
TOML
TOML
PyMuPDF
PyMuPDF
ChromaDB
ChromaDB

Plotting

Matplotlib
Matplotlib
Altair
Altair
Plotly Express
Plotly Express

Cloud storage

Google Cloud Storage
Google Cloud Storage
Azure
Azure Storage Blob
AWS S3
AWS S3
Boto3
Boto3
Bigquery
Bigquery

Have a look at the package overview and API reference for a list of available packages.

Documentation

Documentation is available at https://ing-bank.github.io/ordeq/.

Why consider Ordeq?

  • Ordeq is the GenAI companion: it gives your project structure and consistency, such that GenAI can thrive
  • It offers seamless integrations with existing data & ML tooling, such as Spark, Pandas, Pydantic and PyMuPDF, and adding new integrations is trivial
  • It's actively developed and trusted by data scientists, engineers, analysts and machine learning engineers at ING

Learning Ordeq

To learn more about Ordeq, check out the following resources:

Visualizing pipelines

Ordeq makes it easy to visualize your pipelines like this with a single line of code. Read more in the documentation.

The following figure shows an example Ordeq pipeline of a Retrieval-Augmented Generation (RAG) pipeline visualized with Mermaid:

RAG pipeline

Acknowledgements

Ordeq builds upon design choices and ideas from Kedro and other frameworks. It has been developed at ING, with contributions from various individuals. Please refer to the acknowledgements section in the documentation for more details.

License

Ordeq is available under the MIT license. Please refer to the license and notice for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ordeq-1.4.2.tar.gz (31.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ordeq-1.4.2-py3-none-any.whl (34.7 kB view details)

Uploaded Python 3

File details

Details for the file ordeq-1.4.2.tar.gz.

File metadata

  • Download URL: ordeq-1.4.2.tar.gz
  • Upload date:
  • Size: 31.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for ordeq-1.4.2.tar.gz
Algorithm Hash digest
SHA256 aa59d57bdfd61e0465c32740d3f7d747799291d0c4fb18d2d77cabddacbd53ae
MD5 8501d57a57ce32e7ea27dec22c3fd8a8
BLAKE2b-256 6de65fc3c812185baa68101da580b5a1166e9eebb3d9dcffba48a16d7fb9e8f1

See more details on using hashes here.

File details

Details for the file ordeq-1.4.2-py3-none-any.whl.

File metadata

  • Download URL: ordeq-1.4.2-py3-none-any.whl
  • Upload date:
  • Size: 34.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for ordeq-1.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 a95e4dde1aaa393fc863df824be79deef7604244df4d52840f6391585f50dfb9
MD5 d5f52cb2f7b30099f11860c4fde8b94a
BLAKE2b-256 23ec7c18903c2a69ba3ad0e304356b7b883c5fd7a309afa003ad8ec707b30348

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page