Pluggable versioned metadata management for incremental multi-modal pipelines.
Project description
Metaxy
Metaxy is a metadata layer for multi-modal Data and ML pipelines. Metaxy tracks feature versions, (partial) data dependencies, and lineage across complex computation graphs.
Metaxy's goal is to provide a standard instrument for any kind of multi-modal (or just tabular) incremental pipelines, standardizing dependency specification, versioning, partial data dependencies, manipulations over metadata, migrations, and more.
Read the docs to learn more.
Installation
Warning: Metaxy hasn't been publicly released yet, but you can try the latest dev release:
pip install --pre metaxy
Integrating Metaxy in your project
Metaxy is highly pluggable and generally can be used with any kind of incremental pipelines, storage, metadata stores, and dataframe libraries.
Metaxy provides integrations with popular tools such as Dagster, ClickHouse, DeltaLake, SQLModel.
The full list can be found here.
Contributing
See CONTRIBUTING.md.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file metaxy-0.0.1.dev6-py3-none-any.whl.
File metadata
- Download URL: metaxy-0.0.1.dev6-py3-none-any.whl
- Upload date:
- Size: 281.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d6272a9e4eb273972aff71e721cc8b24f01d0bd4d5d3f1f5cca2650728f6d433
|
|
| MD5 |
8a5a043fa515e13decd5f9a0957d9df9
|
|
| BLAKE2b-256 |
ab91777211c745fc584d4bbb3270c022cb0edf877c19355fd5a6d3f90131a138
|
