Pluggable versioned metadata management for incremental multi-modal pipelines.
Project description
Metaxy
Metaxy is a metadata layer for multi-modal Data and ML pipelines. Metaxy tracks feature versions, data dependencies - including multi-modal components - and lineage across complex computational graphs.
Metaxy's goal is to provide a standard instrument for any kind of multi-modal (or just purely tabular) incremental pipelines, standardizing dependency specification, versioning, partial data dependencies, and manipulations with metadata.
Read the docs to discover more about Metaxy.
Installation
Warning: Metaxy hasn't been publicly released yet, but you can try the latest dev release:
pip install --pre metaxy
Integrating Metaxy in your project
Metaxy is highly pluggable and generally can be used with any kind of incremental pipelines, storage, metadata storage, and dataframe libraries.
Metaxy provides integrations with popular tools such as Dagster, ClickHouse, DeltaLake, SQLModel.
The full list can be found here.
Contributing
See CONTRIBUTING.md.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file metaxy-0.0.1.dev19-py3-none-any.whl.
File metadata
- Download URL: metaxy-0.0.1.dev19-py3-none-any.whl
- Upload date:
- Size: 309.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3d7adc1db46ad12c3bddb4efb5a6cf7b108db9604ebb3a9567987c53dc72064d
|
|
| MD5 |
d583df1270c4c0890b7099c1d769e3ef
|
|
| BLAKE2b-256 |
373fb80b9a84cf1ed2a51806b5044adccb51f5b90e7ec2b8a500d07f8beeb8ac
|
