A pandas extension built for OpenLineage
Project description
pandas-lineage
BEWARE: This project is in very early stages (as of 2022-09-12)
pandas-lineage is intended to extend the functionality of I/O and standard transform operations on a pandas dataframe to emit OpenLineage RunEvents. I am starting just with read/write operations emiting RunEvents with schema facets.
Badges:
Examples:
- marquez-examples
- contains getting started code and a script for running Marquez locally in Docker
- mock-api-example
- contains getting started code and a simple Flask API for sending lineage events to which will just always return a 200 status code
References:
- :green_heart: Marquez :green_heart:
- :green_heart: OpenLineage :green_heart:
- :green_heart: Pandas :green_heart:
Contributing:
I have not created any sort of contribution guide yet, but I don't want that to stop anyone! If you are interested in contributing, fork this repository and open a PR. As this becomes more feature-rich/useful, we will establish a contributors workflow. For now, please just use the pre-commit hooks.
Notes:
- The pandas-lineage directory structure (for now) will mirror the directory structure of pandas for the components that it is extending.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pandas_lineage-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7779a126ee6777e9b1c6dfa7c6fc727943da07809c68001ea3031708328bb0eb |
|
MD5 | a43201d1b045326e5cb4a6ae28d2c2aa |
|
BLAKE2b-256 | d8ad01377bfe103527c9ad104bf3c906143a26df015313d551045727ccdc1409 |