A scalable, fast, ACID-compliant Data Catalog powered by Ray.
Project description
DeltaCAT - this is a new version - this is going to non-test
DeltaCAT is a Pythonic Data Catalog powered by Ray.
Its data storage model allows you to define and manage fast, scalable, ACID-compliant data catalogs through git-like stage/commit APIs, and has been used to successfully host exabyte-scale enterprise data lakes.
DeltaCAT uses the Ray distributed compute framework together with Apache Arrow for common table management tasks, including petabyte-scale change-data-capture, data consistency checks, and table repair.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltacat-fork-0.1.6.tar.gz
(95.1 kB
view hashes)
Built Distribution
deltacat_fork-0.1.6-py3-none-any.whl
(133.1 kB
view hashes)
Close
Hashes for deltacat_fork-0.1.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5fcee09b5bc8cb6de59ec113c1ef7c0919c05a5f7305b1c2df957cdae7b44893 |
|
MD5 | d172d67f80fd044ebe1c6cc115dda6db |
|
BLAKE2b-256 | d421e0031f7265f2d9b1d3b3ad1ce092cbd05bf62d64ae94df3425dd027c9386 |