dadude
Lakehouse management and orchestration tool.
Status
- The ultimate target lakehouse is the unity catalog, which is to provide benefits from both
deltalakeandiceberg. - To support writing data to the lakehouse, we currently use the
deltalake-rspython bindings. - For testing purposes, we use the
minioinstance athttp://192.168.18.206:9000.
Installation
This package is published to the PyPI repository, so you can install it using pip anywhere:
pip install dadude
Usage
First export the following environment variables:
export STORAGE_ACCESS_KEY_ID=xxx STORAGE_SECRET_ACCESS_KEY=xxx STORAGE_ENDPOINT_URL=http://192.168.18.206:9000
Then you can use the dadude module CLI to interact with the lakehouse:
python -m dadude.cli.read_table staging <table_name> --save_dir <save_dir>
python -m dadude.cli.write_table write_json_table --local_json_file_path data/silver/xxx.json
Metadata
Release files for dadude 0.3.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| dadude-0.3.5.tar.gz | 141.0 kB | Without provenance | Details for dadude-0.3.5.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| dadude-0.3.5-py3-none-any.whl | Python 3 | none | any | Details for dadude-0.3.5-py3-none-any.whl |
Total release size: 162.7 kB
Release files / dadude-0.3.5.tar.gz
| Download URL | dadude-0.3.5.tar.gz |
|---|---|
| Size | 141.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
17c4134650f845287a85866530c2b762f996392d2238ac34ac5e02af27f94ba8
|
|
BLAKE2b-256 checksum How to use checksums |
9d9ef488286a00a3d93351eabcbb01055709f1851a9f8380a9a80b815a50755a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.1
|
Release files / dadude-0.3.5-py3-none-any.whl
| Download URL | dadude-0.3.5-py3-none-any.whl |
|---|---|
| Size | 21.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ebf6f4c0968fb1e3a736b3bfa995a8ba32e939460605b7f4b93c93dcf2d01772
|
|
BLAKE2b-256 checksum How to use checksums |
d069125f9c6138054363123041a1092114e25e2ac8556ceeee0a2709fe76d7d2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.1
|
Security for dadude 0.3.5
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.