Skip to main content

dadude

Lakehouse management and orchestration tool.

Status

  • The ultimate target lakehouse is the unity catalog, which is to provide benefits from both deltalake and iceberg.
  • To support writing data to the lakehouse, we currently use the deltalake-rs python bindings.
  • For testing purposes, we use the minio instance at http://192.168.18.206:9000.

Installation

This package is published to the PyPI repository, so you can install it using pip anywhere:

pip install dadude

Usage

First export the following environment variables:

export STORAGE_ACCESS_KEY_ID=xxx STORAGE_SECRET_ACCESS_KEY=xxx STORAGE_ENDPOINT_URL=http://192.168.18.206:9000

Then you can use the dadude module CLI to interact with the lakehouse:

python -m dadude.cli.read_table staging <table_name> --save_dir <save_dir>
python -m dadude.cli.write_table write_json_table --local_json_file_path data/silver/xxx.json

Metadata

Release files for dadude 0.3.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dadude 0.3.5
File Size Uploaded Provenance Actions
dadude-0.3.5.tar.gz 141.0 kB Without provenance Details for dadude-0.3.5.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for dadude 0.3.5
File Interpreter ABI Platform Actions
dadude-0.3.5-py3-none-any.whl Python 3 none any Details for dadude-0.3.5-py3-none-any.whl

Total release size: 162.7 kB

Release files / dadude-0.3.5.tar.gz

Download URL dadude-0.3.5.tar.gz
Size 141.0 kB
Tags Source
SHA-256 checksum
How to use checksums
17c4134650f845287a85866530c2b762f996392d2238ac34ac5e02af27f94ba8
BLAKE2b-256 checksum
How to use checksums
9d9ef488286a00a3d93351eabcbb01055709f1851a9f8380a9a80b815a50755a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.5.1

Release files / dadude-0.3.5-py3-none-any.whl

Download URL dadude-0.3.5-py3-none-any.whl
Size 21.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ebf6f4c0968fb1e3a736b3bfa995a8ba32e939460605b7f4b93c93dcf2d01772
BLAKE2b-256 checksum
How to use checksums
d069125f9c6138054363123041a1092114e25e2ac8556ceeee0a2709fe76d7d2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.5.1

Security for dadude 0.3.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page