A data loading and transformation engine for data lakehouses
Project description
Loadhouse
A powerful ETL (Extract, Transform, Load) tool designed for data lakehouse architectures with JSON-based configuration.
Overview
Loadhouse is a flexible data processing tool that simplifies ETL operations through JSON configuration. It supports various data sources and provides robust data transformation capabilities using Apache Spark.
Features
-
Configurable Data Sources
- File-based (CSV, Delta, etc.)
- JDBC connections
- SQL queries
- DataFrame operations
-
Data Transformations
- Expression filtering
- Custom transformations
- Data quality validation
-
Multiple Output Formats
- Delta Lake
- File formats (CSV, Parquet, etc.)
- Console output for debugging
-
Quality Checker
- Data quality patterns with Apache Airflow
- Unit test Spark
- Data validation with GX
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file loadhouse-0.1.3.tar.gz.
File metadata
- Download URL: loadhouse-0.1.3.tar.gz
- Upload date:
- Size: 19.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5a7473fe6b3e274dbcfe5ff766690e1dfd22a6196ff291dd805df4c4d8a701f3
|
|
| MD5 |
a9f8bb1aa51db094fc21c02d0b5d0787
|
|
| BLAKE2b-256 |
9783f449c68289950e4e972322f5fddc5093f103205aeac4ab2f217ddef07ce2
|
Provenance
The following attestation bundles were made for loadhouse-0.1.3.tar.gz:
Publisher:
loadhouse.yml on flynn3103/loadhouse
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
loadhouse-0.1.3.tar.gz -
Subject digest:
5a7473fe6b3e274dbcfe5ff766690e1dfd22a6196ff291dd805df4c4d8a701f3 - Sigstore transparency entry: 173706881
- Sigstore integration time:
-
Permalink:
flynn3103/loadhouse@925046e7050d779ffa29028467ca2642747f9230 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/flynn3103
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
loadhouse.yml@925046e7050d779ffa29028467ca2642747f9230 -
Trigger Event:
push
-
Statement type:
File details
Details for the file loadhouse-0.1.3-py3-none-any.whl.
File metadata
- Download URL: loadhouse-0.1.3-py3-none-any.whl
- Upload date:
- Size: 29.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fd216f33a8468644991a1c05ccaea1cfd25c18136ff6c5450b4d563301a1f340
|
|
| MD5 |
7059bf1a440d7df8e1482b2d8656a990
|
|
| BLAKE2b-256 |
f21cabf59c4c4a5cb9ab5e14cc9bdfdd5ad4893f65299c35781fe85fc446de4b
|
Provenance
The following attestation bundles were made for loadhouse-0.1.3-py3-none-any.whl:
Publisher:
loadhouse.yml on flynn3103/loadhouse
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
loadhouse-0.1.3-py3-none-any.whl -
Subject digest:
fd216f33a8468644991a1c05ccaea1cfd25c18136ff6c5450b4d563301a1f340 - Sigstore transparency entry: 173706882
- Sigstore integration time:
-
Permalink:
flynn3103/loadhouse@925046e7050d779ffa29028467ca2642747f9230 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/flynn3103
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
loadhouse.yml@925046e7050d779ffa29028467ca2642747f9230 -
Trigger Event:
push
-
Statement type:
