Data Vault automation for Apache Spark
Project description
SparkDV
SparkDV — это лёгкая библиотека для автоматизации построения моделей Data Vault 2.0 на Apache Spark. Поддерживаются основные сущности: Staging, Hub, Satellite и Link.
🚀 Возможности
- Автоматическая очистка и нормализация "сырых" данных (Stage)
- Генерация HUB-таблиц с бизнес-ключами и техническими метками
- Поддержка Satellite с HASHDIFF, датой актуальности и источником
- Автоматическая генерация Link-связей с вычислением хэшей
📦 Установка
Убедитесь, что у вас установлен PySpark
pip install sparkdv
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparkdv-0.1.0.tar.gz
(3.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sparkdv-0.1.0.tar.gz.
File metadata
- Download URL: sparkdv-0.1.0.tar.gz
- Upload date:
- Size: 3.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5e0b428321dde46e5d75d354d969ce6244095f6b1d0cd30860ab0752e552b3a0
|
|
| MD5 |
0fc4c754d17fa158bbd9e49f789e7b07
|
|
| BLAKE2b-256 |
cb09a9d0a775e63ce8a1d760d057cb6ce05eef5ea602e6145d3fcfb14b5ea5e7
|
File details
Details for the file sparkdv-0.1.0-py3-none-any.whl.
File metadata
- Download URL: sparkdv-0.1.0-py3-none-any.whl
- Upload date:
- Size: 3.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4cdaf6303b16f80fb7762b538ed4a7c826b6d7d973be0699bef222833d984881
|
|
| MD5 |
a32d33890e1f112e83c41fe958004ffe
|
|
| BLAKE2b-256 |
acfa7c48ac62ac8ab389d21f0f24d3f39edbb62adedb1aeacf9e70fcb48b2557
|
