Smart Spark Optimizer: Skew Rebalancer + Key Detector + DRTree
Project description
HexaDruid
HexaDruid is a blazing-fast optimization engine for PySpark that intelligently:
- Detects and rebalances skewed columns using dynamic value bucketing
- Automatically detects primary keys and composite key candidates
- Splits your data logically using DRTree sharding
- Optionally tunes shuffle partitions
Installation
pip install .
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hexadruid-0.1.0.tar.gz
(21.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
hexadruid-0.1.0-py3-none-any.whl
(20.5 kB
view details)
File details
Details for the file hexadruid-0.1.0.tar.gz.
File metadata
- Download URL: hexadruid-0.1.0.tar.gz
- Upload date:
- Size: 21.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c750ec8326c4f4a75622ed8ff1305589ae844146ed8b9c5f12b0c196194f6cb8
|
|
| MD5 |
a0bdb246d1f7d892e9b8ec12a5dfa64b
|
|
| BLAKE2b-256 |
f8282949d273200b293e4a54a6653e120bc9c51b338c0c284af10e5dc413cd3a
|
File details
Details for the file hexadruid-0.1.0-py3-none-any.whl.
File metadata
- Download URL: hexadruid-0.1.0-py3-none-any.whl
- Upload date:
- Size: 20.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c2c8e97c769f9eead2be93c1333cda81abbf4085df637c1b11544981efdec329
|
|
| MD5 |
205a4e824e0dc27d105200f1704784db
|
|
| BLAKE2b-256 |
fce67584854aede26d665c107402b49c40bc2f0e70dd373ae77e516f84fcf23f
|
