sparglim
Project description
Sparglim
Sparglim is aimed at providing a clean solution for PySpark applications in cloud-native scenarios (On K8S、Connect Server etc.).
Feature
Config pyspark via Environment Variables
SQL Magic
Connect Server daemon
Install
pip install sparglim
Usage
Develop
Install pre-commit before commit
pip install pre-commit
pre-commit install
Install package locally
pip install -e .[test]
Run unit-test before PR, ensure that new features are covered by unit tests
pytest -v
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparglim-0.1.0rc2.tar.gz
(22.5 kB
view hashes)
Built Distribution
Close
Hashes for sparglim-0.1.0rc2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9bf7c55ef07bed6a8f838c8a42c0c2102f1c01aae2968a40d285f3d455575b16 |
|
MD5 | 690ed6ebb4555ff318b054d470def7b8 |
|
BLAKE2b-256 | 0a913d602074e813daab7ddf16244bc0d1116ccafbc7adc9393e302b56c12b91 |