sparglim
Project description
Sparglim
Sparglim is aimed at providing a clean solution for PySpark applications in cloud-native scenarios (On K8S、Connect Server etc.).
Feature
Config pyspark via Environment Variables
SQL Magic
Connect Server daemon
Install
pip install sparglim
Usage
Develop
Install pre-commit before commit
pip install pre-commit
pre-commit install
Install package locally
pip install -e .[test]
Run unit-test before PR, ensure that new features are covered by unit tests
pytest -v
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparglim-0.1.0rc1.tar.gz
(22.2 kB
view hashes)
Built Distribution
Close
Hashes for sparglim-0.1.0rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f2d9e407f2568a1d52f70ee2a9762f085d7f6fcfe0cc7bee27c7e3d1b01c9b69 |
|
MD5 | 9b9e8351ba84b04aaeb2570fcfcc46cf |
|
BLAKE2b-256 | 5e6d9cae5c70eca659efc68bba649090808b6b68937136f5dddf75613c6879c0 |