sparglim
Project description
Sparglim
Sparglim is aimed at providing a clean solution for PySpark applications in cloud-native scenarios (On K8S、Connect Server etc.).
Feature
Config pyspark via Environment Variables
SQL Magic
Connect Server daemon
Install
pip install sparglim
Usage
Develop
Install pre-commit before commit
pip install pre-commit
pre-commit install
Install package locally
pip install -e .[test]
Run unit-test before PR, ensure that new features are covered by unit tests
pytest -v
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sparglim-0.1.0rc3.tar.gz
(22.8 kB
view hashes)
Built Distribution
Close
Hashes for sparglim-0.1.0rc3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85dc15ea830bd55727f9cb588f7db7e646b26d10a0e008e615c9e978a4555627 |
|
MD5 | 61f8c58ad77cf1a1a9a5f95e694d74e8 |
|
BLAKE2b-256 | 961b354b538cf019220bebd01c641dbde207db0144171a141fbc935c0f809e7f |