A common set of python libraries for DataBricks
Project description
atc-dataplatform
A common set of python libraries for DataBricks
Important Notes
This package can not be run or tested without access to pyspark. However, installing pyspark as part of our installer gave issues when other versions of pyspark were needed. Hence we took out the dependency from our installer.
Installation
pip install atc-dataplatform
Development Notes
To prepare for development please install these additional requirements:
- Java 8
pip install -r test_requirements.txt
Then install the package locally
python setup.py develop
Git Hooks
Please install the git hooks in your repository by running
python utilities/git_hooks.py
The hooks will help you catch problems locally instead of having to wait for the PR pipeline to fail.
Testing
After installing the dev-requirements, execute tests by running
pytest tests
If these tests don't pass, PRs will not be accepted. If you add features, please include tests for these features.
General Project Info
Packages
Build Status
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for atc_dataplatform-0.4.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 174271412f651807e4e772be3aa21be73382b1ddb9d97012e19dbe33f58dab6e |
|
MD5 | 5dd722a3dd038ea7afd533207df5d1af |
|
BLAKE2b-256 | 2f1d2e86d81c4c329cc387f116f302de086c7d1c1359683c43cb80949f155107 |