A common set of python libraries for DataBricks
Project description
atc-dataplatform
A common set of python libraries for DataBricks
Important Notes
This package can not be run or tested without access to pyspark. However, installing pyspark as part of our installer gave issues when other versions of pyspark were needed. Hence we took out the dependency from our installer.
Development Notes
Git Hooks
Please install the git hooks in your repository by running
python utilities/git_hooks.py
The hooks will help you catch problems locally instead of having to wait for the PR pipeline to fail.
Testing
To run the tests you will need these dependencies
- Java 8
pip install -r test_requirements.txt
Then, execute tests by running
python setup.py develop
pytest tests
If these tests don't pass, PRs will not be accepted. If you add features, please include tests for these features.
General Project Info
Packages
Build Status
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for atc_dataplatform-0.1.17-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6aeeb45540b738c3ceb64a07e8755d9ef0c303888cf6bd0cc88e5a4b13f46874 |
|
MD5 | 48c08163bc5c1a917c393f16fb504241 |
|
BLAKE2b-256 | f576d688dcc5f50bf4ed63372f2cb6c4a730e7c10471d3f3f9a5b5713645cd3d |