The data engineering library to build robust, reliable and on time data pipelines in Python.
Project description
dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
Run tests in repo root
pytest -s
For a specific test
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
Troubleshooting errors
If an error occurs, try removing .pytest_cache and __pycache__
- can happen after devcontainers build
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
### S3 / Minio for testing in VS code devcontainers
- Go to http://localhost:9011
- Login with: username: admin and password: hello123
- bucket: dataplanebucket
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataplane-0.0.20.tar.gz
(10.9 kB
view hashes)
Built Distribution
dataplane-0.0.20-py3-none-any.whl
(21.6 kB
view hashes)
Close
Hashes for dataplane-0.0.20-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fe1aeb4c98722e07ce6b39ea1129f0b85e319c06eee77a0b74c4207a9efe76ab |
|
MD5 | f3d0904305f24ffc5b3f7febb6852f04 |
|
BLAKE2b-256 | b857e66ad688ac1fefbec0dd6aec0395d73f72d7bb9f35b32c828f1e04ed5162 |