The data engineering library to build robust, reliable and on time data pipelines in Python.
Project description
dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
Run tests in repo root
pytest -s
For a specific test
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
Troubleshooting errors
If an error occurs, try removing .pytest_cache and __pycache__
- can happen after devcontainers build
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
### S3 / Minio for testing in VS code devcontainers
- Go to http://localhost:9011
- Login with: username: admin and password: hello123
- bucket: dataplanebucket
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataplane-0.0.17.tar.gz
(10.6 kB
view hashes)
Built Distribution
dataplane-0.0.17-py3-none-any.whl
(20.1 kB
view hashes)
Close
Hashes for dataplane-0.0.17-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1605449d8a7e418e054197cd2f85c0d4afb79b2afe9c794cdecdb530fcd1348a |
|
MD5 | 3d0399a11588d0c6215ef95cf9983154 |
|
BLAKE2b-256 | 1b7fcdf7f9479ee6996363e52c4d1dcb08578f8ed0d1d833d950103f5a82e9a1 |