The data engineering library to build robust, reliable and on time data pipelines in Python.
Project description
dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
Run tests in repo root
pytest -s
For a specific test
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
Troubleshooting errors
If an error occurs, try removing .pytest_cache and __pycache__
- can happen after devcontainers build
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
### S3 / Minio for testing in VS code devcontainers
- Go to http://localhost:9011
- Login with: username: admin and password: hello123
- bucket: dataplanebucket
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataplane-0.0.19.tar.gz
(10.9 kB
view hashes)
Built Distribution
dataplane-0.0.19-py3-none-any.whl
(21.7 kB
view hashes)
Close
Hashes for dataplane-0.0.19-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3df592b2bc8e0e1e01f2c66e2cb57c612e69cbc9bfc0aa3a67dea4a74a247180 |
|
MD5 | 89f63cf0bd6b57d7a63a0301cc893e30 |
|
BLAKE2b-256 | 65a877685f28112c8c349fbbd04a05695b0632d63f8bc0598713a3d80740fa86 |