The data engineering library to build robust, reliable and on time data pipelines in Python.
Project description
dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
Run tests in repo root
pytest -s
For a specific test
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
Troubleshooting errors
If an error occurs, try removing .pytest_cache and __pycache__
- can happen after devcontainers build
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
### S3 / Minio for testing in VS code devcontainers
- Go to http://localhost:9011
- Login with: username: admin and password: hello123
- bucket: dataplanebucket
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataplane-0.1.1.tar.gz
(11.0 kB
view hashes)
Built Distribution
dataplane-0.1.1-py3-none-any.whl
(21.7 kB
view hashes)
Close
Hashes for dataplane-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d824450e78f1948b051323e4b211748864e4b10a3f0abe0d90da6073f9420914 |
|
MD5 | e379f79e1ca7d8058804d42edea88252 |
|
BLAKE2b-256 | c2a26ca8ad7a5208ccff34c5b70b9d34bf57563f716d033cc9c6e120c01e4a5c |