The data engineering library to build robust, reliable and on time data pipelines in Python.
Project description
dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
Run tests in repo root
pytest -s
For a specific test
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
Troubleshooting errors
If an error occurs, try removing .pytest_cache and __pycache__
- can happen after devcontainers build
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
### S3 / Minio for testing in VS code devcontainers
- Go to http://localhost:9011
- Login with: username: admin and password: hello123
- bucket: dataplanebucket
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dataplane-0.1.3.tar.gz
(11.0 kB
view hashes)
Built Distribution
dataplane-0.1.3-py3-none-any.whl
(21.7 kB
view hashes)
Close
Hashes for dataplane-0.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0efcf853e4c114c87b37d3c785c8e8725bcdb44bbad0b9da277e4e0a8a52878 |
|
MD5 | 566aad6c2c50f33bb62e0da5673638f4 |
|
BLAKE2b-256 | 88c4258b5cdb9709c98bda7053eacccf539d1635f4ea8765e3213a6e4cf77064 |