The Curator helps you define pipelines for transforming dirty data into consumable databases.
Usage
from thecurator import Curator
# Paths to files describing different tables
table_descriptions = ['patient.yml', 'lab.yml']
curator = Curator(sqlalchemy_engine, table_descriptions)
# Transform a pandas DataFrame according to the descriptions
curator.transform_df('patient', patient_df)
# Transform a dictionary array according to the descriptions
curator.transform_dicts('patient', patient_dicts)
# Transform and insert a according to the descriptions
curator.insert_dicts('lab', lab_dicts)See the tests. More coming soon…
Development
Install development requirements pip install -r dev-requirements.txt
Make changes
Run the tests pytest tests
Release
https://packaging.python.org/tutorials/distributing-packages/ gpg –detach-sign -a dist/package-1.0.1.tar.gz twine upload dist/*
twine upload –repository-url https://test.pypi.org/legacy/ dist/*
1 maintainer
Metadata
1 maintainer
Release files for The-Curator 0.1.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| The Curator-0.1.2.tar.gz | 5.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| The_Curator-0.1.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 12.6 kB
Release files / The Curator-0.1.2.tar.gz
| Download URL | The Curator-0.1.2.tar.gz |
|---|---|
| Size | 5.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a7d6099bc5baf4e9e779949fd879d5a7642c67c498476976d1d7c761b595e9d4
|
|
BLAKE2b-256 checksum How to use checksums |
b0bceb69c037e63bea170941e719521fe925f2ddeddd78c0ccb10a569ddb030c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / The_Curator-0.1.2-py3-none-any.whl
| Download URL | The_Curator-0.1.2-py3-none-any.whl |
|---|---|
| Size | 7.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
6f9dd93ede6807792a2dc80fa9cd1de4e7674226138723199130fbf42cfb9b0f
|
|
BLAKE2b-256 checksum How to use checksums |
246015ff6621de037a97e0a81a7ce5201bc73b83e5737f338ce99dd6f8c21bfc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
