The Curator helps you define pipelines for transforming dirty data into consumable databases.
Usage
from thecurator import Curator
# Paths to files describing different tables
table_descriptions = ['patient.yml', 'lab.yml']
curator = Curator(sqlalchemy_engine, table_descriptions)
# Transform a pandas DataFrame according to the descriptions
curator.transform_df('patient', patient_df)
# Transform a dictionary array according to the descriptions
curator.transform_dicts('patient', patient_dicts)
# Transform and insert a dictionary array according to the descriptions
curator.insert_dicts('lab', lab_dicts)See the tests for more examples. More coming soon…
Development
Install development requirements pip install -r dev-requirements.txt
Make changes
Run the tests pytest tests
See the Makefile for other useful commands
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thecurator-0.2.1.tar.gz
(5.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file thecurator-0.2.1.tar.gz.
File metadata
- Download URL: thecurator-0.2.1.tar.gz
- Upload date:
- Size: 5.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
170da25b86b7e406b7bafd88f9dc8538220dadd30648625fa89e66612b7026b4
|
|
| MD5 |
418cb75f49f5d2b2594a0c761795e6a4
|
|
| BLAKE2b-256 |
cb3c8bd8e38ad3f1d7d898248e0f9be87210717da385f3d8c295bd77f1bd6de6
|
File details
Details for the file thecurator-0.2.1-py3-none-any.whl.
File metadata
- Download URL: thecurator-0.2.1-py3-none-any.whl
- Upload date:
- Size: 7.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7b1c2b90a6c76b6760d31bf19d1b0811561a67aa1d36a783796cd26c4b287eab
|
|
| MD5 |
dfd0d2e4fbc11fead92121b6938f7bc3
|
|
| BLAKE2b-256 |
e4cba79ae7a4d8c6a65701e21789b9d4f8d4c81214c5b76c04a20164ab34be0f
|
