The Curator helps you define pipelines for transforming dirty data into consumable databases.
Usage
from thecurator import Curator
# Paths to files describing different tables
table_descriptions = ['patient.yml', 'lab.yml']
curator = Curator(sqlalchemy_engine, table_descriptions)
# Transform a pandas DataFrame according to the descriptions
curator.transform_df('patient', patient_df)
# Transform a dictionary array according to the descriptions
curator.transform_dicts('patient', patient_dicts)
# Transform and insert a dictionary array according to the descriptions
curator.insert_dicts('lab', lab_dicts)
See the tests for more examples. More coming soon…
Development
Install development requirements pip install -r dev-requirements.txt
Make changes
Run the tests pytest tests
See the Makefile for other useful commands
Metadata
Release files for thecurator 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| thecurator-0.2.1.tar.gz | 5.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| thecurator-0.2.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 12.9 kB
Release files / thecurator-0.2.1.tar.gz
| Download URL | thecurator-0.2.1.tar.gz |
|---|---|
| Size | 5.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
170da25b86b7e406b7bafd88f9dc8538220dadd30648625fa89e66612b7026b4
|
|
BLAKE2b-256 checksum How to use checksums |
cb3c8bd8e38ad3f1d7d898248e0f9be87210717da385f3d8c295bd77f1bd6de6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4
|
Release files / thecurator-0.2.1-py3-none-any.whl
| Download URL | thecurator-0.2.1-py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7b1c2b90a6c76b6760d31bf19d1b0811561a67aa1d36a783796cd26c4b287eab
|
|
BLAKE2b-256 checksum How to use checksums |
e4cba79ae7a4d8c6a65701e21789b9d4f8d4c81214c5b76c04a20164ab34be0f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4
|