Skip to main content
Build Status The Curator on PyPI

The Curator helps you define pipelines for transforming dirty data into consumable databases.

Usage

from thecurator import Curator

# Paths to files describing different tables
table_descriptions = ['patient.yml', 'lab.yml']
curator = Curator(sqlalchemy_engine, table_descriptions)

# Transform a pandas DataFrame according to the descriptions
curator.transform_df('patient', patient_df)

# Transform a dictionary array according to the descriptions
curator.transform_dicts('patient', patient_dicts)

# Transform and insert a dictionary array according to the descriptions
curator.insert_dicts('lab', lab_dicts)

See the tests for more examples. More coming soon…

Development

  • Install development requirements pip install -r dev-requirements.txt

  • Make changes

  • Run the tests pytest tests

  • See the Makefile for other useful commands

Metadata

Release files for thecurator 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for thecurator 0.2.1
File Size Uploaded
thecurator-0.2.1.tar.gz 5.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for thecurator 0.2.1
File Interpreter ABI Platform
thecurator-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 12.9 kB

Release files / thecurator-0.2.1.tar.gz

Download URL thecurator-0.2.1.tar.gz
Size 5.7 kB
Tags Source
SHA-256 checksum
How to use checksums
170da25b86b7e406b7bafd88f9dc8538220dadd30648625fa89e66612b7026b4
BLAKE2b-256 checksum
How to use checksums
cb3c8bd8e38ad3f1d7d898248e0f9be87210717da385f3d8c295bd77f1bd6de6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4

Release files / thecurator-0.2.1-py3-none-any.whl

Download URL thecurator-0.2.1-py3-none-any.whl
Size 7.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7b1c2b90a6c76b6760d31bf19d1b0811561a67aa1d36a783796cd26c4b287eab
BLAKE2b-256 checksum
How to use checksums
e4cba79ae7a4d8c6a65701e21789b9d4f8d4c81214c5b76c04a20164ab34be0f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/3.6.4

Release history Release notifications | RSS feed

This release

0.2.1 This release

2 release files

0.2.0

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page