Skip to main content

No project description provided

Project description

Build Status The Curator on PyPI

The Curator helps you define pipelines for transforming dirty data into consumable databases.

Usage

from thecurator import Curator

# Paths to files describing different tables
table_descriptions = ['patient.yml', 'lab.yml']
curator = Curator(sqlalchemy_engine, table_descriptions)

# Transform a pandas DataFrame according to the descriptions
curator.transform_df('patient', patient_df)

# Transform a dictionary array according to the descriptions
curator.transform_dicts('patient', patient_dicts)

# Transform and insert a dictionary array according to the descriptions
curator.insert_dicts('lab', lab_dicts)

See the tests for more examples. More coming soon…

Development

  • Install development requirements pip install -r dev-requirements.txt
  • Make changes
  • Run the tests pytest tests
  • See the Makefile for other useful commands

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

thecurator-0.2.1.tar.gz (5.7 kB view hashes)

Uploaded source

Built Distribution

thecurator-0.2.1-py3-none-any.whl (7.2 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page