Skip to main content

An ETL pipeline to extract INSPIRE data into the MEDS format.

Project description

Extract your custom dataset via MEDS-Transforms

codecov tests code-quality python license PRs contributors This pipeline extracts the INSPIRE dataset (from physionet, https://physionet.org/content/inspire/) into the MEDS format.

Usage:

pip install INSPIRE_MEDS
export DATASET_DOWNLOAD_USERNAME=$PHYSIONET_USERNAME
export DATASET_DOWNLOAD_PASSWORD=$PHYSIONET_PASSWORD
MEDS_extract-INSPIRE root_output_dir=$ROOT_OUTPUT_DIR

When you run this, the program will:

  1. Download the needed raw INSPIRE files for the currently supported version into $ROOT_OUTPUT_DIR/raw_input.
  2. Perform initial, pre-MEDS processing on the raw INSPIRE files, saving the results in $ROOT_OUTPUT_DIR/pre_MEDS.
  3. Construct the final MEDS cohort, and save it to $ROOT_OUTPUT_DIR/MEDS_cohort.

You can also specify the target directories more directly, with

export DATASET_DOWNLOAD_USERNAME=$PHYSIONET_USERNAME
export DATASET_DOWNLOAD_PASSWORD=$PHYSIONET_PASSWORD
MEDS_extract-INSPIRE raw_input_dir=$RAW_INPUT_DIR pre_MEDS_dir=$PRE_MEDS_DIR MEDS_cohort_dir=$MEDS_COHORT_DIR

Examples and More Info:

You can run MEDS_extract-INSPIRE --help for more information on the arguments and options. You can also run

MEDS_extract-INSPIRE root_output_dir=$ROOT_OUTPUT_DIR

to run the entire pipeline.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inspire_meds-0.0.1.tar.gz (132.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

INSPIRE_MEDS-0.0.1-py3-none-any.whl (19.4 kB view details)

Uploaded Python 3

File details

Details for the file inspire_meds-0.0.1.tar.gz.

File metadata

  • Download URL: inspire_meds-0.0.1.tar.gz
  • Upload date:
  • Size: 132.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for inspire_meds-0.0.1.tar.gz
Algorithm Hash digest
SHA256 88383093010efcc8c01bffd3aacb01d1fdb65c8ef66ada4118bf17ab37cf137a
MD5 ac2e30530c8b5daf0b33136df913fcf7
BLAKE2b-256 0cb14257b523532702fbd56a9fbf04318dc084331dbf01f91e570930734c0959

See more details on using hashes here.

Provenance

The following attestation bundles were made for inspire_meds-0.0.1.tar.gz:

Publisher: python-build.yaml on rvandewater/INSPIRE_MEDS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file INSPIRE_MEDS-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: INSPIRE_MEDS-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 19.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for INSPIRE_MEDS-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 96ca69f97a48e19bbd864eb4ad5cb1d4e573ab8e855e5a8784043a68b050e46a
MD5 45a18fbb15fd06fc53c0bb6f5bead79d
BLAKE2b-256 c7925a4cf58a2f885de4c567eb548bf65b25e2b57e81e3be6d5e3053d0e083f9

See more details on using hashes here.

Provenance

The following attestation bundles were made for INSPIRE_MEDS-0.0.1-py3-none-any.whl:

Publisher: python-build.yaml on rvandewater/INSPIRE_MEDS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page