Skip to main content

A package to download, load, and process multiple benchmark multi-omic drug response datasets

Project description

Cancer Omics Drug Experiment Response Dataset

There is a recent explosion of deep learning algorithms that to tackle the computational problem of predicting drug treatment outcome from baseline molecular measurements. To support this,we have built a benchmark dataset that harmonizes diverse datasets to better assess algorithm performance.

This package collects diverse sets of paired molecular datasets with corresponding drug sensitivity data. All data here is reprocessed and standardized so it can be easily used as a benchmark dataset for the This repository leverages existing datasets to collect the data required for deep learning model development. Since each deep learning model requires distinct data capabilities, the goal of this repository is to collect and format all data into a schema that can be leveraged for existing models.

Coderdata Motivation

The goal of this repository is two-fold: First, it aims to collate and standardize the data for the broader community. This requires running a series of scripts to build and append to a standardized data model. Second, it has a series of scripts that pull from the data model to create model-specific data files that can be run by the data infrastructure.

Data access

For the access to the latest version of CoderData, please visit our documentation site which provides access to Figshare and instructions for using the Python package to download the data.

Data format

All coderdata files are in text format - either comma delimited or tab delimited (depending on data type). Each dataset can be evaluated individually according to the CoderData schema that is maintained in LinkML and can be udpated via a commit to the repository. For more details, please see the schema description.

Building a local version

The build process can be found in our build directory. Here you can follow the instructions to build your own local copy of the data on your machine.

Adding a new dataset

We have standardized the build process so an additional dataset can be built locally or as part of the next version of coder. Here are the steps to follow:

  1. First visit the build directory and ensure you can build a local copy of CoderData.

  2. Checkout this repository and create a subdirectory of the build directory with your own build files.

  3. Develop your scripts to build the data files according to our LinkML Schema. This will require collecting the following metadata:

  • entrez gene identifiers (or you can use the genes.csv file
  • sample information such as species and model system type
  • drug name that can be searched on PubChem

You can validate each file by using the linkML validator together with our schema file.

You can use the following scripts as part of your build process:

  1. Wrap your scripts in standard shell scripts with the following names and arguments:
shell script arguments description
build_samples.sh [latest_samples] Latest version of samples generated by coderdata build
build_omics.sh [gene file] [samplefile] This includes the genes.csv that was generated in the original build as well as the sample file generated above.
build_drugs.sh [drugfile1,drugfile2,...] This includes a comma-delimited list of all drugs files generated from previous build
build_exp.sh [samplfile ] [drugfile] sample file and drug file generated by previous scripts
  1. Put the Docker container file inside the Docker directory with the name Dockerfile.[datasetname].

  2. Run build_all.py from the root directory, which should now add in your Dockerfile in the mix and call the scripts in your Docker container to build the files.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coderdata-0.1.40.tar.gz (15.6 kB view details)

Uploaded Source

Built Distribution

coderdata-0.1.40-py3-none-any.whl (20.1 kB view details)

Uploaded Python 3

File details

Details for the file coderdata-0.1.40.tar.gz.

File metadata

  • Download URL: coderdata-0.1.40.tar.gz
  • Upload date:
  • Size: 15.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for coderdata-0.1.40.tar.gz
Algorithm Hash digest
SHA256 062fafdae309053f506bd346c1119092cbea093737ac11583e2016733477daa2
MD5 7e2b410908a718debbe6b9bf621f2ac0
BLAKE2b-256 82924b75201e265dbba504c5a33d0620859baadbf948a8bf268f09377babe8e6

See more details on using hashes here.

Provenance

File details

Details for the file coderdata-0.1.40-py3-none-any.whl.

File metadata

  • Download URL: coderdata-0.1.40-py3-none-any.whl
  • Upload date:
  • Size: 20.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for coderdata-0.1.40-py3-none-any.whl
Algorithm Hash digest
SHA256 b449738369cfce9443646984831b19566d8f92cf61ef2deb83998022e7635760
MD5 773f0065aba5aaf5525a129967488677
BLAKE2b-256 26f6454b3f459345a06c9b83afcb13ca86d2316dcb50308278ae570cd8ecefdc

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page