A package to download, load, and process multiple benchmark multi-omic drug response datasets
Project description
Cancer Omics Drug Experiment Response Dataset
There is a recent explosion of deep learning algorithms that to tackle the computational problem of predicting drug treatment outcome from baseline molecular measurements. To support this,we have built a benchmark dataset that harmonizes diverse datasets to better assess algorithm performance.
This package collects diverse sets of paired molecular datasets with corresponding drug sensitivity data. All data here is reprocessed and standardized so it can be easily used as a benchmark dataset for the This repository leverages existing datasets to collect the data required for deep learning model development. Since each deep learning model requires distinct data capabilities, the goal of this repository is to collect and format all data into a schema that can be leveraged for existing models.
The goal of this repository is two-fold: First, it aims to collate and standardize the data for the broader community. This requires running a series of scripts to build and append to a standardized data model. Second, it has a series of scripts that pull from the data model to create model-specific data files that can be run by the data infrastructure.
Data access
For the access to the latest version of CoderData, please visit our documentation site which provides access to Figshare and instructions for using the Python package to download the data.
Data format
All coderdata files are in text format - either comma delimited or tab delimited (depending on data type). Each dataset can be evaluated individually according to the CoderData schema that is maintained in LinkML and can be udpated via a commit to the repository. For more details, please see the schema description.
Building a local version
The build process can be found in our build directory. Here you can follow the instructions to build your own local copy of the data on your machine.
Adding a new dataset
We have standardized the build process so an additional dataset can be built locally or as part of the next version of coder. Here are the steps to follow:
-
First visit the build directory and ensure you can build a local copy of CoderData.
-
Checkout this repository and create a subdirectory of the build directory with your own build files.
-
Develop your scripts to build the data files according to our LinkML Schema. This will require collecting the following metadata:
- entrez gene identifiers (or you can use the
genes.csv
file - sample information such as species and model system type
- drug name that can be searched on PubChem
You can validate each file by using the linkML validator together with our schema file.
You can use the following scripts as part of your build process:
- build/utils/fit_curve.py: This script takes dose-response data and generates the dose-response statistics required by CoderData/
- build/utils/pubchem_retrieval.py:
This script retreives structure and drug synonym information
required to populate the
Drug
table.
- Wrap your scripts in standard shell scripts with the following names and arguments:
shell script | arguments | description |
---|---|---|
build_samples.sh |
[latest_samples] | Latest version of samples generated by coderdata build |
build_omics.sh |
[gene file] [samplefile] | This includes the genes.csv that was generated in the original build as well as the sample file generated above. |
build_drugs.sh |
[drugfile1,drugfile2,...] | This includes a comma-delimited list of all drugs files generated from previous build |
build_exp.sh |
[samplfile ] [drugfile] | sample file and drug file generated by previous scripts |
-
Put the Docker container file inside the Docker directory with the name
Dockerfile.[datasetname]
. -
Run
build_all.py
from the root directory, which should now add in your Dockerfile in the mix and call the scripts in your Docker container to build the files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file coderdata-0.1.40.tar.gz
.
File metadata
- Download URL: coderdata-0.1.40.tar.gz
- Upload date:
- Size: 15.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 062fafdae309053f506bd346c1119092cbea093737ac11583e2016733477daa2 |
|
MD5 | 7e2b410908a718debbe6b9bf621f2ac0 |
|
BLAKE2b-256 | 82924b75201e265dbba504c5a33d0620859baadbf948a8bf268f09377babe8e6 |
Provenance
File details
Details for the file coderdata-0.1.40-py3-none-any.whl
.
File metadata
- Download URL: coderdata-0.1.40-py3-none-any.whl
- Upload date:
- Size: 20.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b449738369cfce9443646984831b19566d8f92cf61ef2deb83998022e7635760 |
|
MD5 | 773f0065aba5aaf5525a129967488677 |
|
BLAKE2b-256 | 26f6454b3f459345a06c9b83afcb13ca86d2316dcb50308278ae570cd8ecefdc |