Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

Preprocessing methylation pipeline, written in python. Easy to use and highly parallelized.

Project description

PyMethylProcess

pymethylprocess_overview

https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess

Wiki: https://github.com/Christensen-Lab-Dartmouth/PyMethylProcess/wiki

Help documentation: https://christensen-lab-dartmouth.github.io/PyMethylProcess/

Alternatively, you can access the pdf: PyMethylProcess.pdf

What is it:

  • Preprocess 450k and 850k methylation IDAT files in parallel using Minfi, ENmix, and meffil
  • Convenient and scalable implementation
  • Imputation and Feature Selection
  • Preparation for machine learning pipelines

Why:

  • Make DNAm accessible to python developers and more machine learning oriented researchers
  • Streamlined analysis makes processing easy

PyMethyProcess is now available in Bioinformatics: https://academic.oup.com/bioinformatics/advance-article/doi/10.1093/bioinformatics/btz594/5542385 .

Getting Started:

  • Installation:
  • Example Usage Scripts (in github repo): Located in ./example_scripts/
  • Help docs (in github repo): https://christensen-lab-dartmouth.github.io/PyMethylProcess/
  • See GitHub wiki for more information on getting started, preprocessing quickly, and setting up and running machine learning analyses / classic methylation analyses (cell type deconvolution, age estimation).
  • Running the CWL tool (temporary instructions until new docker upload):
    • Clone this repository.
    • sh docker_build.sh
    • Then execute the cwl/pymethylprocess.cwl tool using Toil https://toil.readthedocs.io/en/latest/ or Rabix Composer or executor https://github.com/rabix/composer, amongst others.
    • Try this dataset for quick testing: GSE109541
    • Note: This CWL tool has limited functionality, if you would like to see additional functions automated (eg. age calculation, cell type deconvolution, running machine learning pipelines), please submit an issue, and we'll add new features.

NOTE: There have been reported issues with installing PyMethylProcess on Mac OS Mojave (rpy2). If this is the issue, try the docker installation and please report an issue.

CWL Workflow Visualization
PyMethylProcess CWL Pipeline

Benchmark Results: benchmark

Supplementary Figure Removed from Manuscript: Supplemental

Supplemental Figure 1: UMAP embeddings (colored) of: a) GSE87571 (age), b) GSE81961 (disease status), c) GSE69138 (subtype), d) GSE42861 (disease status), e) GSE112179 (brain disorder), f) GSE90496 (subclass), g) TCGA Pancancer (subtype)

pipeline-download
pipeline-format
pipeline-preprocess
pipeline-visualize pipeline-train-test-split

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pymethylprocess, version 0.1.5
Filename, size File type Python version Upload date Hashes
Filename, size pymethylprocess-0.1.5.tar.gz (40.3 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page