Skip to main content

Preprocessing methylation pipeline, written in python. Easy to use and highly parallelized.

Project description




Help documentation:

Alternatively, you can access the pdf: PyMethylProcess.pdf

What is it:

  • Preprocess 450k and 850k methylation IDAT files in parallel using Minfi, ENmix, and meffil
  • Convenient and scalable implementation
  • Imputation and Feature Selection
  • Preparation for machine learning pipelines


  • Make DNAm accessible to python developers and more machine learning oriented researchers
  • Streamlined analysis makes processing easy

PyMethyProcess is now available in Bioinformatics: .

Getting Started:

  • Installation:
  • Example Usage Scripts (in github repo): Located in ./example_scripts/
  • Help docs (in github repo):
  • See GitHub wiki for more information on getting started, preprocessing quickly, and setting up and running machine learning analyses / classic methylation analyses (cell type deconvolution, age estimation).
  • Running the CWL tool (temporary instructions until new docker upload):
    • Clone this repository.
    • sh
    • Then execute the cwl/pymethylprocess.cwl tool using Toil or Rabix Composer or executor, amongst others.
    • Try this dataset for quick testing: GSE109541
    • Note: This CWL tool has limited functionality, if you would like to see additional functions automated (eg. age calculation, cell type deconvolution, running machine learning pipelines), please submit an issue, and we'll add new features.

NOTE: There have been reported issues with installing PyMethylProcess on Mac OS Mojave (rpy2). If this is the issue, try the docker installation and please report an issue.

CWL Workflow Visualization
PyMethylProcess CWL Pipeline

Benchmark Results: benchmark

Supplementary Figure Removed from Manuscript: Supplemental

Supplemental Figure 1: UMAP embeddings (colored) of: a) GSE87571 (age), b) GSE81961 (disease status), c) GSE69138 (subtype), d) GSE42861 (disease status), e) GSE112179 (brain disorder), f) GSE90496 (subclass), g) TCGA Pancancer (subtype)

pipeline-visualize pipeline-train-test-split

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pymethylprocess-0.1.6.tar.gz (40.5 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page