Skip to main content
https://badge.fury.io/py/sequana-fastqc.svg JOSS (journal of open source software) DOI https://github.com/sequana/fastqc/actions/workflows/main.yml/badge.svg

This is is the fastqc pipeline from the Sequana projet

Overview:

Runs fastqc and multiqc on a set of Sequencing data to produce control quality reports

Input:

A set of FastQ files (paired or single-end) compressed or not

Output:

an HTML file summary.html (individual fastqc reports, mutli-samples report)

Status:

production

Wiki:

https://github.com/sequana/fastqc/wiki

Documentation:

This README file, the Wiki from the github repository (link above) and https://sequana.readthedocs.io

Citation:

Cokelaer et al, (2017), ‘Sequana’: a Set of Snakemake NGS pipelines, Journal of Open Source Software, 2(16), 352, JOSS DOI https://doi:10.21105/joss.00352

Installation

You must install Sequana first (use –upgrade to get the latest version installed):

pip install sequana --upgrade

Then, just install this package:

pip install sequana_fastqc --upgrade

Usage

This command will scan all files ending in .fastq.gz found in the local directory, create a directory called fastqc/ where a snakemake pipeline is launched automatically. Depending on the number of files and their sizes, the process may be long:

sequana_fastqc --run

To know more about the options (e.g., add a different pattern to restrict the execution to a subset of the input files, change the output/working directory, etc):

sequana_pipelines_fastqc --help
sequana_pipelines_fastqc --input-directory DATAPATH

This creates a directory fastq. You just need to execute the pipeline:

cd fastqc
sh fastqc.sh  # for a local run

This launch a snakemake pipeline. If you are familiar with snakemake, you can retrieve the fastqc.rules and config.yaml files and then execute the pipeline yourself with specific parameters:

snakemake -s fastqc.rules --cores 4 --stats stats.txt

Or use sequanix interface.

Please see the Wiki for more examples and features.

Tutorial

You can retrieve test data from sequana_fastqc (https://github.com/sequana/fastqc) or type:

wget https://raw.githubusercontent.com/sequana/fastqc/master/sequana_pipelines/fastqc/data/data_R1_001.fastq.gz
wget https://raw.githubusercontent.com/sequana/fastqc/master/sequana_pipelines/fastqc/data/data_R2_001.fastq.gz

then, prepare the pipeline:

sequana_fastqc --input-directory .
cd fastqc
sh fastq.sh

# once done, remove temporary files (snakemake and others)
make clean

Just open the HTML entry called summary.html. A multiqc report is also available. You will get expected images such as the following one:

https://github.com/sequana/fastqc/blob/master/doc/summary.png?raw=true

Please see the Wiki for more examples and features.

Requirements

This pipelines requires the following executable(s):

  • fastqc

  • falco (optional)

  • sequana (Python: pip install sequana)

For Linux users, we provide a singularity image available through damona:

pip install damona
damona install fastqc
# and add the ~/.config/damona/bin path to your binary PATH
https://raw.githubusercontent.com/sequana/fastqc/master/sequana_pipelines/fastqc/dag.png

Details

This pipeline runs fastqc in parallel on the input fastq files (paired or not) and then execute multiqc. A brief sequana summary report is also produced.

You may use falco instead of fastqc. This is experimental but seem to work for Illumina/FastQ files.

This pipeline has been tested on several hundreds of MiSeq, NextSeq, MiniSeq, ISeq100, Pacbio runs.

It produces a md5sum of your data. It copes with empty samples. Produces ready-to-use HTML reports, etc

Rules and configuration details

Here is the latest documented configuration file to be used with the pipeline. Each rule used in the pipeline may have a section in the configuration file.

Changelog

Version

Description

1.4.0

  • This version uses sequana 0.12.0 and new sequana-wrappers mechanism. Functionalities is unchanged. Also based on sequana_pipetools 0.6.X

1.3.0

  • add option –skip-multiqc (in case of memory trouble)

  • Fix typo in the link towards fastqc reports in the summary.html table

  • Fix number of samples in the paired case (divide by 2)

1.2.0

  • compatibility with Sequanix

  • Fix pipeline to cope with new snakemake API

1.1.0

  • add new rule to allow users to choose falco software instead of fastqc. Note that fastqc is 4 times faster but still a work in progress (version 0.1 as of Nov 2020).

  • allows the pipeline to process pacbio files (in fact any files accepted by fastqc i.e. SAM and BAM files

  • More doc, test and info on the wiki

1.0.1

  • add md5sum of input files as md5.txt file

1.0.0

  • a stable version. Added a wiki on github as well and a singularity recipes

0.9.15

  • For the HTML reports, takes into account samples with zero reads

0.9.14

  • round up some statistics in the main table

0.9.13

  • improve the summary HTML report

0.9.12

  • implemented new –from-project option

0.9.11

  • now depends on sequana_pipetools instead of sequana.pipelines to speed up –help calls

  • new summary.html report created with pipeline summary

  • new rule (plotting)

0.9.10

  • simplify the onsuccess section

0.9.9

  • add missing png and pipeline (regression bug)

0.9.8

  • add missing multi_config file

0.9.7

  • check existence of input directory in main.py

  • add a logo

  • fix schema

  • add multiqc_config

  • add sequana + sequana_fastqc version

0.9.6

add the readtag option

Contribute & Code of Conduct

To contribute to this project, please take a look at the Contributing Guidelines first. Please note that this project is released with a Code of Conduct. By contributing to this project, you agree to abide by its terms.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sequana_fastqc-1.4.0.tar.gz (102.1 kB view details)

Uploaded Source

File details

Details for the file sequana_fastqc-1.4.0.tar.gz.

File metadata

  • Download URL: sequana_fastqc-1.4.0.tar.gz
  • Upload date:
  • Size: 102.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for sequana_fastqc-1.4.0.tar.gz
Algorithm Hash digest
SHA256 6079e7730b021a1fb43a7586d4abdb72d7a8fb23653e252f13c08811a76d28f2
MD5 5f8ea76fa4978826b65d52ec958fc59e
BLAKE2b-256 b3a47995275c5eb427d4c2e8417e861a3b2d2ca8f2cdff00bd2e76dbb62e39e4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page