fastq-downloader 0.3.0

No project description provided

Fastq Downloader (WIP)

use this snakemake script to get more fluent experience.

This python package let you download fastq files from ena. It can automatic merge and rename fastq files based on the input file provided. If you have trouble downloading this repo's release, please go to fastgit

How to use

auto merge multiple files of paired end reads are not tested now, but should be usable

conda create --name fastq-downloader -c conda-forge -c hcc -c bioconda aspera-cli snakemake httpx lxml click beautifulsoup4 python=3.9
## use what ever you want to download the gist mentioned above to thisname.smk
## download whl file from github release of this project to thisname.whl
conda activate fastq-downloader
pip install fastq-downloader==0.3.0
## make sure to create an infotsv before, you can just copy from the geo website,
## then go to vim, type :set paste to get into paste mode, paste the table into vim,
## save the file as whatever name you want, then exit vim
## the white space will be auto convert to underscore
## refresh_acc need to be False if you don't want to query again the accesion number,
## or due to the recreation of the link file(default set to false), all files are to be downloaded.
python3 -m fastq_downloader smk --info thisname.tsv --out thisname --refresh_acc False

todo

• test for paired-end reads run merge
• publish to bioconda
• if fail, retry
• use dag to run the pipeline (sort of, implemented by using snakemake)
• option to resume download when md5 not match
• option to continue from last time download
• implement second level parallelization