Simulate repeating a nanopore experiment.
Project description
======
taeper
======
Simulate repeating a nanopore experiment.
.. image:: https://img.shields.io/pypi/v/taeper.svg
:target: https://pypi.python.org/pypi/taeper
.. image:: https://img.shields.io/travis/mbhall88/taeper.svg
:target: https://travis-ci.org/mbhall88/taeper
.. image:: https://readthedocs.org/projects/taeper/badge/?version=latest
:target: https://taeper.readthedocs.io/en/latest/?badge=latest
:alt: Documentation Status
This tool is designed for anyone developing tools and applications for
real-time analysis of Oxford Nanopore sequencing data. The use is quite
simple. Given a directory of ``fast5`` files, ``A``, and a destination
directory, ``B``, this tool will copy the files from ``A`` to ``B`` in
the same order and timing as they were deposited into the reads folder
during the actual experiment. It will also maintain the current directory structure.
I know what you’re thinking: “But who wants to hang around for 30 hours
waiting for a simulation to finish?” Luckily there is an optional
scaling factor that will speed up the process (``--scale``).
Installation
=============
This is a **python3 only** package.
To install, simply run
.. code-block:: bash
pip3 install taeper
taeper --help
Usage
======
``taeper`` is designed to simulate the order and timing of fast5 files that
were produced in a minION run. You give it an input directory and it will gather
the names of all the fast5 files under that directory (including sub-directories).
It gathers information about the time when each read finished sequencing and
creates a sorted index of all the files. In this index the first file was the first
one sequenced and so on. Attached to each file path is a delay time, ``t`` in seconds.
This specifies that that read completed sequencing ``t`` seconds after the one
before it. In this way ``taeper`` can rerun what the experiment looked like in
terms of the depositing of fast5 files. It then moves those files into a specified
output directory and will recreate any subdirectory structures (e.g pass or fail
folders).
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place
This will copy all fast5 files in ``path/to/reads`` to ``some/place`` in the
exact same timing as they were produced.
In reality though you probably dont want to wait the full length of time that
would take. In that case you can use the scale option.
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place --scale 100
This will rerun the experiment 100 times faster.
Indexing is the longest step of the process and therefore, by default, an index
file of the file order with the time delays is stored in a file called ``taeper_index.npy``.
Keep in mind that the file paths in the index are relative to the working directory
it was generated in.
If you would just like to index but not copy you can do
.. code-block:: bash
taeper --input_dir path/to/reads --dump_index experiment_index.npy
You just omit the output directory. ``--dump_index`` also allows you to specify a
name other than the default for the index.
If you already have an index file and you would like to rerun the experiment then
you can provide that index and skip to the copying
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place --index experiment_index.npy --scale 100
**Full usage**
.. code-block:: bash
taeper --help
usage: taeper [-h] -i INPUT_DIR [--index INDEX] [-o OUTPUT] [--scale SCALE]
[-d DUMP_INDEX] [--no_index] [--log_level {0,1,2,3,4,5}]
[--no_progress_bar]
Simulate the real-time depositing of Nanopore reads into a given folder,
conserving the order they were processed during sequencing. If pass and fail
folders do not exist in output_dir they will be created if detected in the
file path for the fast5 file.
optional arguments:
-h, --help show this help message and exit
-i INPUT_DIR, --input_dir INPUT_DIR
Directory where files are located.
--index INDEX Provide a prebuilt index file to skip indexing. Be
aware that paths within an index file are relative to
the current working directory when they were built.
-o OUTPUT, --output OUTPUT
Directory to copy the files to. If not specified, will
generate the index file only.
--scale SCALE Amount to scale the timing by. i.e scale of 10 will
deposit the reads 10x fatser than they were generated.
(Default = 1.0)
-d DUMP_INDEX, --dump_index DUMP_INDEX
Path to save index as. Default is 'taeper_index.npy'
in current working directory. Note: Paths in the index
are relative to the current working directory.
--no_index Dont write the index list to file. This will mean it
needs regenerating for this dataset on each run.
--log_level {0,1,2,3,4,5}
Level of logging. 0 is none, 5 is for debugging.
Default is 4 which will report info, warnings, errors,
and critical information.
--no_progress_bar Do not display progress bar.
Disclaimer
~~~~~~~~~~~~~~
The ``fast5`` file structure has changed a bit over time and as such not all
files will work. Although, I have tested this program with most recent forms and
it works fine. A logging warning will show up on the console if ``taeper`` is
unable to read a file or determine it's finish time.
-----------
* Free software: MIT license
* Documentation: https://taeper.readthedocs.io.
Credits
-------
This package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.
.. _Cookiecutter: https://github.com/audreyr/cookiecutter
.. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage
=======
History
=======
0.1.0 (2018-03-26)
------------------
* First release on PyPI.
taeper
======
Simulate repeating a nanopore experiment.
.. image:: https://img.shields.io/pypi/v/taeper.svg
:target: https://pypi.python.org/pypi/taeper
.. image:: https://img.shields.io/travis/mbhall88/taeper.svg
:target: https://travis-ci.org/mbhall88/taeper
.. image:: https://readthedocs.org/projects/taeper/badge/?version=latest
:target: https://taeper.readthedocs.io/en/latest/?badge=latest
:alt: Documentation Status
This tool is designed for anyone developing tools and applications for
real-time analysis of Oxford Nanopore sequencing data. The use is quite
simple. Given a directory of ``fast5`` files, ``A``, and a destination
directory, ``B``, this tool will copy the files from ``A`` to ``B`` in
the same order and timing as they were deposited into the reads folder
during the actual experiment. It will also maintain the current directory structure.
I know what you’re thinking: “But who wants to hang around for 30 hours
waiting for a simulation to finish?” Luckily there is an optional
scaling factor that will speed up the process (``--scale``).
Installation
=============
This is a **python3 only** package.
To install, simply run
.. code-block:: bash
pip3 install taeper
taeper --help
Usage
======
``taeper`` is designed to simulate the order and timing of fast5 files that
were produced in a minION run. You give it an input directory and it will gather
the names of all the fast5 files under that directory (including sub-directories).
It gathers information about the time when each read finished sequencing and
creates a sorted index of all the files. In this index the first file was the first
one sequenced and so on. Attached to each file path is a delay time, ``t`` in seconds.
This specifies that that read completed sequencing ``t`` seconds after the one
before it. In this way ``taeper`` can rerun what the experiment looked like in
terms of the depositing of fast5 files. It then moves those files into a specified
output directory and will recreate any subdirectory structures (e.g pass or fail
folders).
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place
This will copy all fast5 files in ``path/to/reads`` to ``some/place`` in the
exact same timing as they were produced.
In reality though you probably dont want to wait the full length of time that
would take. In that case you can use the scale option.
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place --scale 100
This will rerun the experiment 100 times faster.
Indexing is the longest step of the process and therefore, by default, an index
file of the file order with the time delays is stored in a file called ``taeper_index.npy``.
Keep in mind that the file paths in the index are relative to the working directory
it was generated in.
If you would just like to index but not copy you can do
.. code-block:: bash
taeper --input_dir path/to/reads --dump_index experiment_index.npy
You just omit the output directory. ``--dump_index`` also allows you to specify a
name other than the default for the index.
If you already have an index file and you would like to rerun the experiment then
you can provide that index and skip to the copying
.. code-block:: bash
taeper --input_dir path/to/reads --output some/place --index experiment_index.npy --scale 100
**Full usage**
.. code-block:: bash
taeper --help
usage: taeper [-h] -i INPUT_DIR [--index INDEX] [-o OUTPUT] [--scale SCALE]
[-d DUMP_INDEX] [--no_index] [--log_level {0,1,2,3,4,5}]
[--no_progress_bar]
Simulate the real-time depositing of Nanopore reads into a given folder,
conserving the order they were processed during sequencing. If pass and fail
folders do not exist in output_dir they will be created if detected in the
file path for the fast5 file.
optional arguments:
-h, --help show this help message and exit
-i INPUT_DIR, --input_dir INPUT_DIR
Directory where files are located.
--index INDEX Provide a prebuilt index file to skip indexing. Be
aware that paths within an index file are relative to
the current working directory when they were built.
-o OUTPUT, --output OUTPUT
Directory to copy the files to. If not specified, will
generate the index file only.
--scale SCALE Amount to scale the timing by. i.e scale of 10 will
deposit the reads 10x fatser than they were generated.
(Default = 1.0)
-d DUMP_INDEX, --dump_index DUMP_INDEX
Path to save index as. Default is 'taeper_index.npy'
in current working directory. Note: Paths in the index
are relative to the current working directory.
--no_index Dont write the index list to file. This will mean it
needs regenerating for this dataset on each run.
--log_level {0,1,2,3,4,5}
Level of logging. 0 is none, 5 is for debugging.
Default is 4 which will report info, warnings, errors,
and critical information.
--no_progress_bar Do not display progress bar.
Disclaimer
~~~~~~~~~~~~~~
The ``fast5`` file structure has changed a bit over time and as such not all
files will work. Although, I have tested this program with most recent forms and
it works fine. A logging warning will show up on the console if ``taeper`` is
unable to read a file or determine it's finish time.
-----------
* Free software: MIT license
* Documentation: https://taeper.readthedocs.io.
Credits
-------
This package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.
.. _Cookiecutter: https://github.com/audreyr/cookiecutter
.. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage
=======
History
=======
0.1.0 (2018-03-26)
------------------
* First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
taeper-0.1.0.tar.gz
(1.4 MB
view details)
Built Distribution
File details
Details for the file taeper-0.1.0.tar.gz
.
File metadata
- Download URL: taeper-0.1.0.tar.gz
- Upload date:
- Size: 1.4 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c336aa0d40f658703cecad8dace4c3212fbefff0fdf159b239f5ccf676c6e929 |
|
MD5 | b7520b160061dd7aaae9fcc21746dc5f |
|
BLAKE2b-256 | 359c3d0c593617d211ed812cf089cf59b34d18555d7b3810e07249a182768737 |
File details
Details for the file taeper-0.1.0-py2.py3-none-any.whl
.
File metadata
- Download URL: taeper-0.1.0-py2.py3-none-any.whl
- Upload date:
- Size: 12.4 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0ec603894ca6a1866dddfe9d6725d83aeac04922a5ec58210a61dd109af3217f |
|
MD5 | 2cc6773cb2d8e11284d0370913277ab9 |
|
BLAKE2b-256 | 888ff20cddb772cb28dd7d89e56bbc95badbdd43ed0e23eacb1b25214fef870f |