Skip to main content

PyMINEr: automated biologic insights from large datasets.

Project description

README

Tutorials

I've made some videos that walk you through the outputs as well as how to install and use PyMINEr here: www.ScienceScott.com/pyminer

What is this repository for?

  • cell type identification using novel clustering algorithms that outperform some competitors when applied to both real-world and synthetic datasets

  • basic statistics & enrichment analyses

  • pathway analyses

  • Spearman correlation-based expression graphs that enable analyses by graph theory

  • creation of in silico predicted autocrine/paracrine signaling networks within and across cell types

  • creation of publication-ready visuals based on these analyses

  • generation of a web page explaining the results of the run

  • Future releases will contain updated clustering methods that work for reconstructing single cell lineages, among other cool functions

How do I get set up?

PyMINEr is now pip installable: python3 -m pip install bio-pyminer Note that there was another package called pyminer for mining bit-coin - this is definitely not that, so be sure to install bio-pyminer instead!

You can also install using the setup.py script in the distribution like so: python3 setup.py install

How do I run PyMINEr?

PyMINEr takes as input a cleaned and normalized (typically log transformed) tab delimited 2D matrix text file. For example:

genes	cell_1	cell_2	...
ACTB   5.3012	 6.3102	...
...	...	...	...

You can feed this text file into PyMINEr in the command line:

pyminer.py -i expression.txt

If you have a really big file, you can convert it to hdf5 so that you can run the pipeline outside of memory:

tab_to_h5.py expression.txt

This will generate 3 files:

  • expression.hdf5
  • ID_list.txt the list of genes (no header line)
  • column_IDs.txt the sample names for the columns.

That's about it. There are some other interesting things you can do though, like if you are working with something that isn't human, you should be able to pass in the argument -species, followed by a species code that is taken by gProfiler. This will automate tons of pathway analyses, so long as the variables you're working with can be mapped over to Ensembl gene IDs by gProfiler. The default is homo sapiens (hsapiens).

A list of the gProfiler accepted species codes is listed here: https://biit.cs.ut.ee/gprofiler/page/organism-list

License

For non-commercial use, PyMINEr is available via the AGPLv3 license. Commercial entities should inquire with scottyler89@gmail.com

Who do I talk to?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bio_pyminer-0.9.0.tar.gz (166.2 kB view details)

Uploaded Source

Built Distributions

bio_pyminer-0.9.0-py3.7.egg (549.7 kB view details)

Uploaded Source

bio_pyminer-0.9.0-py3-none-any.whl (362.7 kB view details)

Uploaded Python 3

File details

Details for the file bio_pyminer-0.9.0.tar.gz.

File metadata

  • Download URL: bio_pyminer-0.9.0.tar.gz
  • Upload date:
  • Size: 166.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.0.tar.gz
Algorithm Hash digest
SHA256 c5101999dc03add138f2180d673aef9c3e1bde0e338017489d8fa8cfa54a1838
MD5 e60d1b9056138a37270d70e0055e311d
BLAKE2b-256 868a93817e663fffbd6125ce9703b92bd829c76ae0d7b4969b714ca290bc3cf8

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.0-py3.7.egg.

File metadata

  • Download URL: bio_pyminer-0.9.0-py3.7.egg
  • Upload date:
  • Size: 549.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.0-py3.7.egg
Algorithm Hash digest
SHA256 c71e977b920d1aa3929d5b7da90871f7a3c5de866935546d49262ff614620851
MD5 db18eca646006fae020a029a7cd7b244
BLAKE2b-256 e6bbfc3a4d9a1115ced33723d0bec1e2538db34fdfaa388cdbb931262692d09e

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: bio_pyminer-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 362.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2747b1b37b976277efa89c99edb3a7f2c6d739d4e88a9236d0c05f871c31ecdf
MD5 a8de5aef29b81235d29019d6efa1d42a
BLAKE2b-256 858818df61e244ce30bc40f1e922b896a6231bc28867f227882bae88bba2f1b5

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page