Skip to main content

PyMINEr: automated biologic insights from large datasets.

Project description

README

Tutorials

I've made some videos that walk you through the outputs as well as how to install and use PyMINEr here: www.ScienceScott.com/pyminer

What is this repository for?

  • cell type identification using novel clustering algorithms that outperform some competitors when applied to both real-world and synthetic datasets

  • basic statistics & enrichment analyses

  • pathway analyses

  • Spearman correlation-based expression graphs that enable analyses by graph theory

  • creation of in silico predicted autocrine/paracrine signaling networks within and across cell types

  • creation of publication-ready visuals based on these analyses

  • generation of a web page explaining the results of the run

  • Future releases will contain updated clustering methods that work for reconstructing single cell lineages, among other cool functions

How do I get set up?

PyMINEr is now pip installable: python3 -m pip install bio-pyminer Note that there was another package called pyminer for mining bit-coin - this is definitely not that, so be sure to install bio-pyminer instead!

You can also install using the setup.py script in the distribution like so: python3 setup.py install

How do I run PyMINEr?

PyMINEr takes as input a cleaned and normalized (typically log transformed) tab delimited 2D matrix text file. For example:

genes	cell_1	cell_2	...
ACTB   5.3012	 6.3102	...
...	...	...	...

You can feed this text file into PyMINEr in the command line:

pyminer.py -i expression.txt

If you have a really big file, you can convert it to hdf5 so that you can run the pipeline outside of memory:

tab_to_h5.py expression.txt

This will generate 3 files:

  • expression.hdf5
  • ID_list.txt the list of genes (no header line)
  • column_IDs.txt the sample names for the columns.

That's about it. There are some other interesting things you can do though, like if you are working with something that isn't human, you should be able to pass in the argument -species, followed by a species code that is taken by gProfiler. This will automate tons of pathway analyses, so long as the variables you're working with can be mapped over to Ensembl gene IDs by gProfiler. The default is homo sapiens (hsapiens).

A list of the gProfiler accepted species codes is listed here: https://biit.cs.ut.ee/gprofiler/page/organism-list

License

For non-commercial use, PyMINEr is available via the AGPLv3 license. Commercial entities should inquire with scottyler89@gmail.com

Who do I talk to?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bio_pyminer-0.9.8.tar.gz (65.4 MB view details)

Uploaded Source

Built Distributions

bio_pyminer-0.9.8-py3.7.egg (39.4 MB view details)

Uploaded Source

bio_pyminer-0.9.8-py3-none-any.whl (39.2 MB view details)

Uploaded Python 3

File details

Details for the file bio_pyminer-0.9.8.tar.gz.

File metadata

  • Download URL: bio_pyminer-0.9.8.tar.gz
  • Upload date:
  • Size: 65.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.8.tar.gz
Algorithm Hash digest
SHA256 e5d0cf8ffeb8fd399d33a3e7684208cf5963fd362b185b7f237d4b52a4481486
MD5 9c88246eb115f62bb9b4eb3ad9313394
BLAKE2b-256 97823563c1490d82e1ad5f7ba65c048d77a8f6cc8075520fa51748a73bbb3749

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.8-py3.7.egg.

File metadata

  • Download URL: bio_pyminer-0.9.8-py3.7.egg
  • Upload date:
  • Size: 39.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.8-py3.7.egg
Algorithm Hash digest
SHA256 54bed8e1d7d2509169812702b8a7e1b5239e37191672846ae3ca35440458c80b
MD5 91ac270ff16f8bc745d542175d96f389
BLAKE2b-256 a4a3096a39a59a051f4fbcfba7401a3013cc9a4bf0bac5dca4db1f3d7d3b3776

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.8-py3-none-any.whl.

File metadata

  • Download URL: bio_pyminer-0.9.8-py3-none-any.whl
  • Upload date:
  • Size: 39.2 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.8-py3-none-any.whl
Algorithm Hash digest
SHA256 62fdd3408b76e82a8ee7d6c8f9cb21a24bc28ae69320e47646cbf2beae65983b
MD5 4c764306bd98c448c4c2d3815d2ff2d1
BLAKE2b-256 6237ba515a61967f9e08cc996790be075042e233c4dab80d128bd9e0cb04d641

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page