Skip to main content

PyMINEr: automated biologic insights from large datasets.

Project description

README

Tutorials

I've made some videos that walk you through the outputs as well as how to install and use PyMINEr here: www.ScienceScott.com/pyminer

What is this repository for?

  • cell type identification using novel clustering algorithms that outperform some competitors when applied to both real-world and synthetic datasets

  • basic statistics & enrichment analyses

  • pathway analyses

  • Spearman correlation-based expression graphs that enable analyses by graph theory

  • creation of in silico predicted autocrine/paracrine signaling networks within and across cell types

  • creation of publication-ready visuals based on these analyses

  • generation of a web page explaining the results of the run

  • Future releases will contain updated clustering methods that work for reconstructing single cell lineages, among other cool functions

How do I get set up?

PyMINEr is now pip installable: python3 -m pip install bio-pyminer Note that there was another package called pyminer for mining bit-coin - this is definitely not that, so be sure to install bio-pyminer instead!

You can also install using the setup.py script in the distribution like so: python3 setup.py install

How do I run PyMINEr?

PyMINEr takes as input a cleaned and normalized (typically log transformed) tab delimited 2D matrix text file. For example:

genes	cell_1	cell_2	...
ACTB   5.3012	 6.3102	...
...	...	...	...

You can feed this text file into PyMINEr in the command line:

pyminer.py -i expression.txt

If you have a really big file, you can convert it to hdf5 so that you can run the pipeline outside of memory:

tab_to_h5.py expression.txt

This will generate 3 files:

  • expression.hdf5
  • ID_list.txt the list of genes (no header line)
  • column_IDs.txt the sample names for the columns.

That's about it. There are some other interesting things you can do though, like if you are working with something that isn't human, you should be able to pass in the argument -species, followed by a species code that is taken by gProfiler. This will automate tons of pathway analyses, so long as the variables you're working with can be mapped over to Ensembl gene IDs by gProfiler. The default is homo sapiens (hsapiens).

A list of the gProfiler accepted species codes is listed here: https://biit.cs.ut.ee/gprofiler/page/organism-list

License

For non-commercial use, PyMINEr is available via the AGPLv3 license. Commercial entities should inquire with scottyler89@gmail.com

Who do I talk to?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bio_pyminer-0.9.15.tar.gz (65.5 MB view details)

Uploaded Source

Built Distributions

bio_pyminer-0.9.15-py3.8.egg (39.4 MB view details)

Uploaded Source

bio_pyminer-0.9.15-py3-none-any.whl (39.2 MB view details)

Uploaded Python 3

File details

Details for the file bio_pyminer-0.9.15.tar.gz.

File metadata

  • Download URL: bio_pyminer-0.9.15.tar.gz
  • Upload date:
  • Size: 65.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

File hashes

Hashes for bio_pyminer-0.9.15.tar.gz
Algorithm Hash digest
SHA256 b7111f7298f7ac82dff0c6e5cc4aa14c2d187c4dc82b6d4f18c6ea1bc502ad71
MD5 d9f3b6ec385ecf294671f707dbb0c99a
BLAKE2b-256 02eecdc3fa44b40f054868ab4d63008b8c10b2c64cee4d69a54bcb6ffe3e160f

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.15-py3.8.egg.

File metadata

  • Download URL: bio_pyminer-0.9.15-py3.8.egg
  • Upload date:
  • Size: 39.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

File hashes

Hashes for bio_pyminer-0.9.15-py3.8.egg
Algorithm Hash digest
SHA256 d8bbd65198ea108d7a9f7bc70056f580cb8f07dc0b159fe46f2c319dd4f3a296
MD5 7573584e2817685eff3b73acb8101ce3
BLAKE2b-256 2f511bdfc04b1cb42bdcb8c9b30b8f8e9f990bded7326c1ee52481d495e99441

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.15-py3-none-any.whl.

File metadata

  • Download URL: bio_pyminer-0.9.15-py3-none-any.whl
  • Upload date:
  • Size: 39.2 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

File hashes

Hashes for bio_pyminer-0.9.15-py3-none-any.whl
Algorithm Hash digest
SHA256 39e9e1fea7e0f3b01943be02759776e1b69dc182193b6d877e79f85c90c8764f
MD5 b704d893e94da22ca425d11eb98f282e
BLAKE2b-256 3b4105f2be5a6afc23f9094a1cfb3c48f09a3c7535fe23a0eb54b0f63e1f1879

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page