Skip to main content

PyMINEr: automated biologic insights from large datasets.

Project description

README

Tutorials

I've made some videos that walk you through the outputs as well as how to install and use PyMINEr here: www.ScienceScott.com/pyminer

What is this repository for?

  • cell type identification using novel clustering algorithms that outperform some competitors when applied to both real-world and synthetic datasets

  • basic statistics & enrichment analyses

  • pathway analyses

  • Spearman correlation-based expression graphs that enable analyses by graph theory

  • creation of in silico predicted autocrine/paracrine signaling networks within and across cell types

  • creation of publication-ready visuals based on these analyses

  • generation of a web page explaining the results of the run

  • Future releases will contain updated clustering methods that work for reconstructing single cell lineages, among other cool functions

How do I get set up?

PyMINEr is now pip installable: python3 -m pip install bio-pyminer Note that there was another package called pyminer for mining bit-coin - this is definitely not that, so be sure to install bio-pyminer instead!

You can also install using the setup.py script in the distribution like so: python3 setup.py install

How do I run PyMINEr?

PyMINEr takes as input a cleaned and normalized (typically log transformed) tab delimited 2D matrix text file. For example:

genes	cell_1	cell_2	...
ACTB   5.3012	 6.3102	...
...	...	...	...

You can feed this text file into PyMINEr in the command line:

pyminer.py -i expression.txt

If you have a really big file, you can convert it to hdf5 so that you can run the pipeline outside of memory:

tab_to_h5.py expression.txt

This will generate 3 files:

  • expression.hdf5
  • ID_list.txt the list of genes (no header line)
  • column_IDs.txt the sample names for the columns.

That's about it. There are some other interesting things you can do though, like if you are working with something that isn't human, you should be able to pass in the argument -species, followed by a species code that is taken by gProfiler. This will automate tons of pathway analyses, so long as the variables you're working with can be mapped over to Ensembl gene IDs by gProfiler. The default is homo sapiens (hsapiens).

A list of the gProfiler accepted species codes is listed here: https://biit.cs.ut.ee/gprofiler/page/organism-list

License

For non-commercial use, PyMINEr is available via the AGPLv3 license. Commercial entities should inquire with scottyler89@gmail.com

Who do I talk to?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bio_pyminer-0.9.6.tar.gz (31.2 MB view details)

Uploaded Source

Built Distributions

bio_pyminer-0.9.6-py3.7.egg (566.0 kB view details)

Uploaded Source

bio_pyminer-0.9.6-py3-none-any.whl (372.2 kB view details)

Uploaded Python 3

File details

Details for the file bio_pyminer-0.9.6.tar.gz.

File metadata

  • Download URL: bio_pyminer-0.9.6.tar.gz
  • Upload date:
  • Size: 31.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.6.tar.gz
Algorithm Hash digest
SHA256 03a3b7d3b0589161968e20e164f9114414c84f38bfe415f99dbbb38470b8c771
MD5 235b5b5adcf6936229fbf3f88eb8d6cd
BLAKE2b-256 8994730d79ed8458203cdab3900874dc86070b8af6c9c989144935cdc8fc4ab3

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.6-py3.7.egg.

File metadata

  • Download URL: bio_pyminer-0.9.6-py3.7.egg
  • Upload date:
  • Size: 566.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.6-py3.7.egg
Algorithm Hash digest
SHA256 7d06945698366b1dba43c45dfcb446fbd159697004328246856dccb4885c6500
MD5 9d24f9873645c7aba95b394e82f21935
BLAKE2b-256 920cdfc1e5d1f4cdba5024e445a03bf3515b94ba08f4c75fa5c73f7d732a5ab6

See more details on using hashes here.

File details

Details for the file bio_pyminer-0.9.6-py3-none-any.whl.

File metadata

  • Download URL: bio_pyminer-0.9.6-py3-none-any.whl
  • Upload date:
  • Size: 372.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.1

File hashes

Hashes for bio_pyminer-0.9.6-py3-none-any.whl
Algorithm Hash digest
SHA256 9d80ef8fc9f3550fd80de8457c777cf362d1b5eebe603032628124e25bcb15f6
MD5 e5603493acf59f2356584db2fd932cfa
BLAKE2b-256 b6a7409626838187a1a75983ea06aaa6128b7989ea4d55563acfa26cc802bf7d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page