Probabilistic Programming in Python: Bayesian Modeling and Probabilistic Machine Learning with Theano
PyMC3 is a Python package for Bayesian statistical modeling and Probabilistic Machine Learning focusing on advanced Markov chain Monte Carlo (MCMC) and variational inference (VI) algorithms. Its flexibility and extensibility make it applicable to a large suite of problems.
The future of PyMC3 & Theano
There have been many questions and uncertainty around the future of PyMC3 since Theano stopped getting developed by the original authors, and we started experiments with a PyMC version based on tensorflow probability.
Since then many things changed and we are happy to announce that PyMC3 will continue to rely on Theano, or rather its successors Theano-PyMC (pymc3 <4) and Aesara (pymc3 >=4). Check out <https://github.com/aesara-devs/aesara>`__) and specifically the latest developments on the PyMC3 `main branch <https://github.com/pymc-devs/pymc3/>`.
Intuitive model specification syntax, for example, x ~ N(0,1) translates to x = Normal('x',0,1)
Powerful sampling algorithms, such as the No U-Turn Sampler, allow complex models with thousands of parameters with little specialized knowledge of fitting algorithms.
Variational inference: ADVI for fast approximate posterior estimation as well as mini-batch ADVI for large data sets.
- Relies on Theano-PyMC which provides:
Computation optimization and dynamic C or JAX compilation
Numpy broadcasting and advanced indexing
Linear algebra operators
Transparent support for missing value imputation
If you already know about Bayesian statistics:
Learn Bayesian statistics with a book together with PyMC3:
Probabilistic Programming and Bayesian Methods for Hackers: Fantastic book with many applied code examples.
PyMC3 port of the book “Doing Bayesian Data Analysis” by John Kruschke as well as the second edition: Principled introduction to Bayesian data analysis.
PyMC3 port of the book “Bayesian Cognitive Modeling” by Michael Lee and EJ Wagenmakers: Focused on using Bayesian statistics in cognitive modeling.
To install PyMC3 on your system, follow the instructions on the appropriate installation guide:
Salvatier J., Wiecki T.V., Fonnesbeck C. (2016) Probabilistic programming in Python using PyMC3. PeerJ Computer Science 2:e55 DOI: 10.7717/peerj-cs.55.
To report an issue with PyMC3 please use the issue tracker.
Finally, if you need to get in touch for non-technical information about the project, send us an e-mail.
Software using PyMC3
Exoplanet: a toolkit for modeling of transit and/or radial velocity observations of exoplanets and other astronomical time series.
Bambi: BAyesian Model-Building Interface (BAMBI) in Python.
pymc3_models: Custom PyMC3 models built on top of the scikit-learn API.
PMProphet: PyMC3 port of Facebook’s Prophet model for timeseries modeling
webmc3: A web interface for exploring PyMC3 traces
sampled: Decorator for PyMC3 models.
NiPyMC: Bayesian mixed-effects modeling of fMRI data in Python.
beat: Bayesian Earthquake Analysis Tool.
pymc-learn: Custom PyMC models built on top of pymc3_models/scikit-learn API
fenics-pymc3: Differentiable interface to FEniCS, a library for solving partial differential equations.
cell2location: Comprehensive mapping of tissue cell architecture via integrated single cell and spatial transcriptomics.
Please contact us if your software is not listed here.
Papers citing PyMC3
See Google Scholar for a continuously updated list.
PyMC3 is a non-profit project under NumFOCUS umbrella. If you want to support PyMC3 financially, you can donate here.
PyMC for enterprise
PyMC is now available as part of the Tidelift Subscription!
Tidelift is working with PyMC and the maintainers of thousands of other open source projects to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while contributing financially to PyMC – making it even more robust, reliable and, let’s face it, amazing!
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.