forward simulation using python
Project description
This is the main README for the fwdpy software.
This package is a testing ground for providing access to efficient forward-time population simulation machinery in Python.
This package is implemented in terms of:
Cython, which is a package allowing C++ and Python to work together
fwdpp, which is a C++11 template library for implementing efficient population genetic simulations
Please note that this package is likely to be quite unstable/actively developed.
The package is usable now (in fact, we are currently using it for research), but the API, etc., could change without warning.
Citation
See the project home page for details (http://molpopgen.github.io/fwdpy).
Features:
So far, there is support for:
Simulation of a recombining region with arbitrary variation in neutral mutation rate, recombination rate, and distribution of selective effects and their dominance along the region.
Support for arbitrary changes in population size.
The ability to sample from simulated populations.
Calculate some standard summary statistics from samples taken from simulated populations.
Selfing
The ability to vary model parameters over time (recombination rates, genetic maps, selfing, selection, etc.)
Sampling populations at various time points
Parallel executiom of simulations. Multiple replicates may be run simultaenously via C++11’s threading mechanism. This is a “sneaky” end-run around Pythons’ Global Interpreter Lock, or GIL.
The following distributions of selection coefficients are supported:
constant (i.e., s takes on a fixed value)
uniform
exponential
gamma
gaussian
The following distributions of dominance are supported:
constant (i.e., h takes on a fixed value)
Google Group
For help with various issues, check out the fwdpy Google Group
Examples
Several examples exist in the form of output from “iPython”/Jupyter notebooks:
Availability
This package is distributed at the following github repository: https://github.com/molpopgen/fwdpy.
Dependencies
This section assumes that all packages are installed in fairly standard locations, such as /usr/local. See the troubleshooting section for more complex setups.
This package minimally depends on:
The configure script will enforce minimum version numbers of these dependencies, if necessary.
Note: fwdpy may require the ‘dev’ branch of fwdpp. The configure script checks for both the correct dependency version number and specific header files within each depdency. If the version number check passes, but a subsequent header check fails, then that is a sign that you need a development version of the relevant dependency. The reason for this situation is that the development of fwdpy has generated ideas for how to make fwdpp more accessible. This situation will remain until fwdpy stabilizes.
You also need a C++11-compliant compiler. For linux users, GCC 4.8 or newer should suffice. OS X users must use the clang-omp package from brew.
You may use one or the other of these libraries, but not both. See the Performance subsection of the Installation section below for how to use these libraries.
Notes for OS X users
Apple is making life difficult for OS X users. The release of El Capitan made installing third-party Unix tools into /usr/local more difficult. A lot of the instructions below ask you to use brew to install depdendencies. Please make sure that you have a working brew setup before trying any of the below. If your setup is not working, please do research online about fixing it, which is beyond the scope of this document.
OS X users are recommended to use brew to install the various dependencies:
$ brew install clang-omp
$ brew install gsl
$ ##Risky:
$ brew install fwdpp
$ brew install google-perftools
Important: you need to install clang-omp on OS X! This package uses openmp for parallelizing some tasks. Sadly, OS X’s compiler does not come with openmp support, and so you need a third-party compiler that does.
For brew users, you may or may not have luck with their version of fwdpp. That package can change rapidly, and thus the brew version may get out-of-sync with the version required for this package.
The required Python package dependencies are in the requirements.txt file that comes with the source.
What Python version?
I’m developing the package using Python 2.7.6 on an Ubuntu machine.
Currently, the package is not 100% compatible with Python 3. The goal is to make it work, though.
Installation
The latest release of the package is available via PyPi, and can be installed with your favorite Python package manager:
$ pip install --upgrade fwdpy
OS X users must first install clang-omp from brew and use the following command:
$ CC=clang-omp CXX=clang-omp++ pip install fwdpy
Installation from source
This section describes “vanilla” installation using the minimal dependencies.
First, install the dependencies (see above).
OS X users need to do the following first:
$ export CC=clang-omp
$ export CXX=clang-omp++
To install system-wide.
$ ./configure
$ sudo python setup.py install
To install for your user:
$ ./configure --prefix=$HOME
$ #yes, the prefix is needed again here...
$ python setup.py install --prefix=$HOME
To uninstall:
$ #use 'sudo' here if it is installed system-wide...
$ pip uninstall fwdpy
To build the package in place and run the unit tets:
$ #build package locally:
$ python setup.py build_ext -i
$ #run the unit tests:
$ python -m unittest discover unit_test
Note for developers
Cython is a static compiler. Code written in Cython is compiled into C or, in the case of this package, C++. Finally, the system’s C/C++ compiler is used to compile the final Python module.
In order to modify the package, you will need Cython installed:
$ pip install Cython
You need Cython >= 0.22.2, so upgrade if you need to:
$ pip install --upgrade Cython
If you wish to modify the package, then you will want setup.py to “re-Cythonize” when you make changes to the package source code.
To do this, use the setup.py script as follows:
$ python setup.py build_ext -i --use-cython
Now, Cython will be a compilation depdendency, and any changes to .pyx/.pyd/.cc files in this package will trigger Cython to regenerate the .cpp files that make up the core of the package.
Rough guide to installation on UCI HPC
Use the following module:
$ module load krthornt/thorntonlab
That command loads the proper dependencies for compiling much of the tools that we use.
Note: this module replaces/over-rules some modules already on HPC. The “thorntonlab” modules are all consistently compiled with a GCC version that we’ve deemed suitable.
Troubleshooting the installation
Incorrect fwdpp version
This package is compatible with fwdpp >= 0.4.5, which means that you should have a binary installed on your systems called fwdppConfig. You can check if you have it:
$ which fwdppConfig
If the above command returns nothing, then it is very likely that fwdpp is either too old, missing entirely from your system, or it is installed somewhere non-standard. For example, if you installed fwdpp locally for your user, and did not edit PATH to include ~/bin, then fwdppConfig cannot be called without referring to its complete path.
Dependencies in non-standard locations
Your system’s compiler has a default set of paths where it will look for header files, libraries, etc. Typically, these paths will include /usr and /usr/local. If you have installed the dependencies somewhere else (your home directory, for example), then the ./configure script may not be able to find them automatically.
NOTE: I sometimes get requests for installation help from users who have installed every dependency in a separate folder in their $HOME. In other words, they have some setup that looks like this:
$HOME/software/boost
$HOME/software/gsl
$HOME/software/fwdpp
If you insist on doing this, then you are on your own. You have to manually pass in all of the -I and -L flags to all of these locations. This setup is problematic because it violates the POSIX Filesystem Hierarchy Standard (http://en.wikipedia.org/wiki/Filesystem_Hierarchy_Standard), and you cannot reasonably expect things to “just work” any more. It would be best to start over, and simply install all of the dependencies into the following prefix:
$ $HOME/software
Doing so will allow $HOME/software/include, etc., to be populated as they were intended to be.
Documentation
The manual is available online in html format at the project web page.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.