Skip to main content

Ensemble based Reservoir Tool (ERT)

Project description

ert

Build Status PyPI - Python Version Code Style Type checking codecov License: GPL v3

ert - Ensemble based Reservoir Tool - is designed for running ensembles of dynamical models such as reservoir models, in order to do sensitivity analysis and data assimilation. ert supports data assimilation using the Ensemble Smoother (ES), Ensemble Smoother with Multiple Data Assimilation (ES-MDA) and Iterative Ensemble Smoother (IES).

Installation

$ pip install ert
$ ert --help

or, for the latest development version (requires Python development headers):

$ pip install git+https://github.com/equinor/ert.git@main
$ ert --help

For examples and help with configuration, see the ert Documentation.

Developing

ert was originally written in C/C++ but most new code is Python.

Developing Python

You might first want to make sure that some system level packages are installed before attempting setup:

- pip
- python include headers
- (python) venv
- (python) setuptools
- (python) wheel

It is left as an exercise to the reader to figure out how to install these on their respective system.

To start developing the Python code, we suggest installing ert in editable mode into a virtual environment to isolate the install (substitute the appropriate way of sourcing venv for your shell):

# Create and enable a virtualenv
python3 -m venv my_virtualenv
source my_virtualenv/bin/activate

# Update build dependencies
pip install --upgrade pip wheel setuptools

# Download and install ert
git clone https://github.com/equinor/ert
cd ert
pip install --editable .

Test setup

Additional development packages must be installed to run the test suite:

pip install ".[dev]"
pytest tests/

Git LFS must be installed to get all the files. This is packaged as git-lfs on Ubuntu, Fedora or macOS Homebrew. For Equinor RGS node users, it is possible to use git from Red Hat Software Collections:

source /opt/rh/rh-git227/enable

test-data/block_storage is a submodule and must be checked out.

git submodule update --init --recursive

If you checked out submodules without having git lfs installed, you can force git lfs to run in all submodules with:

git submodule foreach "git lfs pull"

Style requirements

There are a set of style requirements, which are gathered in the pre-commit configuration, to have it automatically run on each commit do:

$ pip install pre-commit
$ pre-commit install

Trouble with setup

If you encounter problems during install, try deleting the _skbuild folder before reinstalling.

As a simple test of your ert installation, you may try to run one of the examples, for instance:

cd test-data/poly_example
# for non-gui trial run
ert test_run poly.ert
# for gui trial run
ert gui poly.ert

Note that in order to parse floating point numbers from text files correctly, your locale must be set such that . is the decimal separator, e.g. by setting

# export LC_NUMERIC=en_US.UTF-8

in bash (or an equivalent way of setting that environment variable for your shell).

Developing C++

C++ is the backbone of ert as in used extensively in important parts of ert. There's a combination of legacy code and newer refactored code. The end goal is likely that some core performance-critical functionality will be implemented in C++ and the rest of the business logic will be implemented in Python.

While running --editable will create the necessary Python extension module (src/ert/_clib.cpython-*.so), changing C++ code will not take effect even when reloading ert. This requires recompilation, which means reinstalling ert from scratch.

To avoid recompiling already-compiled source files, we provide the script/build script. From a fresh virtualenv:

git clone https://github.com/equinor/ert
cd ert
script/build

This command will update pip if necessary, install the build dependencies, compile ert and install in editable mode, and finally install the runtime requirements. Further invocations will only build the necessary source files. To do a full rebuild, delete the _skbuild directory.

Note: This will create a debug build, which is faster to compile and comes with debugging functionality enabled. The downside is that this makes the code unoptimised and slow. Debugging flags are therefore not present in builds of ert that we release on Komodo or PyPI. To build a release build for development, use script/build --release.

Notes

  1. If pip reinstallation fails during the compilation step, try removing the _skbuild directory.

  2. The default maximum number of open files is normally relatively low on MacOS and some Linux distributions. This is likely to make tests crash with mysterious error-messages. You can inspect the current limits in your shell by issuing the command ulimit -a. In order to increase maximum number of open files, run ulimit -n 16384 (or some other large number) and put the command in your .profile to make it persist.

Running C++ tests

The C++ code and tests require resdata. As long as you have pip install resdata'd into your Python virtualenv all should work.

# Create and enable a virtualenv
python3 -m venv my_virtualenv
source my_virtualenv/bin/activate

# Install build dependencies
pip install pybind11 conan cmake resdata

# Build ert and tests
mkdir build && cd build
cmake ../src/clib -DCMAKE_BUILD_TYPE=Debug
make -j$(nproc)

# Run tests
ctest --output-on-failure

Example usage

Basic ert test

To test if ert itself is working, go to test-data/poly_example and start ert by running poly.ert with ert gui

cd test-data/poly_example
ert gui poly.ert

This opens up the ert graphical user interface. Finally, test ert by starting and successfully running the simulation.

ert with a reservoir simulator

To actually get ert to work at your site you need to configure details about your system; at the very least this means you must configure where your reservoir simulator is installed. In addition you might want to configure e.g. queue system in the site-config file, but that is not strictly necessary for a basic test.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

ert-10.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (956.4 kB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

ert-10.1.3-cp312-cp312-macosx_11_0_arm64.whl (751.1 kB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

ert-10.1.3-cp312-cp312-macosx_10_15_x86_64.whl (773.2 kB view details)

Uploaded CPython 3.12 macOS 10.15+ x86-64

ert-10.1.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (945.4 kB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

ert-10.1.3-cp311-cp311-macosx_11_0_arm64.whl (738.7 kB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

ert-10.1.3-cp311-cp311-macosx_10_15_x86_64.whl (759.8 kB view details)

Uploaded CPython 3.11 macOS 10.15+ x86-64

ert-10.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (944.4 kB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

ert-10.1.3-cp310-cp310-macosx_10_15_x86_64.whl (758.7 kB view details)

Uploaded CPython 3.10 macOS 10.15+ x86-64

ert-10.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (944.9 kB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

ert-10.1.3-cp39-cp39-macosx_10_15_x86_64.whl (758.8 kB view details)

Uploaded CPython 3.9 macOS 10.15+ x86-64

ert-10.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (944.5 kB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

ert-10.1.3-cp38-cp38-macosx_10_15_x86_64.whl (758.5 kB view details)

Uploaded CPython 3.8 macOS 10.15+ x86-64

File details

Details for the file ert-10.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e7ee93e8731043afb9457279b52bc8d553a67969081e1f2d4a6d648aa09650ff
MD5 8201ca52f729d828a32e43904804d932
BLAKE2b-256 529bfda7daa32fb42f62fdd791ce75a2ce310a28574393cddfb3b9bfdec076ee

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ddbb8c18b820bf12b97f8b0c11caa88054b2a6203d46ebe7add117a09c83aba1
MD5 b73ad868d34d8f1a8e31a7aef3845aaa
BLAKE2b-256 1f202d4834aa480085f6e8b3a48f7ea53c486c2bdc6aa7ebf1bada64f0d79ef6

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp312-cp312-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp312-cp312-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 07c8ccb77191daee326c27c3856487708c6c444249afacbb18a3d03803f61c91
MD5 fb154947bcab040d928967a65c7ef318
BLAKE2b-256 79cdf7456dfd92bf9bd48ac9ef8542f041279a86ff7cdf983ef987b789f3e822

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4e9090d097d1859717210055a1f44f28e9a9b77c76bd8ab2566e1efd0e46cf85
MD5 634e708849a3f7769f9903d1db08bdff
BLAKE2b-256 b74e76cc6cb5d3978629c08382cd049ae8bc97356d841ef60173121e37484e58

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f2b6e4b266d27ec447db5b9e65cc5db7c33c8abc4db96a8024b4406839cae36a
MD5 ec16489a9e492b0986179b96c7b7e818
BLAKE2b-256 ef162886ec2495b85e68a71aee400f50fd4a51d870406691b18ff380295d7edd

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp311-cp311-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp311-cp311-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 98c921ad21ca9be2d427d85600ee5302575483beb588a63279d5512ab8860c06
MD5 c84fd89ef5752f96f28e1485b9773604
BLAKE2b-256 7b83d4ff3eba253e5dc58df6f751575fdfeb9329c3961229d77f777226ce73b5

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 22eba11fda3583838485b91c4f78e4921cf486096a8d14d38bb721df92a8b8fd
MD5 21c0577f1667b222feac18aa22373a8b
BLAKE2b-256 d2df0cb3bdd9c0af583c4a92e925de9bc458d651746a0dbee6d5652a756ded43

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp310-cp310-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp310-cp310-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 cc99dcd15427c81000311c0750d67dbbd84e2e3c192d9c83a0dda1b3b1fbec71
MD5 83d5c81de502360e4f463504f7492dab
BLAKE2b-256 0e62119bd0034fa245a4c61a080fe6a7f10d168ea78885615d651d5631cadee5

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 45ff8a87fd3ff4ec3e3815b5c44a4b4606ae4f0ba5c02d987bcb446e81efc761
MD5 f2c1b92dc91a77a908582234f664ffe2
BLAKE2b-256 43ee0c6e94669cefe23e631f2f63cf06cccff4b576a5912efa52189b80682ffc

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp39-cp39-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp39-cp39-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 7816fbb780b73579894691e69369e64c1c9a577141eb6a783870fb4359ae0679
MD5 0ea5492ef95a31c27b7a53bbfd948f61
BLAKE2b-256 8e2c9cb9d06f52174652080bd5efeba8853355ed2576f906a894a78082dd552f

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 5c251f8324bed4180cfdea8f455e29adc892d2d0ebc1b4008ab30f05c876a884
MD5 fabe775293f2d54f90b5915a22f50d16
BLAKE2b-256 f4f08ec0cf0d9e2bf661c150142f1fc100c40748070a6df8299e04131ec94044

See more details on using hashes here.

File details

Details for the file ert-10.1.3-cp38-cp38-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-10.1.3-cp38-cp38-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 f0c5bcfa2b479a1df05acf0540008016657376feec1859d18a92aa84ca8fc87a
MD5 21d2937973fb150e1a7a9b2c2c3a132a
BLAKE2b-256 6a2581e1373ecb1d4423e3b1de71b8b316d7734807092cf99797eeb4986ce926

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page