Skip to main content

Ensemble based Reservoir Tool (ERT)

Project description

ert

Build Status PyPI - Python Version Code Style Type checking codecov License: GPL v3

ert - Ensemble based Reservoir Tool - is designed for running ensembles of dynamical models such as reservoir models, in order to do sensitivity analysis and data assimilation. ert supports data assimilation using the Ensemble Smoother (ES), Ensemble Smoother with Multiple Data Assimilation (ES-MDA) and Iterative Ensemble Smoother (IES).

Installation

$ pip install ert
$ ert --help

or, for the latest development version (requires Python development headers):

$ pip install git+https://github.com/equinor/ert.git@main
$ ert --help

For examples and help with configuration, see the ert Documentation.

Developing

ert was originally written in C/C++ but most new code is Python.

Developing Python

You might first want to make sure that some system level packages are installed before attempting setup:

- pip
- python include headers
- (python) venv
- (python) setuptools
- (python) wheel

It is left as an exercise to the reader to figure out how to install these on their respective system.

To start developing the Python code, we suggest installing ert in editable mode into a virtual environment to isolate the install (substitute the appropriate way of sourcing venv for your shell):

# Create and enable a virtualenv
python3 -m venv my_virtualenv
source my_virtualenv/bin/activate

# Update build dependencies
pip install --upgrade pip wheel setuptools

# Download and install ert
git clone https://github.com/equinor/ert
cd ert
pip install --editable .

Test setup

Additional development packages must be installed to run the test suite:

pip install ".[dev]"
pytest tests/

Git LFS must be installed to get all the files. This is packaged as git-lfs on Ubuntu, Fedora or macOS Homebrew. For Equinor RGS node users, it is possible to use git from Red Hat Software Collections:

source /opt/rh/rh-git227/enable

test-data/block_storage is a submodule and must be checked out.

git submodule update --init --recursive

If you checked out submodules without having git lfs installed, you can force git lfs to run in all submodules with:

git submodule foreach "git lfs pull"

Style requirements

There are a set of style requirements, which are gathered in the pre-commit configuration, to have it automatically run on each commit do:

$ pip install pre-commit
$ pre-commit install

Trouble with setup

If you encounter problems during install, try deleting the _skbuild folder before reinstalling.

As a simple test of your ert installation, you may try to run one of the examples, for instance:

cd test-data/poly_example
# for non-gui trial run
ert test_run poly.ert
# for gui trial run
ert gui poly.ert

Note that in order to parse floating point numbers from text files correctly, your locale must be set such that . is the decimal separator, e.g. by setting

# export LC_NUMERIC=en_US.UTF-8

in bash (or an equivalent way of setting that environment variable for your shell).

Developing C++

C++ is the backbone of ert as in used extensively in important parts of ert. There's a combination of legacy code and newer refactored code. The end goal is likely that some core performance-critical functionality will be implemented in C++ and the rest of the business logic will be implemented in Python.

While running --editable will create the necessary Python extension module (src/ert/_clib.cpython-*.so), changing C++ code will not take effect even when reloading ert. This requires recompilation, which means reinstalling ert from scratch.

To avoid recompiling already-compiled source files, we provide the script/build script. From a fresh virtualenv:

git clone https://github.com/equinor/ert
cd ert
script/build

This command will update pip if necessary, install the build dependencies, compile ert and install in editable mode, and finally install the runtime requirements. Further invocations will only build the necessary source files. To do a full rebuild, delete the _skbuild directory.

Note: This will create a debug build, which is faster to compile and comes with debugging functionality enabled. The downside is that this makes the code unoptimised and slow. Debugging flags are therefore not present in builds of ert that we release on Komodo or PyPI. To build a release build for development, use script/build --release.

Notes

  1. If pip reinstallation fails during the compilation step, try removing the _skbuild directory.

  2. The default maximum number of open files is normally relatively low on MacOS and some Linux distributions. This is likely to make tests crash with mysterious error-messages. You can inspect the current limits in your shell by issuing the command ulimit -a. In order to increase maximum number of open files, run ulimit -n 16384 (or some other large number) and put the command in your .profile to make it persist.

Running C++ tests

The C++ code and tests require resdata. As long as you have pip install resdata'd into your Python virtualenv all should work.

# Create and enable a virtualenv
python3 -m venv my_virtualenv
source my_virtualenv/bin/activate

# Install build dependencies
pip install pybind11 conan cmake resdata

# Build ert and tests
mkdir build && cd build
cmake ../src/clib -DCMAKE_BUILD_TYPE=Debug
make -j$(nproc)

# Run tests
ctest --output-on-failure

Example usage

Basic ert test

To test if ert itself is working, go to test-data/poly_example and start ert by running poly.ert with ert gui

cd test-data/poly_example
ert gui poly.ert

This opens up the ert graphical user interface. Finally, test ert by starting and successfully running the simulation.

ert with a reservoir simulator

To actually get ert to work at your site you need to configure details about your system; at the very least this means you must configure where your reservoir simulator is installed. In addition you might want to configure e.g. queue system in the site-config file, but that is not strictly necessary for a basic test.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

ert-9.0.12-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (947.8 kB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

ert-9.0.12-cp312-cp312-macosx_11_0_arm64.whl (742.6 kB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

ert-9.0.12-cp312-cp312-macosx_10_15_x86_64.whl (764.6 kB view details)

Uploaded CPython 3.12 macOS 10.15+ x86-64

ert-9.0.12-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (937.2 kB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

ert-9.0.12-cp311-cp311-macosx_11_0_arm64.whl (730.2 kB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

ert-9.0.12-cp311-cp311-macosx_10_15_x86_64.whl (751.3 kB view details)

Uploaded CPython 3.11 macOS 10.15+ x86-64

ert-9.0.12-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (935.8 kB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

ert-9.0.12-cp310-cp310-macosx_11_0_arm64.whl (729.2 kB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

ert-9.0.12-cp310-cp310-macosx_10_15_x86_64.whl (750.3 kB view details)

Uploaded CPython 3.10 macOS 10.15+ x86-64

ert-9.0.12-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (936.6 kB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

ert-9.0.12-cp39-cp39-macosx_10_15_x86_64.whl (750.3 kB view details)

Uploaded CPython 3.9 macOS 10.15+ x86-64

ert-9.0.12-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (936.6 kB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

ert-9.0.12-cp38-cp38-macosx_10_15_x86_64.whl (750.1 kB view details)

Uploaded CPython 3.8 macOS 10.15+ x86-64

File details

Details for the file ert-9.0.12-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7edde0c8024b269decc1ef49f256bb28f72ea31d8f0a39f2f8c1813e60a80be8
MD5 eec916a002ee8378b1874da7f4f216c2
BLAKE2b-256 d9fbd199875bb789bd2e0d85b1b1b864e51dfa619af472829962f57e551cc309

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 aa404eebf06aecf6369ed59c7d3b378050b210e707fc2619f0153264c4cfdcc5
MD5 61cdcc4c037eada6269810e5ccc408a4
BLAKE2b-256 be7e78ec38a64c96c97ef8178605112c4488286c6ba408929d1c65d6d785f1ad

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp312-cp312-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp312-cp312-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 5311155d7b5ff1c98dce39d499189a87c875bf1d7c77b0084acaf2187cb3a602
MD5 a2d41bd37d19a457894067e7fc99dbf2
BLAKE2b-256 104cf42b9d178204481706017ece8a803d48c5a8f947103bdab013b452e7e17a

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9a25a65d72639390bf36cd6635d1f35c610874834ba6c5894ec870e5242321aa
MD5 c94bd3edac380773cb3d9f5b784a38d2
BLAKE2b-256 84331cdf574b7c463275a62dc1d39a1f931ae039ba913387e34092620656e697

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 2836bd0947adcb10881f8a88379c6f10157a62d210b2134e246e1653eaf32d1c
MD5 314b51370271d794e918a3d9a0a7415a
BLAKE2b-256 1976e53b1162c9a7d152e21fcdacf2f583d0bba90795b9529f838de7b76db3bf

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp311-cp311-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp311-cp311-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 bdc65197a1aa8440b82639d829ded6dc4c03ee7bb3f84c3ed1f30670c05565aa
MD5 6147ddb5400ad81d60ff4b0b4c3e402d
BLAKE2b-256 e2951d1fd94314548879858440a7e3b5c0c312edcf406edb23c10de3b6e99435

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6bc948faa7c629e48069e67926dce01d30bb00f1964627c624256fdc1f3099e2
MD5 15ddd0d37fc556791d1f25ce911d10c2
BLAKE2b-256 bfa3ad9c6b0967a273d78e06903da85dcbde7854b14f45e272d58609893f63f0

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6d36f95c67cae89eaff27cd09893bc709cf3b1b5397fee7936b1a70c63fafc9e
MD5 250053a85cfe39b2ec05065a44094114
BLAKE2b-256 0327a7a7f3847371da932c3aa88e4c811ee37b1370f2dffbd6a9b42a09923f6e

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp310-cp310-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp310-cp310-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 d46ac639686c30e036489aa4c863a14495ef1b4f3ca80d3e175dbc76de186fa3
MD5 620553979acad0c44f2a76cad324d902
BLAKE2b-256 237c9493b9af8351b901ea954adb33ca4894f7b15133f93baba2ce83a529b2ae

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b76ac07a96eb62f60822a5b2c721e692cc608c55f662ca4cf0607b4c35b0f790
MD5 77ec16fc6d56b97252f90852a5879a35
BLAKE2b-256 b712db81160149ba0b5e240bee0493b49db6f96873645a76a4ff6930c458bd51

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp39-cp39-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp39-cp39-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 3d16fc2b2a8e505a4c79a83c8bc952af70c651aadf847bbc087e6cdaecbd60c2
MD5 88dbd7a5fa55bb8c4f692a98e1c967c7
BLAKE2b-256 2a91312875ffe31f32c42e38c03e8973731e3322d09590a59ab2b8fc52f62a7f

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 28062ddca1d1a139c245fe1f1257ea3029875dfbed10e199cf61bc3871b4b0af
MD5 6a6bb67f170720ed3e90b5273d1c375b
BLAKE2b-256 b6e7d42b8e696b9d4276074510a066124d9fea024429446b5ea7469ccbf7eb40

See more details on using hashes here.

File details

Details for the file ert-9.0.12-cp38-cp38-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for ert-9.0.12-cp38-cp38-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 50e74d8f433da858375dc5e15fb0d18d131052de9f9933e352bb11a8b03326e9
MD5 0237ec2e95329c835f78bbc3cccd0ea8
BLAKE2b-256 c78f2a0a9caa34ee2b395f45740e9bdc5e0d0dcad8ffab5503cedbf784f4cb0f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page