Skip to main content

SYnergistic Modelling Framework for Linking and Unifying Earth-system Nexii for Computational Exploration

Project description

SYMFLUENCE

SYnergistic Modelling Framework for Linking and Unifying Earth-system Nexii for Computational Exploration

PyPI version Python 3.11+ License: GPL v3 Documentation Build Status Tests


Overview

SYMFLUENCE is a computational environmental modeling platform that streamlines the hydrological modeling workflow—from domain setup to evaluation. It provides an integrated framework for multi-model comparison, parameter optimization, and automated workflow management across spatial scales.


Quick Links


Installation

Quick Start (Recommended)

Option 1: pip

pip install symfluence

Option 2: uv (Fast Python installer)

# Into current environment
uv pip install symfluence

# As an isolated CLI tool
uv tool install symfluence

Option 3: pipx (Isolated CLI)

pipx install symfluence

After installation, install external model binaries:

symfluence binary install

Development Installation

# Clone repository
git clone https://github.com/DarriEy/SYMFLUENCE.git
cd SYMFLUENCE

# Use built-in installer
./scripts/symfluence-bootstrap --install

This creates a clean Python 3.11 virtual environment, installs dependencies, and builds binaries. For detailed instructions (ARC, FIR, Anvil, custom builds), see the installation guide.

npm (Optional — Experimental)

The npm package bundles pre-built binaries (SUMMA, mizuRoute, FUSE, NGEN, TauDEM) for supported platforms:

npm install -g symfluence

# Verify bundled binaries
symfluence binary info

# Check system compatibility
symfluence binary doctor

Supported platforms:

  • Linux: Ubuntu 22.04+, RHEL 9+, or Debian 12+ (x86_64)
  • macOS: macOS 12+ (Apple Silicon M1/M2/M3)

Note: The npm package is an alternative distribution channel for pre-built binaries. The Python package (pip/uv) is the primary installation method.

System Requirements

System Dependencies (Important)

SYMFLUENCE requires several system-level libraries that must be installed before pip installation:

GDAL (Required)

GDAL is a complex geospatial library that requires system-level installation. The Python bindings (gdal package) will fail to install if the system library is not present.

# Ubuntu/Debian
sudo apt-get update
sudo apt-get install -y gdal-bin libgdal-dev
export CPLUS_INCLUDE_PATH=/usr/include/gdal
export C_INCLUDE_PATH=/usr/include/gdal

# macOS (Homebrew)
brew install gdal

# Windows (conda recommended)
conda install -c conda-forge gdal

# Verify installation
gdalinfo --version

Other System Libraries

# Ubuntu/Debian
sudo apt-get install -y libnetcdf-dev libhdf5-dev libproj-dev libgeos-dev

# macOS (Homebrew)
brew install netcdf hdf5 proj geos

# Windows
# Use conda-forge channel for these dependencies
conda install -c conda-forge netcdf4 hdf5 proj geos

R (Required for rpy2)

Some hydrological models require R integration via rpy2:

# Ubuntu/Debian
sudo apt-get install -y r-base r-base-dev

# macOS
brew install r

# Windows
# Download and install from https://cran.r-project.org/

Troubleshooting

If you encounter GDAL installation issues:

  1. Ensure GDAL system library version matches the Python package version
  2. On Windows, prefer conda installation over pip for geospatial packages
  3. Run symfluence binary doctor to diagnose system dependencies

macOS Apple Silicon (M1/M2/M3):

# Recommended: use Homebrew
brew install gdal
pip install gdal==$(gdal-config --version)

# Alternative: use conda-forge
conda install -c conda-forge gdal geopandas rasterio

Windows:

# Use conda-forge for all geospatial dependencies
conda create -n symfluence python=3.11
conda activate symfluence
conda install -c conda-forge gdal geopandas rasterio netcdf4 hdf5
pip install symfluence

For detailed troubleshooting, see the installation guide


Quick Start

Basic CLI Usage

# Show options
symfluence --help

# Run full workflow
symfluence workflow run --config my_config.yaml

# Run specific steps
symfluence workflow steps setup_project calibrate_model

# Define domain from pour point
symfluence project pour-point 51.1722/-115.5717 --domain-name MyDomain --definition semidistributed

# Check workflow status
symfluence workflow status

# Validate configuration
symfluence config validate --config my_config.yaml

First Project

# Initialize project from template
symfluence project init

# Or copy template manually
cp src/symfluence/resources/config_templates/config_template.yaml my_project.yaml

# Run setup
symfluence workflow step setup_project --config my_project.yaml

# Run full workflow
symfluence workflow run --config my_project.yaml

Python API

For programmatic control or integration:

from pathlib import Path
from symfluence import SYMFLUENCE

cfg = Path('my_config.yaml')
symfluence = SYMFLUENCE(cfg)
symfluence.run_individual_steps(['setup_project', 'calibrate_model'])

Configuration

YAML configuration files define:

  • Domain boundaries and discretization
  • Model selection and parameters
  • Optimization targets
  • Output and visualization options

See src/symfluence/resources/config_templates/config_template.yaml for a full example.


Project Structure

SYMFLUENCE/
├── src/symfluence/           # Main Python package
│   ├── core/                 # Core system, configuration, mixins
│   ├── cli/                  # Command-line interface
│   ├── project/              # Project and workflow management
│   ├── data/                 # Data acquisition and preprocessing
│   ├── geospatial/           # Domain discretization and geofabric
│   ├── models/               # Model integrations (SUMMA, FUSE, GR4J, etc.)
│   ├── optimization/         # Calibration algorithms (DDS, DE, PSO, NSGA-II)
│   ├── evaluation/           # Performance metrics and evaluation
│   ├── reporting/            # Visualization and plotting
│   └── resources/            # Configuration templates and base settings
├── examples/                 # Progressive tutorial examples
├── docs/                     # Sphinx documentation source
├── scripts/                  # Build and release scripts
├── tools/                    # NPM packaging and utilities
└── tests/                    # Unit, integration, and E2E tests

Branching Strategy

  • main: Stable releases only — every commit is a published version.
  • develop: Ongoing integration — merges from feature branches and then tested before release.
  • Feature branches: feature/<description>, PR to develop.

Contributing

See CONTRIBUTING.md for:

  • Code standards and testing
  • Branching and pull request process
  • Issue reporting

License

Licensed under the GPL-3.0 License. See LICENSE for details.


Happy modelling! The SYMFLUENCE Team

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

symfluence-0.7.3.tar.gz (3.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

symfluence-0.7.3-py3-none-any.whl (29.9 kB view details)

Uploaded Python 3

File details

Details for the file symfluence-0.7.3.tar.gz.

File metadata

  • Download URL: symfluence-0.7.3.tar.gz
  • Upload date:
  • Size: 3.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for symfluence-0.7.3.tar.gz
Algorithm Hash digest
SHA256 f7e0f6f8416689a5619dcbf3ac562d39e49016420478257b2c804ada025a3f8e
MD5 575510c09b86676c8a34034a15256732
BLAKE2b-256 15c0cf26f8b627d6abbe77977e337575cc35784c9b237a4d733833f18b537966

See more details on using hashes here.

File details

Details for the file symfluence-0.7.3-py3-none-any.whl.

File metadata

  • Download URL: symfluence-0.7.3-py3-none-any.whl
  • Upload date:
  • Size: 29.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for symfluence-0.7.3-py3-none-any.whl
Algorithm Hash digest
SHA256 f3d62878d3cb0028bbaee8cc7819dd05b1b7e934429f984ab5f29a448ae9a973
MD5 890f1f3c7a80a0701754336994c16953
BLAKE2b-256 11fb77381206f81a286dfe2b8a97d27ade076c842856e47e779f88f473f1b5f0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page