Skip to main content

Extensible plugin-based client for unified wattnet time-series metric storage across multiple backends.

Reason this release was yanked:

Configuration API unsuitable for library usage.

Project description

Wattnet Logo

Storage Backend and Python Client Interface

wattnet-storage provides two things:

  • Storage backend — a Docker Compose stack with ClickHouse for time-series metric storage and Grafana for visualization.
  • Python client library — a plugin-based interface to read and write energy metrics (generation, load, carbon footprint, etc.) against the storage backend.

Purpose

Multiple Wattnet containers compute and expose energy data through their own APIs, each with its own domain model and internal representation. wattnet-storage acts as the shared persistence layer between them: it provides a single, uniform interface so that any Wattnet module can persist and retrieve metrics without coupling to a specific storage technology or to the internal data structures of other modules.

To achieve this, metrics are always stored in a common format regardless of how they are represented in the originating domain model:

Field Type Description
name str Metric identifier (MetricType value, e.g. zone_generation)
value float Numeric measurement
timestamp datetime Point in time the measurement was taken
metadata dict Arbitrary key-value labels (e.g. zone, source, unit)

Any Wattnet module that needs to persist data translates its domain objects into this format before writing, and reconstructs its own representation after reading. The storage backend in use (ClickHouse, or any future backend) is fully transparent to the caller.

Architecture

Storage component diagram

For the full system architecture see the wattnet-architecture repository.

The client layer is plugin-based (via stevedore). Additional storage backends can be added by implementing BaseStorageClient and registering a wattnet.storage.clients entry point.

Requirements

  • Python ≥ 3.10
  • Docker and Docker Compose (for the storage backend)

Backend Setup

Start the ClickHouse and Grafana services:

docker compose up -d
Service Default address
ClickHouse http://localhost:8123
Grafana http://localhost:3000

Grafana's default credentials are admin / admin. The ClickHouse datasource and dashboards are provisioned automatically.

Python Client

Installation

pip install wattnet-storage

Or with Poetry:

poetry add wattnet-storage

Configuration

The client reads settings from environment variables or a .env file. Copy the example and adjust as needed:

cp config/.env.example config/.env.development
Variable Default Description
WATTNET_ENV development Active environment; selects config/.env.<WATTNET_ENV>
STORAGE_CLIENTS [] Active backend plugins, e.g. ["clickhouse"]
CLICKHOUSE_HOST localhost ClickHouse hostname
CLICKHOUSE_PORT 9000 ClickHouse native TCP port
CLICKHOUSE_USER default ClickHouse username
CLICKHOUSE_PASSWORD (empty) ClickHouse password
DATABASE wattnet Target database name
TIMESERIES_STEP_MINUTES 15 Time resolution in minutes
LOG_LEVEL INFO Logging level (DEBUG, INFO, WARNING, …)
LOG_HANDLERS ["console"] Log outputs: "console" and/or "file"
LOG_FILE ./logs/wattnet-storage.log Log file path (only used when file handler is active)

Usage

from datetime import datetime
from wattnet.storage.repository import MetricsRepository
from wattnet.storage.models import Metric, MetricType

repo = MetricsRepository()

# Write metrics
metrics = [
    Metric(
        metric_type=MetricType.ZONE_GENERATION,
        value=1500.0,
        timestamp=datetime.now(),
        metadata={"zone": "ES", "source": "solar"},
    )
]
repo.write_metrics(metrics)

# Query metrics
results = repo.query_metrics(
    metric_name=MetricType.ZONE_GENERATION.value,
    start=datetime(2025, 1, 1),
    end=datetime(2025, 1, 2),
    labels={"zone": "ES"},
)

Supported metric types

MetricType Value Description
ZONE_GENERATION zone_generation Electricity generation in a zone
ZONE_IMPORT zone_import Electricity imports
ZONE_EXPORT zone_export Electricity exports
ZONE_LOAD zone_load Electricity consumption / load
ZONE_MIX_GENERATION zone_mix_generation Generation mix per source
FACTOR factor Emission factor
LOCAL_FOOTPRINT local_footprint Location-based carbon footprint
GLOBAL_FOOTPRINT global_footprint Market-based carbon footprint
LOCAL_IMPACT local_impact Location-based carbon impact
GLOBAL_IMPACT global_impact Market-based carbon impact
LOCAL_SCORE local_score Location-based carbon score
GLOBAL_SCORE global_score Market-based carbon score
FLOW_SHARE flow_share Share of electricity flow between zones
MIX_SHARE mix_share Share of generation mix
FOOTPRINT_SHARE footprint_share Share attributed to carbon footprint
IMPACT_SHARE impact_share Share attributed to carbon impact

Contributing

Contributions are welcome. See CONTRIBUTING.md for environment setup, code style, how to run the tests, and how to add a new storage backend.

License

This repository is licensed under the Apache License 2.0.

See the LICENSE file for more details.

Funding and Acknowledgments

This work is funded by the European Union's Horizon Europe research and innovation programme through the GreenDIGIT project, under grant agreement 101131207.

EU Funded Logo GreenDIGIT Logo
© 2026 Spanish National Research Council (CSIC). All rights reserved.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wattnet_storage-1.0.0.tar.gz (21.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wattnet_storage-1.0.0-py3-none-any.whl (23.4 kB view details)

Uploaded Python 3

File details

Details for the file wattnet_storage-1.0.0.tar.gz.

File metadata

  • Download URL: wattnet_storage-1.0.0.tar.gz
  • Upload date:
  • Size: 21.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for wattnet_storage-1.0.0.tar.gz
Algorithm Hash digest
SHA256 ce9ecc6cfdbab6b1639add9252a47873bf2fa12a1ddd758b97790ed68fc2593d
MD5 a7589b9ba399dbaa8e4ab6f306dd6212
BLAKE2b-256 25b431f4668965a0fa4bc6dac4bff81fda60b4df43582bf6d6c8424ab7b84bdb

See more details on using hashes here.

Provenance

The following attestation bundles were made for wattnet_storage-1.0.0.tar.gz:

Publisher: publish.yml on wattnet/wattnet-storage

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file wattnet_storage-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for wattnet_storage-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ac10375083a4d8610581e1cefc028ec96da243404ca89652cf047a8133b1061e
MD5 f678932786aff2ec21c47c0f74959b15
BLAKE2b-256 ce0f82ee5412514c309ab9a461208854b24f433df864ea6f37f6f50c81cba70c

See more details on using hashes here.

Provenance

The following attestation bundles were made for wattnet_storage-1.0.0-py3-none-any.whl:

Publisher: publish.yml on wattnet/wattnet-storage

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page