Temporal Aggregation & Disaggregation for Modern Python (Polars-first)
Project description
aggdisagg
Temporal Aggregation & Disaggregation for Modern Python
Install & try in 10 seconds:
pip install "aggdisagg[all]"
Note: Requires Python ≥ 3.10. For Excel support (read_excel etc.) use the excel extra or install fastexcel / openpyxl separately (or read with pandas + pl.from_pandas).
import polars as pl
from aggdisagg import TemporalAligner
df = pl.DataFrame({"date": ["2020", "2021"], "y": [100.0, 120.0]})
print(TemporalAligner().fit_transform(df, datetime_col="date", target_col="y"))
aggdisagg is a clean, Polars-first Python library for converting time series between frequencies with perfect aggregation consistency.
- Disaggregate low → high frequency (with indicators)
- Aggregate high → low frequency (symmetric)
- Works with Polars (primary), pandas, and xarray
Installation + Try in 10 Seconds
pip install "aggdisagg[all]" && python -c "
import polars as pl
from datetime import date
from aggdisagg import TemporalAligner
df = pl.DataFrame({'date':[date(2020,1,1),date(2021,1,1)], 'y':[1000.,1200.]})
print(TemporalAligner(method='uniform').fit_transform(df, datetime_col='date', target_col='y'))
"
Quickstart with TemporalAligner
import polars as pl
from datetime import date
from aggdisagg import TemporalAligner
df = pl.DataFrame({
"date": [date(2020, 1, 1), date(2021, 1, 1), date(2022, 1, 1)],
"y": [1200.0, 1500.0, 1350.0], # low-frequency target
"indicator": [100.0, 125.0, 110.0], # high-frequency indicator
})
aligner = TemporalAligner(
method="chow-lin-opt",
target_freq="1mo",
agg="sum",
indicator_cols=["indicator"],
)
monthly = aligner.fit_transform(df, datetime_col="date", target_col="y")
print(monthly.head())
# Perfect symmetric aggregation
yearly_back = aligner.aggregate(monthly, freq="1y")
print("Roundtrip OK:", (yearly_back["y_1y"] - df["y"]).abs().sum() < 1e-8)
# Plot (requires plotly)
monthly.plot() # or use .plot() on the result if extended
Supported Methods
uniformlineardenton/denton-cholettechow-lin,chow-lin-opt(auto ρ via maxlog/minrss)litterman,fernandez
All methods guarantee C @ y_high ≈ y_low exactly.
Real-World Example: Disaggregating Multiple Quarterly Series to Monthly
When you have a DataFrame with several low-frequency series (e.g. quarterly revenue for multiple companies) and want to convert them all to monthly while preserving the aggregation constraint, use the disaggregate_columns helper:
import polars as pl
from datetime import date
from aggdisagg import TemporalAligner
# Synthetic quarterly data (mimics real company revenue files)
df_q = pl.DataFrame({
"date": [date(2018, 3, 1), date(2018, 6, 1), date(2018, 9, 1), date(2018, 12, 1)],
"Krones": [1_020_000_000, 1_028_000_000, 1_032_000_000, 1_328_000_000],
"JBT": [409_200_000, 491_300_000, 481_900_000, 537_300_000],
"GEA": [1_189_000_000, 1_403_000_000, 1_360_000_000, 1_570_000_000],
})
aligner = TemporalAligner(method="linear", target_freq="1mo", agg="sum")
monthly = aligner.disaggregate_columns(
df_q,
datetime_col="date",
include_dates=True, # automatically generates proper monthly dates
)
print(monthly.head(6))
# date Krones JBT GEA
# 2018-01-01 ~339.1m ~131.1m ~374.3m
# ...
# Round-trip check
reagg = aligner.aggregate(monthly.drop("date"), freq="1q")
print("Sums match original quarters:",
(reagg["y_1q"] - df_q["Krones"]).abs().sum() < 1e-6)
Notes
- The helper automatically detects numeric columns as targets (or pass
target_cols=[...]). - Date inference now correctly chooses a ratio of 3 for quarterly → monthly (instead of assuming annual).
- Use
include_dates=Truefor a ready-to-use monthly date column, or callexpand_high_freq_datesyourself for custom alignment. - All series are disaggregated independently but share the same frequency mapping.
- New in 1.4.1:
extrapolate("nan" default) controls NaN low-freq input handling. "nan" (default) and "drop" never fabricate values from missing inputs; "hold"/"linear" fill using last anchor when requested. Pass onfit_transform(..., extrapolate=...)ordisaggregate_columns(...).
See examples/quickstart.py for more patterns.
Why aggdisagg?
aggdisagg focuses on correctness and calendar fidelity first:
- Calendar-aware disaggregation across all frequency pairs (including irregular ratios, leap years, week boundaries)
- Symmetric calendar-aware aggregation
- 8 real methods: uniform, linear, denton, denton-cholette, chow-lin, chow-lin-opt, litterman, fernandez
- Automatic stock/flow semantics detection
week_start+partial_weekscontrol- Honest NaN handling (
nandefault never fabricates values) - Calibrated opt-in uncertainty bands (
with_uncertainty=True)
It is Polars-native (core since 1.6.1; lazy-friendly, no pandas routing in the main paths) with excellent pandas/xarray interop, a sklearn-style API, and production quality (typed, tested, documented).
The recommended multi-series API (disaggregate_columns) has negligible overhead vs. calling fit_transform in a loop (see Benchmarks below).
First-User Tips & Current Limitations
Recommended starting point
aligner = TemporalAligner(method="chow-lin-opt", target_freq="1mo", agg="sum", indicator_cols=[...])
high = aligner.fit_transform(low_df, datetime_col="date", target_col="y")
back = aligner.aggregate(high, freq="1y") # should match original low almost exactly
Output shape
By default (return_dataframe=True, include_dates=True), fit_transform returns a ready-to-use Polars DataFrame with a leading date (pl.Date) column plus y_disaggregated (and bands when with_uncertainty=True). This matches the behavior of disaggregate_columns(..., include_dates=True).
high = aligner.fit_transform(low_df, datetime_col="date", target_col="y") # has "date" + "y_disaggregated"
To get the prior values-only DataFrame (no date column), use return_dataframe=False. The manual date expansion is still available as an advanced/optional path:
# Advanced: manual date attachment (or for custom week_start etc.)
low_dates = low_df["date"]
high = aligner.fit_transform(low_df, datetime_col="date", target_col="y", return_dataframe=False)
high = high.with_columns(aligner.expand_high_freq_dates(low_dates).alias("date"))
Limitations (as of 1.10.0)
- Date expansion uses the same calendar-aware logic as
expand_high_freq_dates(now attached by default onfit_transform). - Uncertainty is a simple bootstrap and can be noisy or near-zero.
- All listed methods are fully implemented, produce distinct results, respond to indicators/ρ where applicable, and satisfy the aggregation constraint. (Denton uses quadratic penalty on first/second differences; Chow-Lin family uses GLS with AR(1) or IAR(1) errors.)
- Only regular frequency ratios are supported.
See the CHANGELOG for the full list of recent robustness and correctness fixes.
- Negative post-correction + NNLS ensemble
- sktime / statsforecast compatible wrapper
# Hierarchical
rec = aligner.reconcile_hierarchical([nat_df, reg_df])
# Uncertainty
mean, std = aligner.predict_with_uncertainty() # real std when uncertainty was requested in disagg (otherwise near-zero)
# Lazy + xarray
lazy_high = aligner.fit_transform(lazy_df)
xa = aligner.to_xarray(high_df)
See examples/quickstart.py for complete gallery.
Benchmarks
benchmarks/bench_disagg.py runs a deterministic, closed-form benchmark comparing disaggregate_columns (the convenient multi-series wrapper) against an equivalent hand-written per-series loop using fit_transform.
Because disaggregate_columns internally loops over columns (calling the same core per series), the overhead is negligible — the wrapper costs you essentially nothing while providing shared configuration, semantics handling, etc.
Example run (this hardware):
aggdisagg 1.10 multi-series benchmark (disaggregate_columns vectorized vs per-series naive)
Python 3.12.13, polars 1.42.1
Platform: macOS-26.3.1-arm64-arm-64bit
| N | n_low | method | vec_ms | naive_ms | speedup | note |
| --- | --- | --- | --- | --- | --- | --- |
| 20 | 12 | uniform | 6.4 | 5.4 | 0.9x | |
| 20 | 12 | linear | 6.4 | 5.7 | 0.9x | |
| 20 | 12 | denton | 17.6 | 15.8 | 0.9x | quad |
| 20 | 12 | chow-lin-opt | 318.4 | 303.8 | 1.0x | rho opt |
| 100 | 12 | uniform | 28.8 | 27.2 | 0.9x | |
| 100 | 12 | linear | 29.8 | 29.0 | 1.0x | |
| 100 | 12 | denton | 78.6 | 76.7 | 1.0x | quad |
| 100 | 12 | chow-lin-opt | 1530.2 | 1508.1 | 1.0x | rho opt |
Re-run python benchmarks/bench_disagg.py to refresh on your hardware. The numbers show the expected ~1.0× (no multi-series vectorization magic across columns; the convenience layer adds negligible cost). Note that chow-lin-opt is slower by design (ρ optimization) and denton due to the quadratic solve.
Development & Publishing
uv sync --all-extras
uv run pytest
uv run python examples/quickstart.py
uv build
# twine or uv publish
License
MIT
Built for data scientists who want temporal frequency conversion that just works.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file aggdisagg-1.10.1.tar.gz.
File metadata
- Download URL: aggdisagg-1.10.1.tar.gz
- Upload date:
- Size: 96.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
14ad6bf2e0d866e104a1dfa58dfc1a8e8038c6869b51f2f3e81dc525abd36e79
|
|
| MD5 |
74fef8b4e48002c2ae130b3a0ca1a267
|
|
| BLAKE2b-256 |
f85113964bd7ab0464a752eee03cc9a85a428da6ae664e2569f2b1272f1b7a2f
|
Provenance
The following attestation bundles were made for aggdisagg-1.10.1.tar.gz:
Publisher:
publish.yml on southu/aggdisagg
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
aggdisagg-1.10.1.tar.gz -
Subject digest:
14ad6bf2e0d866e104a1dfa58dfc1a8e8038c6869b51f2f3e81dc525abd36e79 - Sigstore transparency entry: 2117016978
- Sigstore integration time:
-
Permalink:
southu/aggdisagg@12711085fa2e5dd8c20c849aaeb262169a4fcd87 -
Branch / Tag:
refs/tags/v1.10.1 - Owner: https://github.com/southu
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@12711085fa2e5dd8c20c849aaeb262169a4fcd87 -
Trigger Event:
release
-
Statement type:
File details
Details for the file aggdisagg-1.10.1-py3-none-any.whl.
File metadata
- Download URL: aggdisagg-1.10.1-py3-none-any.whl
- Upload date:
- Size: 36.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eae44527fed9bd1ab7964e88da9eb87638d86c043e203900a40b2695a6266ca8
|
|
| MD5 |
487a6362a103ab794366f6f416c48a0e
|
|
| BLAKE2b-256 |
e40138c8f682c6d5e25c9fb5ea4dcce1f9fa29a4ce87753f435bc4763bb4cdf9
|
Provenance
The following attestation bundles were made for aggdisagg-1.10.1-py3-none-any.whl:
Publisher:
publish.yml on southu/aggdisagg
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
aggdisagg-1.10.1-py3-none-any.whl -
Subject digest:
eae44527fed9bd1ab7964e88da9eb87638d86c043e203900a40b2695a6266ca8 - Sigstore transparency entry: 2117017055
- Sigstore integration time:
-
Permalink:
southu/aggdisagg@12711085fa2e5dd8c20c849aaeb262169a4fcd87 -
Branch / Tag:
refs/tags/v1.10.1 - Owner: https://github.com/southu
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@12711085fa2e5dd8c20c849aaeb262169a4fcd87 -
Trigger Event:
release
-
Statement type: