Skip to main content

TS-ICL: A Flexible Time-Index Foundation Model for Time Series via In-Context Learning

Project description

TS-ICL architecture

TS-ICL: a Time-Indexed Foundation Model for Time Series Forecasting & Imputation via In-Context Learning

arXiv PyPI Python

Paper: TS-ICL: A Flexible Time-Indexed Foundation Model for Time Series via In-Context Learning

TS-ICL is a continuous probabilistic Time Series Foundation Model (TSFM) that unifies forecasting and imputation in a single zero-shot architecture, requiring no task-specific training or fine-tuning.

TS-ICL architecture

Installation

pip install tsicl

Model checkpoint can be found on TS-ICL's Huggingface repo.

Requirements: Python ≥ 3.12, PyTorch ≥ 2.5.1


Quick Start

from tsicl import TSICL

model = TSICL(model_path="checkpoints/tsicl-v1.ckpt")

# Forecasting — predict the next 96 timesteps
point, quantiles = model.forecast(
    inputs            = my_series,        # e.g. 1-D numpy array or tensor
    prediction_length = 96,
    quantile_levels   = [0.1, 0.5, 0.9],
    denormalize       = True
)

# Imputation — reconstruct NaN values
point, quantiles = model.impute(
    inputs          = my_series_with_nans,
    quantile_levels = [0.1, 0.5, 0.9],
    denormalize     = True
)

Both methods return a (point_prediction, quantile_predictions) tuple. NaN values are handled natively — no preprocessing required.


Notebooks

Step-by-step tutorials on synthetic Gaussian Processes:

Notebook Description
get_started_imputation.ipynb Pointwise & block missingness, covariate-aware imputation, output format, batch processing
get_started_forecasting.ipynb Univariate forecasting, partially observed look-back, covariate-aware forecasting, batch processing

Model

TS-ICL processes each time series through four successive modules:

  1. Time Series Encoder — a Perceiver-like architecture that compresses observed (timestamp, value) pairs into M = 32 learnable latent tokens via cross-attention. Accepts inputs of arbitrary length without preprocessing.
  2. Channel Mixer — aggregates information across channels via cross-attention. Selectively integrates covariate representations into the target's representation when covariates are provided.
  3. Temporal Context Query Module — maps any query timestamp to a context-aware embedding using Fourier (NeRF-style) positional encoding. Enables prediction at arbitrary timestamps, including on irregular grids.
  4. In-Context Regressor — a causal Transformer that reads observed (representation, value) pairs as in-context training examples and outputs 99 quantiles at the queried timestamps.

A single checkpoint (tsicl-v1.ckpt) contains two specialised components — one trained with masking for imputation, one with causal masking for forecasting — sharing the same architecture backbone.


Performance

Forecasting — fev-bench

TS-ICL is highly competitive with the best forecasting foundation models, while being fast at inference. TS-ICL efficently leverages covariate (when relevant) and is also robust to sparse look-back windows.

fev-bench results

Example — pointwise forecast with a known covariate (GFC17 dataset):

Forecast with covariate example

Forecasting — TIME benchmark

TIME benchmark results

Imputation — fm-impute-bench

TS-ICL achieves state-of-the-art imputation across 132 univariate and 24 covariate-aware tasks, outperforming the best tabular foundation model baseline while being ~50× faster at inference.

fm-impute-bench results

Example — block imputation with uncertainty quantification (COVID-19 energy dataset):

Block imputation with uncertainty quantification example

Citation

If you use TS-ICL for research purposes, please consider citing the associated paper:

@article{lenaour2026tsicl,
  title={TS-ICL: A Flexible Time-Indexed Foundation Model for Time Series via In-Context Learning},
  author={Le Naour, Etienne and Nabil, Tahar and Petralia, Adrien},
  journal={arXiv preprint arXiv:2606.05878},
  year={2026}
}

Contributors


License

TS-ICL weights and code are released under a non-commercial license, see LICENSE.

Contact

To learn more or request a commercial license, please contact us at: tsicl-contact_at_edf.fr (replace _at_ with @).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tsicl-0.1.0.tar.gz (55.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tsicl-0.1.0-py3-none-any.whl (75.9 kB view details)

Uploaded Python 3

File details

Details for the file tsicl-0.1.0.tar.gz.

File metadata

  • Download URL: tsicl-0.1.0.tar.gz
  • Upload date:
  • Size: 55.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.2

File hashes

Hashes for tsicl-0.1.0.tar.gz
Algorithm Hash digest
SHA256 4d0470b06df983dcf45d2b436127b0fefd454d8b8823bdbe73345ae241b8ebec
MD5 624ed4a4ce6fa503ddc10feeab45d6f0
BLAKE2b-256 a3eb9abcc954dd0f4915496011172f14ee667de111d09f7b7714377c8754db49

See more details on using hashes here.

File details

Details for the file tsicl-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: tsicl-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 75.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.2

File hashes

Hashes for tsicl-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 23bd91e23000f139e81f4f1f7e582b7f8c050b974332812b935510404e58b5cd
MD5 47aac5cca50b0a1c1a1c9cd0188c740c
BLAKE2b-256 21ebeacd4d729d609518060959411c8218e71b483715e140dcff41278d059827

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page