Skip to main content

Python reader/writer for the Lastra columnar time series format. Bit-exact compatible with QTSurfer/lastra-java + lastra-ts.

Project description

Lastra

CI PyPI License

Python reader/writer for the Lastra columnar time series format.
Bit-exact compatibility with lastra-java and lastra-ts.


Status

Reader and writer feature-complete, aligned with lastra-java. Wire-format spec lives in FORMAT.md. See the PyPI badge above for the latest version.

Install

pip install lastra

Usage

from lastra import LastraReader

with open("ohlcv.lastra", "rb") as f:
    r = LastraReader.from_stream(f)

    # Read only what you need — other columns are not decompressed
    ts = r.read_series_long("ts")        # numpy int64 array
    close = r.read_series_double("close") # numpy float64 array

    # Column metadata
    meta = r.get_series_column("ema1").metadata
    # {"indicator": "ema", "periods": "10"}

    # Events (independent timestamps)
    sig_ts = r.read_event_long("ts")
    sig_data = r.read_event_binary("data")  # list[bytes | None]

Pandas / Polars / Arrow adapters (planned for 0.9):

df = LastraReader(f).to_pandas()      # all series columns
pl_df = LastraReader(f).to_polars()
table = LastraReader(f).to_arrow()

Why Lastra

Lastra is a columnar file format optimised for numeric time series — financial tick data, IoT sensors, infrastructure metrics. It applies semantic compression per column:

  • ALP: decimal-aware → ~3-4 bits/value for prices at 2 decimal places
  • Pongo: decimal erasure + Gorilla XOR → ~18 bits/value
  • Gorilla: XOR for volatile metrics
  • DELTA_VARINT: ~1 byte/value for regular timestamps

A typical OHLCV column at 2 decimal places compresses to ~13× the raw size — about 2× better than Apache Parquet (SNAPPY) or ORC for the same data. See the lastra-java README for benchmarks.

Reference implementations

Language Repo Status
Java QTSurfer/lastra-java Reference (writer + reader)
TypeScript QTSurfer/lastra-ts Reader feature-complete
Python QTSurfer/lastra-py This repo

Conversion to/from Parquet, CSV, Arrow

See QTSurfer/lastra-convert-py — Python CLI port of the QTSurfer/lastra-convert (Java) tool.

License

Copyright 2026 Wualabs LTD. Apache License 2.0 — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lastra-0.8.3.tar.gz (44.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lastra-0.8.3-py3-none-any.whl (34.7 kB view details)

Uploaded Python 3

File details

Details for the file lastra-0.8.3.tar.gz.

File metadata

  • Download URL: lastra-0.8.3.tar.gz
  • Upload date:
  • Size: 44.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for lastra-0.8.3.tar.gz
Algorithm Hash digest
SHA256 4a9ef51631df752ccce52a93015307b5c6f02dbda987b54f3759f8eb7df6b92d
MD5 b02357e02097c748c1ec8e7e123dc5e6
BLAKE2b-256 3887fc27963226f6a2bb7e49661c006a0c83f79c2eff7a70bf60e993133d6780

See more details on using hashes here.

Provenance

The following attestation bundles were made for lastra-0.8.3.tar.gz:

Publisher: release.yml on QTSurfer/lastra-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lastra-0.8.3-py3-none-any.whl.

File metadata

  • Download URL: lastra-0.8.3-py3-none-any.whl
  • Upload date:
  • Size: 34.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for lastra-0.8.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b71cbdc5a696a475e27878ae3c08d896d6c638e8e96b9d4d42d5b86ceed23d33
MD5 e240076cd98786f2cdab6807b37c4bee
BLAKE2b-256 b859e6210385a1b857be21d43ed2b4e4702eadff4107ed84c349c25474a03dfc

See more details on using hashes here.

Provenance

The following attestation bundles were made for lastra-0.8.3-py3-none-any.whl:

Publisher: release.yml on QTSurfer/lastra-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page