lidb

lidb is a lightweight quant data processing library (Light Database for Quantor), providing dataset management with dependency tracking, topological scheduling, and partitioned parquet storage.

Features

  • Dataset management with dependency tracking and automatic backfill
  • Topological DAG scheduler — dependency graph → layer-parallel execution
  • Full-cache fast path — scan-only when all dates cached, skip scheduler
  • @dataset() decorator — convert functions to Dataset objects
  • Hive-style partition storage (date=xxx/asset=xxx/data.parquet)
  • Expression engine (QDF) for factor computation

Installation

# PyPI（发布版本）
pip install lidb

# GitHub（最新开发版本）
pip install -e "lidb @ git+ssh://git@github.com/link-yundi/lidb.git"

Documentation

See API Documentation for detailed usage.

Quick Start

import lidb
import polars as pl

# Define a dataset via @dataset() decorator
@lidb.dataset(update_time="15:00:00")
def my_dataset(date: str):
    return pl.DataFrame(
        {"date": [date], "time": ["15:00:00"], "asset": ["000001"], "value": [1.0]}
    )

# Get data
data = my_dataset.get_value("2024-01-01")

# Load datasets into a new Zoo workspace
zoo = lidb.load(
    beg_date="2024-01-01",
    end_date="2024-01-31",
    times=["15:00:00"],
    ds_list=[my_dataset],
)

License

MIT License

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2026.9.3.0)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lidb-2026.7.15.1.tar.gz (358.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lidb-2026.7.15.1-py3-none-any.whl (370.5 kB view details)

Uploaded Python 3

File details

Details for the file lidb-2026.7.15.1.tar.gz.

File metadata

  • Download URL: lidb-2026.7.15.1.tar.gz
  • Upload date:
  • Size: 358.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.15.1.tar.gz
Algorithm Hash digest
SHA256 5f9b21fec74843f70434f3098a2cb643e516535e368a21b598af7c75337b4d8f
MD5 51653ecb0dc443ad72eeac12a33832bc
BLAKE2b-256 899acf3f875b08b4b804f5326c3eaaa9d97e4a7d9d0d34e5f82bded2bc6bdb38

See more details on using hashes here.

File details

Details for the file lidb-2026.7.15.1-py3-none-any.whl.

File metadata

  • Download URL: lidb-2026.7.15.1-py3-none-any.whl
  • Upload date:
  • Size: 370.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.15.1-py3-none-any.whl
Algorithm Hash digest
SHA256 eeefe6b65d8159f90de13f1d95fbcd69934bdc7ea4ec1a25f9c687ed18759f95
MD5 2dbc56780af8589acf888797bc285cc5
BLAKE2b-256 832e487e1058f1057bbbb5bbd49d0c17958ae97a1d88f4ab0441e4cc9b3de8c5

See more details on using hashes here.

Release history Release notifications | RSS feed

2026.9.3.0

2 files

2026.7.31.3

2 files

2026.7.31.2

2 files

2026.7.31.1

2 files

2026.7.31.0

2 files

2026.7.30.0

2 files

2026.7.28.0

2 files

2026.7.17.0

2 files

2026.7.15.2

2 files

This release

2026.7.15.1 This release

2 files

2026.7.15.0

2 files

2026.7.13.1

2 files

2026.7.12.0

2 files

2026.7.8.0

2 files

2026.5.14.16

2 files

2026.5.13.2

2 files

3.0.0

2 files

2.3.7.4

2 files

2.3.7.3

2 files

2.3.7.2

2 files

2.3.7.1

2 files

2.3.7

2 files

2.3.6

2 files

2.3.5

2 files

2.3.2

2 files

2.3.1

2 files

2.3.0

2 files

2.2.6

2 files

2.2.5

2 files

2.2.4

2 files

2.2.3

2 files

2.2.2

2 files

2.2.1

2 files

2.2.0

2 files

2.1.17

2 files

2.1.16

2 files

2.1.15

2 files

2.1.14

2 files

2.1.13

2 files

2.1.12

2 files

2.1.11

2 files

2.1.10

2 files

2.1.9

2 files

2.1.8

2 files

2.1.7

2 files

2.1.6

2 files

2.1.5

2 files

2.1.4

2 files

2.1.3

2 files

2.1.2

2 files

2.1.0

2 files

2.0.20

2 files

2.0.19

2 files

2.0.18

2 files

2.0.17

2 files

2.0.16

2 files

2.0.15

2 files

2.0.14

2 files

2.0.13

2 files

2.0.12

2 files

2.0.11

2 files

2.0.10

2 files

2.0.9

2 files

2.0.8

2 files

2.0.7

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2.0

2 files

1.1.22

2 files

1.1.21

2 files

1.1.20

2 files

1.1.19

2 files

1.1.18

2 files

1.1.17

2 files

1.1.16

2 files

1.1.15

2 files

1.1.14

2 files

1.1.13

2 files

1.1.12

2 files

1.1.11

2 files

1.1.10

2 files

1.1.9

2 files

1.1.8

2 files

1.1.7

2 files

1.1.6

2 files

1.1.5

2 files

1.1.4

2 files

1.1.3

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.10

2 files

1.0.9

2 files

1.0.8

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page