lidb

lidb is a lightweight quant data processing library (Light Database for Quantor), providing dataset management with dependency tracking, topological scheduling, and partitioned parquet storage.

Features

  • Dataset management with dependency tracking and automatic backfill
  • Topological DAG scheduler — dependency graph → layer-parallel execution
  • Full-cache fast path — scan-only when all dates cached, skip scheduler
  • @dataset() decorator — convert functions to Dataset objects
  • Hive-style partition storage (date=xxx/asset=xxx/data.parquet)
  • Expression engine (QDF) for factor computation

Installation

# PyPI（发布版本）
pip install lidb

# GitHub（最新开发版本）
pip install -e "lidb @ git+ssh://git@github.com/link-yundi/lidb.git"

Documentation

See API Documentation for detailed usage.

Quick Start

import lidb
import polars as pl

# Define a dataset via @dataset() decorator
@lidb.dataset(update_time="15:00:00")
def my_dataset(date: str):
    return pl.DataFrame(
        {"date": [date], "time": ["15:00:00"], "asset": ["000001"], "value": [1.0]}
    )

# Get data
data = my_dataset.get_value("2024-01-01")

# Load datasets into a new Zoo workspace
zoo = lidb.load(
    beg_date="2024-01-01",
    end_date="2024-01-31",
    times=["15:00:00"],
    ds_list=[my_dataset],
)

License

MIT License

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2026.9.3.0)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lidb-2026.7.30.0.tar.gz (332.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lidb-2026.7.30.0-py3-none-any.whl (63.1 kB view details)

Uploaded Python 3

File details

Details for the file lidb-2026.7.30.0.tar.gz.

File metadata

  • Download URL: lidb-2026.7.30.0.tar.gz
  • Upload date:
  • Size: 332.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.30.0.tar.gz
Algorithm Hash digest
SHA256 565b1c9c68b5ef3e0e9afe93c84360a2e795a1b05a3eb944027ac7a0e52e6074
MD5 75d104faf71475ec1f8b3c4a748e0cab
BLAKE2b-256 2ee805db765155673ddf8e3b63e568b0c9b8eb7717c462af12b41f49ac48444e

See more details on using hashes here.

File details

Details for the file lidb-2026.7.30.0-py3-none-any.whl.

File metadata

  • Download URL: lidb-2026.7.30.0-py3-none-any.whl
  • Upload date:
  • Size: 63.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.30.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b62cfd96bbf87fd4c47f8eca55bfd8c3a3f94246b7902b076f45b117a7bfa42d
MD5 05e183f9c1bef77bdcaca2552bb2ab7a
BLAKE2b-256 ad91fcceee3e300544f6dd9cb98e10d8e663a3dcdccbc7c2fe6756a15cd8f229

See more details on using hashes here.

Release history Release notifications | RSS feed

2026.9.3.0

2 files

2026.7.31.3

2 files

2026.7.31.2

2 files

2026.7.31.1

2 files

2026.7.31.0

2 files

This release

2026.7.30.0 This release

2 files

2026.7.28.0

2 files

2026.7.17.0

2 files

2026.7.15.2

2 files

2026.7.15.1

2 files

2026.7.15.0

2 files

2026.7.13.1

2 files

2026.7.12.0

2 files

2026.7.8.0

2 files

2026.5.14.16

2 files

2026.5.13.2

2 files

3.0.0

2 files

2.3.7.4

2 files

2.3.7.3

2 files

2.3.7.2

2 files

2.3.7.1

2 files

2.3.7

2 files

2.3.6

2 files

2.3.5

2 files

2.3.2

2 files

2.3.1

2 files

2.3.0

2 files

2.2.6

2 files

2.2.5

2 files

2.2.4

2 files

2.2.3

2 files

2.2.2

2 files

2.2.1

2 files

2.2.0

2 files

2.1.17

2 files

2.1.16

2 files

2.1.15

2 files

2.1.14

2 files

2.1.13

2 files

2.1.12

2 files

2.1.11

2 files

2.1.10

2 files

2.1.9

2 files

2.1.8

2 files

2.1.7

2 files

2.1.6

2 files

2.1.5

2 files

2.1.4

2 files

2.1.3

2 files

2.1.2

2 files

2.1.0

2 files

2.0.20

2 files

2.0.19

2 files

2.0.18

2 files

2.0.17

2 files

2.0.16

2 files

2.0.15

2 files

2.0.14

2 files

2.0.13

2 files

2.0.12

2 files

2.0.11

2 files

2.0.10

2 files

2.0.9

2 files

2.0.8

2 files

2.0.7

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2.0

2 files

1.1.22

2 files

1.1.21

2 files

1.1.20

2 files

1.1.19

2 files

1.1.18

2 files

1.1.17

2 files

1.1.16

2 files

1.1.15

2 files

1.1.14

2 files

1.1.13

2 files

1.1.12

2 files

1.1.11

2 files

1.1.10

2 files

1.1.9

2 files

1.1.8

2 files

1.1.7

2 files

1.1.6

2 files

1.1.5

2 files

1.1.4

2 files

1.1.3

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.10

2 files

1.0.9

2 files

1.0.8

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page