lidb

lidb is a lightweight quant data processing library (Light Database for Quantor), providing dataset management with dependency tracking, topological scheduling, and partitioned parquet storage.

Features

  • Dataset management with dependency tracking and automatic backfill
  • Topological DAG scheduler — dependency graph → layer-parallel execution
  • Full-cache fast path — scan-only when all dates cached, skip scheduler
  • @dataset() decorator — convert functions to Dataset objects
  • Hive-style partition storage (date=xxx/asset=xxx/data.parquet)
  • Expression engine (QDF) for factor computation

Installation

# PyPI（发布版本）
pip install lidb

# GitHub（最新开发版本）
pip install -e "lidb @ git+ssh://git@github.com/link-yundi/lidb.git"

Documentation

See API Documentation for detailed usage.

Quick Start

import lidb
import polars as pl

# Define a dataset via @dataset() decorator
@lidb.dataset(update_time="15:00:00")
def my_dataset(date: str):
    return pl.DataFrame(
        {"date": [date], "time": ["15:00:00"], "asset": ["000001"], "value": [1.0]}
    )

# Get data
data = my_dataset.get_value("2024-01-01")

# Load datasets into a new Zoo workspace
zoo = lidb.load(
    beg_date="2024-01-01",
    end_date="2024-01-31",
    times=["15:00:00"],
    ds_list=[my_dataset],
)

License

MIT License

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Metadata

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Release files for lidb 2026.9.15.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lidb 2026.9.15.0
File Size Uploaded
lidb-2026.9.15.0.tar.gz 352.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for lidb 2026.9.15.0
File Interpreter ABI Platform
lidb-2026.9.15.0-py3-none-any.whl 67.8 kB Python 3 none any Details

Total release size: 419.9 kB

Release files / lidb-2026.9.15.0.tar.gz

Download URL lidb-2026.9.15.0.tar.gz
Size 352.1 kB
Tags Source
SHA-256 checksum
How to use checksums 		d24b4d7e67317f72c51f85cbe3b9e832f8559294ff388107e44d68584a3512ec
BLAKE2b-256 checksum
How to use checksums 		dce10c2386d22feab3cb47782ed7e54961bdcea805a6a16b292c74b4d95ca20c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via uv/0.7.21

Release files / lidb-2026.9.15.0-py3-none-any.whl

Download URL lidb-2026.9.15.0-py3-none-any.whl
Size 67.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums 		7277f2aa535e6d07444c4ce2cf96675b7ed37f214382a82994d2aa981ded7360
BLAKE2b-256 checksum
How to use checksums 		4070b8a81ea5fdde184e0ee0fcd8049b89a4cde2bf5919dff99628de670357cd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via uv/0.7.21

Release history Release notifications | RSS feed

This release

2026.9.15.0 This release

2 release files

2026.9.3.0

2 release files

2026.7.31.3

2 release files

2026.7.31.2

2 release files

2026.7.31.1

2 release files

2026.7.31.0

2 release files

2026.7.30.0

2 release files

2026.7.28.0

2 release files

2026.7.17.0

2 release files

2026.7.15.2

2 release files

2026.7.15.1

2 release files

2026.7.15.0

2 release files

2026.7.13.1

2 release files

2026.7.12.0

2 release files

2026.7.8.0

2 release files

2026.5.14.16

2 release files

2026.5.13.2

2 release files

3.0.0

2 release files

2.3.7.4

2 release files

2.3.7.3

2 release files

2.3.7.2

2 release files

2.3.7.1

2 release files

2.3.7

2 release files

2.3.6

2 release files

2.3.5

2 release files

2.3.2

2 release files

2.3.1

2 release files

2.3.0

2 release files

2.2.6

2 release files

2.2.5

2 release files

2.2.4

2 release files

2.2.3

2 release files

2.2.2

2 release files

2.2.1

2 release files

2.2.0

2 release files

2.1.17

2 release files

2.1.16

2 release files

2.1.15

2 release files

2.1.14

2 release files

2.1.13

2 release files

2.1.12

2 release files

2.1.11

2 release files

2.1.10

2 release files

2.1.9

2 release files

2.1.8

2 release files

2.1.7

2 release files

2.1.6

2 release files

2.1.5

2 release files

2.1.4

2 release files

2.1.3

2 release files

2.1.2

2 release files

2.1.0

2 release files

2.0.20

2 release files

2.0.19

2 release files

2.0.18

2 release files

2.0.17

2 release files

2.0.16

2 release files

2.0.15

2 release files

2.0.14

2 release files

2.0.13

2 release files

2.0.12

2 release files

2.0.11

2 release files

2.0.10

2 release files

2.0.9

2 release files

2.0.8

2 release files

2.0.7

2 release files

2.0.6

2 release files

2.0.5

2 release files

2.0.4

2 release files

2.0.3

2 release files

2.0.2

2 release files

2.0.1

2 release files

2.0.0

2 release files

1.3.6

2 release files

1.3.5

2 release files

1.3.4

2 release files

1.3.3

2 release files

1.3.2

2 release files

1.3.1

2 release files

1.3.0

2 release files

1.2.22

2 release files

1.2.21

2 release files

1.2.20

2 release files

1.2.19

2 release files

1.2.18

2 release files

1.2.17

2 release files

1.2.16

2 release files

1.2.15

2 release files

1.2.14

2 release files

1.2.13

2 release files

1.2.12

2 release files

1.2.11

2 release files

1.2.10

2 release files

1.2.9

2 release files

1.2.8

2 release files

1.2.7

2 release files

1.2.6

2 release files

1.2.5

2 release files

1.2.4

2 release files

1.2.3

2 release files

1.2.2

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.22

2 release files

1.1.21

2 release files

1.1.20

2 release files

1.1.19

2 release files

1.1.18

2 release files

1.1.17

2 release files

1.1.16

2 release files

1.1.15

2 release files

1.1.14

2 release files

1.1.13

2 release files

1.1.12

2 release files

1.1.11

2 release files

1.1.10

2 release files

1.1.9

2 release files

1.1.8

2 release files

1.1.7

2 release files

1.1.6

2 release files

1.1.5

2 release files

1.1.4

2 release files

1.1.3

2 release files

1.1.2

2 release files

1.1.1

2 release files

1.1.0

2 release files

1.0.10

2 release files

1.0.9

2 release files

1.0.8

2 release files

1.0.7

2 release files

1.0.6

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page