lidb

lidb is a lightweight quant data processing library (Light Database for Quantor), providing dataset management with dependency tracking, topological scheduling, and partitioned parquet storage.

Features

  • Dataset management with dependency tracking and automatic backfill
  • Topological DAG scheduler — dependency graph → layer-parallel execution
  • Full-cache fast path — scan-only when all dates cached, skip scheduler
  • @dataset() decorator — convert functions to Dataset objects
  • Hive-style partition storage (date=xxx/asset=xxx/data.parquet)
  • Expression engine (QDF) for factor computation

Installation

# PyPI（发布版本）
pip install lidb

# GitHub（最新开发版本）
pip install -e "lidb @ git+ssh://git@github.com/link-yundi/lidb.git"

Documentation

See API Documentation for detailed usage.

Quick Start

import lidb
import polars as pl

# Define a dataset via @dataset() decorator
@lidb.dataset(update_time="15:00:00")
def my_dataset(date: str):
    return pl.DataFrame(
        {"date": [date], "time": ["15:00:00"], "asset": ["000001"], "value": [1.0]}
    )

# Get data
data = my_dataset.get_value("2024-01-01")

# Load datasets into a new Zoo workspace
zoo = lidb.load(
    beg_date="2024-01-01",
    end_date="2024-01-31",
    times=["15:00:00"],
    ds_list=[my_dataset],
)

License

MIT License

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2026.9.3.0)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lidb-2026.7.31.0.tar.gz (332.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lidb-2026.7.31.0-py3-none-any.whl (63.2 kB view details)

Uploaded Python 3

File details

Details for the file lidb-2026.7.31.0.tar.gz.

File metadata

  • Download URL: lidb-2026.7.31.0.tar.gz
  • Upload date:
  • Size: 332.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.31.0.tar.gz
Algorithm Hash digest
SHA256 08aa4eacb07bfcf9942301ba7e4f0905642c8b3733c0e090ec49975657131437
MD5 f4d5982c75d4feed1c687f20049db01b
BLAKE2b-256 24d5e2a06989da1feb04f8c69aa465d8863bd1ef0fd5b1dc3cce183e26079818

See more details on using hashes here.

File details

Details for the file lidb-2026.7.31.0-py3-none-any.whl.

File metadata

  • Download URL: lidb-2026.7.31.0-py3-none-any.whl
  • Upload date:
  • Size: 63.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.31.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3b03f1d495099bf21e8f8350a97fba60c3e5e75af69342742c0b0d858cd91c80
MD5 4022f7f87bc1fed1081c8cb0124ac6ae
BLAKE2b-256 83d6bef61de99f7e1f47291a523fa57d9576f71b95eef5edf9e89a5247342e63

See more details on using hashes here.

Release history Release notifications | RSS feed

2026.9.3.0

2 files

2026.7.31.3

2 files

2026.7.31.2

2 files

2026.7.31.1

2 files

This release

2026.7.31.0 This release

2 files

2026.7.30.0

2 files

2026.7.28.0

2 files

2026.7.17.0

2 files

2026.7.15.2

2 files

2026.7.15.1

2 files

2026.7.15.0

2 files

2026.7.13.1

2 files

2026.7.12.0

2 files

2026.7.8.0

2 files

2026.5.14.16

2 files

2026.5.13.2

2 files

3.0.0

2 files

2.3.7.4

2 files

2.3.7.3

2 files

2.3.7.2

2 files

2.3.7.1

2 files

2.3.7

2 files

2.3.6

2 files

2.3.5

2 files

2.3.2

2 files

2.3.1

2 files

2.3.0

2 files

2.2.6

2 files

2.2.5

2 files

2.2.4

2 files

2.2.3

2 files

2.2.2

2 files

2.2.1

2 files

2.2.0

2 files

2.1.17

2 files

2.1.16

2 files

2.1.15

2 files

2.1.14

2 files

2.1.13

2 files

2.1.12

2 files

2.1.11

2 files

2.1.10

2 files

2.1.9

2 files

2.1.8

2 files

2.1.7

2 files

2.1.6

2 files

2.1.5

2 files

2.1.4

2 files

2.1.3

2 files

2.1.2

2 files

2.1.0

2 files

2.0.20

2 files

2.0.19

2 files

2.0.18

2 files

2.0.17

2 files

2.0.16

2 files

2.0.15

2 files

2.0.14

2 files

2.0.13

2 files

2.0.12

2 files

2.0.11

2 files

2.0.10

2 files

2.0.9

2 files

2.0.8

2 files

2.0.7

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2.0

2 files

1.1.22

2 files

1.1.21

2 files

1.1.20

2 files

1.1.19

2 files

1.1.18

2 files

1.1.17

2 files

1.1.16

2 files

1.1.15

2 files

1.1.14

2 files

1.1.13

2 files

1.1.12

2 files

1.1.11

2 files

1.1.10

2 files

1.1.9

2 files

1.1.8

2 files

1.1.7

2 files

1.1.6

2 files

1.1.5

2 files

1.1.4

2 files

1.1.3

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.10

2 files

1.0.9

2 files

1.0.8

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page