lidb

lidb is a lightweight quant data processing library (Light Database for Quantor), providing dataset management with dependency tracking, topological scheduling, and partitioned parquet storage.

Features

  • Dataset management with dependency tracking and automatic backfill
  • Topological DAG scheduler — dependency graph → layer-parallel execution
  • Full-cache fast path — scan-only when all dates cached, skip scheduler
  • @dataset() decorator — convert functions to Dataset objects
  • Hive-style partition storage (date=xxx/asset=xxx/data.parquet)
  • Expression engine (QDF) for factor computation

Installation

# PyPI（发布版本）
pip install lidb

# GitHub（最新开发版本）
pip install -e "lidb @ git+ssh://git@github.com/link-yundi/lidb.git"

Documentation

See API Documentation for detailed usage.

Quick Start

import lidb
import polars as pl

# Define a dataset via @dataset() decorator
@lidb.dataset(update_time="15:00:00")
def my_dataset(date: str):
    return pl.DataFrame(
        {"date": [date], "time": ["15:00:00"], "asset": ["000001"], "value": [1.0]}
    )

# Get data
data = my_dataset.get_value("2024-01-01")

# Load datasets into a new Zoo workspace
zoo = lidb.load(
    beg_date="2024-01-01",
    end_date="2024-01-31",
    times=["15:00:00"],
    ds_list=[my_dataset],
)

License

MIT License

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2026.9.3.0)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for yundi from gravatar.com yundi

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lidb-2026.7.17.0.tar.gz (328.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lidb-2026.7.17.0-py3-none-any.whl (62.2 kB view details)

Uploaded Python 3

File details

Details for the file lidb-2026.7.17.0.tar.gz.

File metadata

  • Download URL: lidb-2026.7.17.0.tar.gz
  • Upload date:
  • Size: 328.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.17.0.tar.gz
Algorithm Hash digest
SHA256 8d6d5ba7903f3a340eb40dc12422423c0ff5b7997271a5dda816d7235ac72fd2
MD5 557c6294c8f7e747fea01e046effaf33
BLAKE2b-256 3e18c3bf023f1efd3e4e94fbe4e9fce6db6ee2188e8959a214beea8ff5c67703

See more details on using hashes here.

File details

Details for the file lidb-2026.7.17.0-py3-none-any.whl.

File metadata

  • Download URL: lidb-2026.7.17.0-py3-none-any.whl
  • Upload date:
  • Size: 62.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.21

File hashes

Hashes for lidb-2026.7.17.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7aefdeea4845be218b46001b8226e874cbf5b1b43d3c0a073e69e91e81c0fb77
MD5 037abe5af80221888f747ccb8ca73de6
BLAKE2b-256 52b8914562ec0fb9f91d52e58f4f41eb3a1e8198f942aee9b8a4cb15019f16bd

See more details on using hashes here.

Release history Release notifications | RSS feed

2026.9.3.0

2 files

2026.7.31.3

2 files

2026.7.31.2

2 files

2026.7.31.1

2 files

2026.7.31.0

2 files

2026.7.30.0

2 files

2026.7.28.0

2 files

This release

2026.7.17.0 This release

2 files

2026.7.15.2

2 files

2026.7.15.1

2 files

2026.7.15.0

2 files

2026.7.13.1

2 files

2026.7.12.0

2 files

2026.7.8.0

2 files

2026.5.14.16

2 files

2026.5.13.2

2 files

3.0.0

2 files

2.3.7.4

2 files

2.3.7.3

2 files

2.3.7.2

2 files

2.3.7.1

2 files

2.3.7

2 files

2.3.6

2 files

2.3.5

2 files

2.3.2

2 files

2.3.1

2 files

2.3.0

2 files

2.2.6

2 files

2.2.5

2 files

2.2.4

2 files

2.2.3

2 files

2.2.2

2 files

2.2.1

2 files

2.2.0

2 files

2.1.17

2 files

2.1.16

2 files

2.1.15

2 files

2.1.14

2 files

2.1.13

2 files

2.1.12

2 files

2.1.11

2 files

2.1.10

2 files

2.1.9

2 files

2.1.8

2 files

2.1.7

2 files

2.1.6

2 files

2.1.5

2 files

2.1.4

2 files

2.1.3

2 files

2.1.2

2 files

2.1.0

2 files

2.0.20

2 files

2.0.19

2 files

2.0.18

2 files

2.0.17

2 files

2.0.16

2 files

2.0.15

2 files

2.0.14

2 files

2.0.13

2 files

2.0.12

2 files

2.0.11

2 files

2.0.10

2 files

2.0.9

2 files

2.0.8

2 files

2.0.7

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2.0

2 files

1.1.22

2 files

1.1.21

2 files

1.1.20

2 files

1.1.19

2 files

1.1.18

2 files

1.1.17

2 files

1.1.16

2 files

1.1.15

2 files

1.1.14

2 files

1.1.13

2 files

1.1.12

2 files

1.1.11

2 files

1.1.10

2 files

1.1.9

2 files

1.1.8

2 files

1.1.7

2 files

1.1.6

2 files

1.1.5

2 files

1.1.4

2 files

1.1.3

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.10

2 files

1.0.9

2 files

1.0.8

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page