TDX (通达信) market data parser — Rust implementation with Python bindings
Project description
tdxrs — 通达信行情数据解析库 (Rust + Python)
tdxrs 是通达信 (TDX) 行情数据解析库的 Rust 高性能实现。通过 PyO3/maturin 提供 Python 调用接口,保持与 Python tdxpy 的 API 兼容,本地解析性能提升 9-11 倍。
from tdxrs import TdxHqClient
from tdxrs.constants import MARKET_SH, KLINE_DAILY, FQ_QFQ
client = TdxHqClient()
client.connect_to_any()
# 贵州茅台日K → DataFrame
df = client.get_security_bars_dataframe(KLINE_DAILY, MARKET_SH, "600519", 0, 500)
df["ma20"] = df["close"].rolling(20).mean()
# 批量实时行情
quotes = client.get_security_quotes([
(MARKET_SH, "600519"), (0, "000858"), (0, "300750")
])
性能
| 场景 | tdxrs (Rust) | tdxpy (Python) | 提升 |
|---|---|---|---|
| 日线解析 1000 条 | 0.3ms | 2.8ms | 9× |
| 分钟线解析 1000 条 | 0.5ms | 5.1ms | 10× |
| 板块解析 500 条 | 1.2ms | 12.0ms | 10× |
| 网络 K 线 100 条 | 73ms | 110ms | 1.5× |
| 网络行情 3 只 | 75ms | 95ms | 1.3× |
| 60 线程并发 K 线 | 344ms | — | 零退化 |
吞吐量 ~260 万条/秒。全市场 5000 只股票日线解析约 2 秒。详见 性能基准。
功能
网络行情 (13 类数据)
| 数据 | 覆盖 |
|---|---|
| K 线 | 个股 + 指数,12 种周期 (1分钟 ~ 年线) |
| 实时行情 | 五档盘口,含成交额/总量 |
| 分时数据 | 当日 + 历史 |
| 逐笔成交 | 当日 + 历史,含买卖方向 |
| 证券信息 | 全市场列表 + 数量 (带缓存) |
| 财务数据 | 实时 34 项 + 45 个英文命名财务指标 |
| 除权除息 | 分红/送股/配股/缩股历史 |
| 板块数据 | 行业/概念/地域分类 |
客户端侧复权计算
TDX 服务端返回未复权原始数据。tdxrs 在客户端自行计算前复权/后复权:
- 中国 A 股标准除权除息公式:
P_ex = (P_close - D + P_rights × R_rights) / (1 + R_bonus + R_rights) - 支持分红+送股+配股联动
- 自动补全早期除权事件 (context_bars 机制)
fq=0路径零额外开销
四种客户端方案
| 客户端 | 策略 | 场景 |
|---|---|---|
TdxHqClient |
连接池(5) + 心跳 + 重试 + 缓存 | 主力,顺序请求 |
TdxDirectClient |
每请求独立 TCP | 高并发 (60线程零退化) |
TdxFinanceClient |
独立超时(15s) + 磁盘缓存 | gpcw 大文件下载 |
AsyncTdxHqClient |
tokio 异步 | 异步生态集成 |
本地文件解析
| 格式 | Reader | 输出 |
|---|---|---|
.day 日线 |
DailyBarReader |
dict / tuple / DataFrame |
.lc5 .lc1 分钟线 |
MinBarReader LcMinBarReader |
同上 |
.dat 板块 |
BlockReader |
flat / group 两种模式 |
gpcw*.dat 财务 |
FinancialReader |
f32 字段数组 |
安装
pip install maturin
git clone https://github.com/jiangtaovan/tdxrs && cd tdxrs
maturin develop --release
Windows x86_64-pc-windows-gnu 需额外安装 MSYS2 dlltool。详见 安装说明。
快速示例
K 线 — 完整复权演示
from tdxrs import TdxHqClient
from tdxrs.constants import MARKET_SH, MARKET_SZ, KLINE_DAILY, KLINE_WEEKLY, FQ_QFQ, FQ_HFQ, FQ_NONE
client = TdxHqClient()
client.connect_to_any()
# 前复权 (默认)
bars = client.get_security_bars(KLINE_DAILY, MARKET_SH, "600519", 0, 100)
# 未复权原始数据
raw = client.get_security_bars(KLINE_DAILY, MARKET_SH, "600519", 0, 100, fq=FQ_NONE)
# 后复权
hfq = client.get_security_bars(KLINE_DAILY, MARKET_SH, "600519", 0, 100, fq=FQ_HFQ)
# 周K + 自动分页 (3000条)
all_bars = client.get_security_bars_all(KLINE_WEEKLY, MARKET_SH, "600519", count=3000)
# Tuple 高性能模式 (快 40-60%)
tuples = client.get_security_bars_tuples(KLINE_DAILY, MARKET_SH, "600519", 0, 500)
# → (open, close, high, low, vol, amount, year, month, day, hour, minute, datetime)
client.disconnect()
多股票批量财务
# 实时财务 (TDX 原始值, 不自动转换单位)
info = client.get_finance_info(market=1, code="600519")
# 经验规则: 股本类 ≈万元, 资产类 ≈万元, 每股指标 ≈元
print(f"净资产: {info['jingzichan']:.0f}") # e.g. 270894048 → 2709亿元
print(f"每股净资产: {info['meigujingzichan']:.2f}") # 216.32元
# 多股票对比 DataFrame
df = client.get_finance_info_dataframe([
(MARKET_SH, "600519"), (MARKET_SZ, "000858"), (MARKET_SZ, "300750")
])
print(df[["code", "jingzichan", "jinglirun", "meigujingzichan"]])
本地文件解析
from tdxrs import DailyBarReader
reader = DailyBarReader(coefficient=0.01)
df = reader.to_dataframe(open("600519.day", "rb").read())
# df.columns: date, open, high, low, close, amount, volume, year, month, day
工程亮点
语言: Rust 2021 edition, 0 行 unsafe
测试: 93 个单元/集成测试 (91 passed)
依赖: 6 个核心 crate (pyo3, flate2, tokio, serde, thiserror, encoding_rs)
文档: 12 篇维护文档 (6 public + 6 internal)
周期: 12 天, v0.1.0 → v0.5.1
架构
Python API ─── dict / tuple / DataFrame
│
Net 层 ─── Pool / Direct / Finance / Async 四个客户端
│ └── utils.rs 公共工具 (packet / handshake / decompress)
│
Protocol 层 ─── 13 个解析器 + 复权算法 + gpcw 字段映射
│
Reader 层 ─── 日线 / 分钟线 / 板块 / 财务
│
基础设施 ─── error / logging / helpers / constants
文档
| 文档 | 说明 |
|---|---|
| API 参考 | 完整 Python API + 最佳实践 |
| 架构说明 | 模块设计、数据流、客户端策略 |
| 性能基准 | 顺序/并发性能 + 场景选择指南 |
| 复权算法 | 公式推导、版本迭代、验证方法 |
| 变更日志 | 版本历史 |
| 贡献指南 | 参与开发 + 可贡献方向 |
| 安装说明 | 环境配置 + FAQ |
| 文件格式 | TDX 二进制格式参考 |
| 代码引用 | 模块依赖 + 变更影响矩阵 |
| 工程经验 | 可复用的开发方法论 |
要求
- Rust 1.83+ | Python 3.8+ | maturin 1.5+
- pandas (可选, DataFrame 输出)
许可证
MIT License — 详见 LICENSE
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tdxrs-0.5.0.tar.gz.
File metadata
- Download URL: tdxrs-0.5.0.tar.gz
- Upload date:
- Size: 71.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
96714442e27b99fbcdfb7a81e73541b5e1cbc91dff7a8fb2bc8f59ff0fb462bc
|
|
| MD5 |
55d868dcb19c6373a200bfcffe0e3687
|
|
| BLAKE2b-256 |
fbafd4f4f76b964cd943cdc17b3c33b04ee55758be566be5c784eedd1aaa3069
|
File details
Details for the file tdxrs-0.5.0-cp311-cp311-win_amd64.whl.
File metadata
- Download URL: tdxrs-0.5.0-cp311-cp311-win_amd64.whl
- Upload date:
- Size: 513.7 kB
- Tags: CPython 3.11, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
40e7789d387045a5af1475c550eeab842de8c09079209b5cf2d3a7696bcc78d6
|
|
| MD5 |
e03f473bb0c6f21ffa267b54be124b1b
|
|
| BLAKE2b-256 |
dc47dee221325df1acdaaa19c041f6d10936e97045d86fab19470c6cd1d96f63
|
File details
Details for the file tdxrs-0.5.0-cp311-cp311-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: tdxrs-0.5.0-cp311-cp311-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 612.0 kB
- Tags: CPython 3.11, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
159c5efa23c24c61eb96a2337764113bb30280d95c8c3bbdc62977f3f7e72f68
|
|
| MD5 |
2260c0b68ade78a39614df2c1c5cb3fa
|
|
| BLAKE2b-256 |
c745ad4d58f7886773a670451ea1348d22759d63c84f5441432389c829782742
|
File details
Details for the file tdxrs-0.5.0-cp311-cp311-macosx_11_0_arm64.whl.
File metadata
- Download URL: tdxrs-0.5.0-cp311-cp311-macosx_11_0_arm64.whl
- Upload date:
- Size: 571.2 kB
- Tags: CPython 3.11, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1aaa4625f901f410f0631effc93d5bb6c9bc511b0518064bb8511f4872673cbf
|
|
| MD5 |
f32e0c1f7e5da06babba0b00a2190490
|
|
| BLAKE2b-256 |
a58829da6c764984f10308c9892dc547e184ffab9d8f9f56dd302dbf5521fb2d
|
File details
Details for the file tdxrs-0.5.0-cp311-cp311-macosx_10_12_x86_64.whl.
File metadata
- Download URL: tdxrs-0.5.0-cp311-cp311-macosx_10_12_x86_64.whl
- Upload date:
- Size: 594.7 kB
- Tags: CPython 3.11, macOS 10.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5d91d9a71cb131cbfe58f7e05c059496223c73bc1f02ee7783a8f1502652bf7a
|
|
| MD5 |
1fd6b8f04ddaaa2be6e35f147fb2fb92
|
|
| BLAKE2b-256 |
33025c2840f728b7eaea19e0ce749b834a7db9341be6e1a9d76a387d9f082101
|