Skip to main content

LeRobot-style dataset I/O:core / io / schemas(本地数据集与录制;不含 Web 服务)。

Project description

lsdataset

独立仓库中的 LeRobot 风格数据集库:coreLsRobotDatasetLsDatasetManager)、ioschemas。负责本地数据集的创建、写入、episode 生命周期管理与磁盘元信息;不包含 Web 框架或 HTTP 服务实现。

PyPI 项目名与 import 名均为 lsdataset

安装

pip install -e .

版本单一来源datasets / pyarrow / jsonlines / avpydanticnumpyscipyPillowpyproject.toml

异步图像写入并发度(默认 4):

  • LSDATASET_IMAGE_WRITER_PROCESSES
  • LSDATASET_IMAGE_WRITER_THREADS

测试

pip install -e ".[dev]"
make test
# 或:python -m pytest tests -q --tb=short

集成脚本在 scripts/(多为本地调试;parquet2json.py 需设置 LSDATASET_PARQUET2JSON_IN 等环境变量,见脚本内说明)。本仓库 tests/ 覆盖核心数据集与编码流程。

版本与依赖声明

在宿主项目的依赖文件中 pin lsdataset==x.y.z(与 PyPIeditable 安装一致即可)。

本地 editable 示例:

pip install -e /path/to/lsdataset

版本号与发布脚本

python scripts/release.py patch --sync-readme
make release PART=minor
make release-build PART=patch

--sync-readme 会替换本仓库 README.md 中出现的 lsdataset==旧版本,以及历史上可能存在的 lsdataset[…]==旧版本 写法。

发版后:更新依赖方声明的版本号,再执行 twine upload 等发布步骤。


发布到 PyPI(摘要)

  1. python scripts/release.py patch --sync-readme(或手改 version
  2. python -m buildtwine check dist/*twine upload dist/*
  3. git tag v<x.y.z>

近期主版本语义(摘要)0.2.0 起移除包内 HTTP 路由模块; 0.3.0 起移除与外部上传网关对接的实现子包; 0.3.1 起精简 schemas.types,删除仅用于该上传流程的请求模型(由集成方自行定义)。若曾依赖已删除的导入路径,请在集成侧替换实现。

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lsdataset-0.3.2.tar.gz (55.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lsdataset-0.3.2-py3-none-any.whl (66.9 kB view details)

Uploaded Python 3

File details

Details for the file lsdataset-0.3.2.tar.gz.

File metadata

  • Download URL: lsdataset-0.3.2.tar.gz
  • Upload date:
  • Size: 55.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for lsdataset-0.3.2.tar.gz
Algorithm Hash digest
SHA256 620fd0d0b8784e0d52cdcd0490f382d6566c051058062dbdbb350eda3fdb9e4e
MD5 8274379591fa9df8cac29dc4db1f8062
BLAKE2b-256 45af0a38bf8be25cb9d36bb517e46022d92e00cadca74cbdbd0eece79cdb37f4

See more details on using hashes here.

File details

Details for the file lsdataset-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: lsdataset-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 66.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for lsdataset-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 e5d45315f8d381492053683c1d18f18b256412b094ee15b3901ede2b55fe237b
MD5 e751a10fcd939a4f02b369568c144947
BLAKE2b-256 d17f8018f00210a7330e2f034d0af94609b7f7493a4d4f9f8c34904660a9a381

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page