Skip to main content

TLabel

A Unified Annotation Framework for Cross-Sensor Tactile Manipulation Data

PyPI Tests License: MIT Downloads DOI 中文文档

TLabel is the first cross-sensor tactile annotation schema with capability declarations and Compliance Level stratification. It enables heterogeneous tactile sensors — regardless of operating principle — to produce compatible 14-dimensional semantic annotations while preserving their unique strengths.

TL;DR — The Unicode for tactile data: one standard schema, every sensor.

Why TLabel?

Tactile datasets today ship as raw sensor signals without semantic annotations. Each sensor type demands its own ad-hoc processing, and results from different sensors cannot be compared or fused. TLabel addresses this by:

  • Standardizing annotations — 14 dimensions covering spatial, mechanical, surface, dynamic, and meta perceptions
  • Declaring capabilities — each adapter explicitly states which dimensions it can and cannot annotate
  • Stratifying compliance — Compliance Level (L1–L4) ensures every sensor participates at its appropriate information density
  • Enabling cross-sensor comparison through a shared output format

Quick Start

Install

pip install tlabel

Load and explore data

import tlabel

# Load tactile data (auto-detects sensor format)
data = tlabel.load("path/to/sensor_data.pkl")

# Or try the built-in demo — no files needed
data = tlabel.demo("gelsight")

# Inspect annotation metadata
print(data.describe())

Interactive annotation (Jupyter)

data.review()  # Bilingual annotation panel (Chinese / English)

Export to training formats

data.export("output.json")              # JSON / CSV
data.export_ftp1("output.zarr")         # FTP-1 Zarr for foundation models

from tlabel.converters import tlabel_to_lerobot
tlabel_to_lerobot("annotations.json", "lerobot_episode/")  # LeRobot

CLI

tlabel list                       # List all registered adapters
tlabel info gelsight              # Adapter details & compliance level
tlabel validate data.json         # Schema compliance check

Optional dependencies

pip install tlabel[gelsight]      # GelSight / DIGIT (.pkl)
pip install tlabel[paxini]        # PaXini PXCap (.h5)
pip install tlabel[daimon]        # Daimon DM-TacClaw (.parquet)
pip install tlabel[ftp1]          # FTP-1 export (zarr)
pip install tlabel[all]           # Everything

Schema — 14 Dimensions, 4 Compliance Levels

TLabel defines 14 semantic dimensions with Compliance Levels (L1–L4) indicating annotation completeness:

Level Name Required Fields Example Sensors
L1 Basic Tactile contact, centroid, slip, confidence Single-point resistive, proximity
L2 Force-Aware L1 + force_magnitude Paxini, YCB-Slide, GelSight
L3 Full-Vector L2 + force_vector [3D] ToucHD, calibrated DM-TAC
L4 Rich-Semantic L3 + all optional fields BioTac, next-gen multimodal

The 14 dimensions span: contact, contact_centroid, force_magnitude, slip_event, confidence, compliance_level, contact_region, force_vector, torque_vector, slip_velocity, manipulation_phase, texture_class, object_deformation, temperature.

Full dimension spec → docs/tlabel-format.md

Supported Sensors

Dataset Adapters (offline): GelSight/DIGIT (L3) · Daimon DM-TacClaw (L3) · PaXini PXCap (L2) · UniVTAC (L3) · TacQuad/AnyTouch (L3) · VTouch (L3) · YCB-Slide (L3)

Real-time Adapters (hardware): PaXini GEN3 (L2) · Daimon DM-Tac (L3)

Adding a new sensor takes ~30 min — fork contrib/adapter-template/

Architecture

┌─────────────────────────────────────────────────┐
│  Layer 1: Schema                                │
│  14 semantic dimensions + Compliance Level L1-L4│
├─────────────────────────────────────────────────┤
│  Layer 2: Adapters                              │
│  DataAdapterBase │ SensorAdapterBase             │
│  (7 built-in + community-extensible)            │
├─────────────────────────────────────────────────┤
│  Layer 3: Downstream                            │
│  Feature derivation · Augmentation · Export      │
│  PredictEngine · FTP-1 · LeRobot · RLDS · ROS2 │
└─────────────────────────────────────────────────┘

Paper

TLabel: A Unified Annotation Framework for Cross-Sensor Tactile Manipulation Data

Xi Luo, Sheng Wu (Niuxiu Tech)

Submitted to SoftwareX, 2026. Manuscript: SOFTX-S-26-01665

[PDF] · LaTeX source: paper/

Citation

@software{tlabel2026,
  title  = {TLabel: A Sensor-Agnostic Tactile Data Annotation Toolkit and Format Standard},
  author = {Wu, Sheng and Luo, Xi},
  year   = {2026},
  url    = {https://github.com/liesliy/tlabel}
}

Documentation

Document Description
TLabel Format Spec Complete annotation schema specification
Annotation Spec Annotation methodology and guidelines
Design Document Core design decisions and architecture
中文文档 Chinese README

Contributing

TLabel is designed to be extensible. Add your sensor in ~30 minutes:

  1. Fork contrib/adapter-template/
  2. Subclass DataAdapterBase or SensorAdapterBase
  3. Submit a PR or publish as a standalone package

See CONTRIBUTING.md for details.

License

MIT © 2026 Niuxiu Tech


TouchLabel AI — Tactile Data Annotation Infrastructure
GitHub · PyPI · Discord
Niuxiu Tech · Hangzhou, China

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tlabel-0.22.2.tar.gz (269.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tlabel-0.22.2-py3-none-any.whl (295.8 kB view details)

Uploaded Python 3

File details

Details for the file tlabel-0.22.2.tar.gz.

File metadata

  • Download URL: tlabel-0.22.2.tar.gz
  • Upload date:
  • Size: 269.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for tlabel-0.22.2.tar.gz
Algorithm Hash digest
SHA256 28b4c3c4ce2e46d14d789cc11e26777f3f49bf25cbbe81b0d914d15679390573
MD5 94c9ba061d70b2b88bf692ab94423f1f
BLAKE2b-256 9667208318c01099db8386ca14dbfe0848597a1652b8887edf6ee47956215b77

See more details on using hashes here.

File details

Details for the file tlabel-0.22.2-py3-none-any.whl.

File metadata

  • Download URL: tlabel-0.22.2-py3-none-any.whl
  • Upload date:
  • Size: 295.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for tlabel-0.22.2-py3-none-any.whl
Algorithm Hash digest
SHA256 c510e10eabc36ae8682de2c58a8f5c2ee1a20ff33a32b71c739d6c285477f248
MD5 4ab8fe1c1573b2aafe27bf844c88c6d3
BLAKE2b-256 e8d29bc713587e187de6529bed4135161e37dbb53d9ade52cdca15bb887d97bb

See more details on using hashes here.

Release history Release notifications | RSS feed

0.23.1

2 files

0.23.0

2 files

0.22.4

2 files

0.22.3

2 files

This release

0.22.2 This release

2 files

0.22.1

2 files

0.22.0

2 files

0.21.1

1 file

0.21.0

2 files

0.20.1

2 files

0.20.0

2 files

0.19.0

2 files

0.18.2

2 files

0.18.1

2 files

0.18.0

2 files

0.17.3

2 files

0.17.2

2 files

0.17.1

2 files

0.17.0

2 files

0.16.0

2 files

0.15.0

2 files

0.14.0

2 files

0.13.1

2 files

0.13.0

2 files

0.12.4

2 files

0.12.3

2 files

0.12.2

2 files

0.12.1

2 files

0.12.0

2 files

0.11.2

2 files

0.11.1

2 files

0.11.0

2 files

0.10.3

2 files

0.10.2

2 files

0.10.1

2 files

0.10.0

2 files

0.9.0

2 files

0.8.0

2 files

0.7.0

2 files

0.6.2

2 files

0.6.1

2 files

0.6.0

2 files

0.5.3

2 files

0.5.2

2 files

0.5.1

2 files

0.5.0

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page