tracebloc-ingestor 0.2.11

A flexible data ingestion library for various file formats

Data Ingestors 📊

Get your data into the tracebloc training environment — validated, clean, and ready for model evaluation.

These pipelines handle the full data preparation workflow: validation, preprocessing, and secure transfer into your Kubernetes cluster. A metadata representation syncs to the tracebloc web app so you can manage datasets visually. Your raw data never leaves your infrastructure.

How it works

Your raw data
     │
     ▼
┌─────────────────┐     ┌──────────────────────────────────┐
│  Data ingestor   │────►│  Your Kubernetes cluster          │
│                  │     │                                   │
│  Validates       │     │  Validated dataset                │
│  Preprocesses    │     │  (ready for training)             │
│  Transfers       │     │                                   │
└─────────────────┘     └──────────────┬────────────────────┘
                                       │
                              Metadata only
                                       │
                                       ▼
                        ┌──────────────────────────┐
                        │  tracebloc web app        │
                        │  (dataset management UI)  │
                        └──────────────────────────┘

Data stays on your infrastructure. Only metadata (structure, schema, statistics) syncs to the web app for dataset management and vendor guidance.

Supported data types

Type	Examples
Image	Classification, detection, segmentation datasets
Text / NLP	Document classification, sentiment, named entities
Tabular	Structured CSV data, feature tables
Time series	Sequential measurements, forecasting datasets

Install

pip install tracebloc-ingestor

Prerequisites

• Python 3.8+
• A tracebloc account with an active use case
• A running tracebloc client on your infrastructure

For step-by-step data preparation instructions → Prepare Data guide

Links

Platform · Docs · Data preparation guide · Discord

License

Apache 2.0 — see LICENSE.

Questions? [e-mail] or open an issue.