turboloader 0.8.0

High-performance ML data loading library (10,146 img/s, 12x faster than PyTorch). Features: 19 SIMD-accelerated transforms (AVX2/NEON), AutoAugment policies, PyTorch/TensorFlow tensor conversion, lock-free concurrent queues, memory-mapped I/O, WebDataset TAR format, professional documentation, and interactive benchmark web app. C++20 implementation with Python bindings.

TurboLoader

High-Performance ML Data Loading Library with 19 SIMD-Accelerated Transforms

---

Overview

TurboLoader is a high-performance data loading library that achieves 10,146 images/second throughput (12x faster than PyTorch) through native C++ implementation, SIMD-accelerated transforms, and lock-free concurrent queues.

Key Features

• 12x Faster than PyTorch DataLoader (optimized)
• 19 SIMD-Accelerated Transforms (AVX2/NEON)
• Zero-Copy Tensor Conversion (PyTorch/TensorFlow)
• Lock-Free Concurrent Queues (50x faster than mutex-based)
• Memory-Mapped I/O (52+ Gbps TAR parsing)
• AutoAugment Policies (ImageNet, CIFAR10, SVHN)
• Thread-Safe Architecture (no Python GIL)
• Professional Documentation (Read the Docs)

---

Performance

Framework Comparison (v0.8.0)

Framework	Throughput	vs TurboLoader	Epoch Time	Memory
TurboLoader	10,146 img/s	1.00x	0.18s	848 MB
TensorFlow	7,569 img/s	0.75x	0.26s	1,245 MB
PyTorch Cached	3,123 img/s	0.31x	0.64s	2,104 MB
PyTorch Optimized	835 img/s	0.08x	2.40s	1,523 MB

Test Config: Apple M4 Max, 2000 images, 8 workers, batch_size=32

See Benchmark Results for detailed analysis.

Transform Performance

Transform	Throughput	SIMD Speedup
RandomPosterize	336,700 img/s	Bitwise ops
RandomSolarize	21,300 img/s	N/A
AutoAugment	19,800 img/s	2x
RandomPerspective	9,900 img/s	N/A
Resize (Bilinear)	8,200 img/s	3.2x
ColorJitter	5,100 img/s	2.1x
GaussianBlur	2,400 img/s	4.5x

---

Installation

From PyPI (Recommended)

pip install turboloader

From Source

git clone https://github.com/ALJainProjects/TurboLoader.git
cd TurboLoader
pip install -e .

System Requirements

• Python: 3.8+
• Compiler: C++20 (GCC 10+, Clang 12+, MSVC 19.29+)
• OS: macOS, Linux, Windows

Optional (Recommended):

# macOS
brew install jpeg-turbo libpng libwebp

# Ubuntu/Debian
sudo apt-get install libjpeg-turbo8-dev libpng-dev libwebp-dev

See Installation Guide for details.

---

Quick Start

Basic Usage

import turboloader

# Create DataLoader
loader = turboloader.DataLoader(
    'imagenet.tar',
    batch_size=128,
    num_workers=8
)

# Iterate over batches
for batch in loader:
    for sample in batch:
        image = sample['image']  # NumPy array (H, W, C)
        label = sample['label']
        # Train your model...

With Transforms

import turboloader

# Create SIMD-accelerated transforms
resize = turboloader.Resize(224, 224, turboloader.InterpolationMode.BILINEAR)
normalize = turboloader.ImageNetNormalize(to_float=True)
flip = turboloader.RandomHorizontalFlip(p=0.5)
color_jitter = turboloader.ColorJitter(brightness=0.2, contrast=0.2)

# Apply to images
loader = turboloader.DataLoader('data.tar', batch_size=64, num_workers=8)

for batch in loader:
    for sample in batch:
        img = sample['image']

        # Apply transforms (SIMD-accelerated)
        img = resize.apply(img)
        img = flip.apply(img)
        img = color_jitter.apply(img)
        img = normalize.apply(img)

        # Ready for training!

PyTorch Integration

import turboloader
import torch

# Create loader with tensor conversion
loader = turboloader.DataLoader('imagenet.tar', batch_size=64, num_workers=8)

# PyTorch-compatible tensor format
to_tensor = turboloader.ToTensor(
    format=turboloader.TensorFormat.PYTORCH_CHW,
    normalize=True
)
normalize = turboloader.ImageNetNormalize(to_float=True)

# Training loop
for batch in loader:
    images = []
    labels = []

    for sample in batch:
        img = to_tensor.apply(sample['image'])
        img = normalize.apply(img)
        images.append(torch.from_numpy(img))
        labels.append(sample['label'])

    batch_tensor = torch.stack(images)
    # Train model...

AutoAugment

import turboloader

# Use learned augmentation policies
autoaugment = turboloader.AutoAugment(
    policy=turboloader.AutoAugmentPolicy.IMAGENET
)

loader = turboloader.DataLoader('data.tar', batch_size=128, num_workers=8)

for batch in loader:
    for sample in batch:
        img = autoaugment.apply(sample['image'])
        # State-of-the-art augmentation applied!

See Getting Started Guide for more examples.

---

Feature Comparison

Feature	TurboLoader	PyTorch	TensorFlow	FFCV	DALI
Throughput (CPU)	10,146 img/s	835 img/s	7,569 img/s	15,000 img/s	8,000 img/s
SIMD Transforms	19	0	0	14	GPU only
Lock-Free Queues	✅	❌	✅	✅	✅
Zero-Copy I/O	✅	❌	✅	✅	✅
AutoAugment	✅	✅	✅	❌	✅
Custom Format	TAR	Any	Any	.beton	Any
GPU Decode	Planned	❌	❌	❌	✅
Memory (2K imgs)	848 MB	1,523 MB	1,245 MB	~900 MB	1,200+ MB
Ease of Use	⭐⭐⭐⭐⭐	⭐⭐⭐⭐⭐	⭐⭐⭐⭐	⭐⭐⭐	⭐⭐⭐
License	MIT	BSD	Apache	Apache	Apache

---

Transform Library

TurboLoader includes 19 SIMD-accelerated transforms:

Core Transforms

• Resize - Bilinear/Bicubic/Lanczos interpolation (3.2x faster)
• Normalize - SIMD FMA operations (5.0 GB/s)
• ImageNetNormalize - Preset for ImageNet (mean/std)
• CenterCrop - Center region extraction
• RandomCrop - Random crop with padding

Augmentation Transforms

• RandomHorizontalFlip - SIMD horizontal flip (10.5K img/s)
• RandomVerticalFlip - SIMD vertical flip
• ColorJitter - Brightness/contrast/saturation/hue (5.1K img/s)
• RandomRotation - Arbitrary angle rotation
• RandomAffine - Rotation/translation/scale/shear
• GaussianBlur - Separable convolution (2.4K img/s, 4.5x faster)
• RandomErasing - Cutout augmentation (8.3K img/s)
• Grayscale - RGB to grayscale conversion
• Pad - Border padding (CONSTANT/EDGE/REFLECT)

Advanced Transforms (v0.7.0+)

• RandomPosterize - Bit-depth reduction (336K+ img/s)
• RandomSolarize - Threshold inversion (21K+ img/s)
• RandomPerspective - Perspective warp (9.9K+ img/s)
• AutoAugment - Learned policies (ImageNet/CIFAR10/SVHN)

Tensor Conversion

• ToTensor - PyTorch CHW or TensorFlow HWC format

See Transforms API for complete reference.

---

Architecture

┌─────────────────────────────────────────────────────────────┐
│                    TurboLoader Pipeline                      │
└──────────┬──────────────────────────────────────────────────┘
           │
    ┌──────▼──────┐
    │  Main Thread │
    └──────┬───────┘
           │
    ┌──────▼───────────────────────────────────────────────────┐
    │          Memory-Mapped TAR Reader (52+ Gbps)              │
    │  • mmap() zero-copy access                                │
    │  • TAR format parsing (512-byte headers)                  │
    └──────┬───────────────────────────────────────────────────┘
           │
    ┌──────▼───────────────────────────────────────────────────┐
    │          Worker Thread Pool (N threads)                   │
    │                                                            │
    │  ┌────────────────┐  ┌────────────────┐                  │
    │  │  Worker 1      │  │  Worker N      │                  │
    │  ├────────────────┤  ├────────────────┤                  │
    │  │ JPEG Decode    │  │ JPEG Decode    │  libjpeg-turbo   │
    │  │ SIMD Transforms│  │ SIMD Transforms│  AVX2/NEON       │
    │  │ Tensor Convert │  │ Tensor Convert │  Zero-copy       │
    │  └────────┬───────┘  └────────┬───────┘                  │
    └───────────┼──────────────────┼─────────────────────────┘
                │                  │
         ┌──────▼──────────────────▼──────┐
         │   Lock-Free Output Queue       │  50x faster
         │   (SPSC ring buffer)            │  than mutex
         └──────┬─────────────────────────┘
                │
         ┌──────▼──────────────┐
         │   Python Iterator   │
         └─────────────────────┘

Key Components:

1. Memory-Mapped I/O - Zero-copy TAR parsing (52+ Gbps)
2. SIMD Transforms - AVX2/NEON vectorized operations
3. Lock-Free Queues - Cache-aligned atomic operations
4. Thread-Local Decoders - Per-worker JPEG/PNG/WebP instances

See Architecture Guide for detailed design.

---

Documentation

Getting Started

• Installation Guide
• Quick Start
• Basic Usage
• Advanced Usage

API Reference

• Pipeline API
• Transforms API
• Tensor Conversion

Guides

• PyTorch Integration
• TensorFlow Integration

Benchmarks

• Performance Overview
• Methodology
• Memory Profiling

Development

• Contributing
• Building from Source
• Running Tests

---

Roadmap

v0.8.0 (Current)

• ✅ Complete documentation
• ✅ Interactive benchmark web app
• ✅ 19 SIMD transforms with full API
• ✅ API stability guarantees

v1.0.0 (Stable Release)

• API freeze (semantic versioning)
• Extended test suite (1000+ images, multiple formats)
• Cross-platform validation (macOS/Linux/Windows)
• Long-term support commitment
• Production deployment guide

v1.1.0+ (Future)

• GPU JPEG decoding (nvJPEG)
• AVX-512 optimizations
• Prefetching pipeline
• Custom binary format (faster than TAR)
• Smart batching (size-based grouping)

See CHANGELOG.md for version history.

---

Contributing

Contributions are welcome! Please see Contributing Guide for:

• Development setup
• Code style guidelines
• Pull request process
• Testing requirements

---

License

TurboLoader is released under the MIT License.

---

Citation

If you use TurboLoader in your research:

@software{turboloader2025,
  author = {Jain, Arnav},
  title = {TurboLoader: High-Performance ML Data Loading},
  year = {2025},
  version = {0.8.0},
  url = {https://github.com/ALJainProjects/TurboLoader}
}

---

Acknowledgments

• Inspired by FFCV and NVIDIA DALI
• Built with pybind11
• Uses libjpeg-turbo for fast JPEG decoding

---

Support

• Documentation: docs/
• Issues: GitHub Issues
• Discussions: GitHub Discussions
• PyPI: https://pypi.org/project/turboloader/

---

TurboLoader v0.8.0 - Making ML data loading fast and simple.