High-performance AI data loader written in Rust
Project description
Green AI 🚀
The World's Fastest Image Loader for PyTorch & TensorFlow.
The Problem
Your GPUs are starving. Standard Python DataLoader pipelines are single-threaded and fight against the GIL (Global Interpreter Lock). While your H100 waits for data, you burn money.
The Solution
Green AI is a high-performance ingestion engine written in Rust. It bypasses Python's overhead to load, decode, and batch images in parallel, delivering them to your model via Zero-Copy memory transfer.
⚡ Performance Benchmark (1,000 Images)
| Loader | Time | Speed | Status |
|---|---|---|---|
| Standard Python (PIL) | 17.48s | 57 img/sec | 🐢 Slow |
| Green AI (Rust) | 1.22s | 819 img/sec | 🚀 14.3x Faster |
(Benchmarks run on local dataset, 512x512 RGB JPEGs)
📦 Installation
pip install green-ai
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file turbo_pixel_loader-0.1.0-cp314-cp314-win_amd64.whl.
File metadata
- Download URL: turbo_pixel_loader-0.1.0-cp314-cp314-win_amd64.whl
- Upload date:
- Size: 854.1 kB
- Tags: CPython 3.14, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.11.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
40df36ef32381ef1a1be138d769e50f5d03ea2a0fc69d3d913f3b33b5e2deb34
|
|
| MD5 |
f4bc3e04e5ffe8b4378f40b79769e51d
|
|
| BLAKE2b-256 |
05971f2d7a7ef0b008a7a9ad58d81b5512a73821aaa4fd78089011a37ed95831
|