Skip to main content

unibox provides unified interface for common file operations

Project description

unibox

ci documentation pypi version gitter

A unified interface for seamless file operations across local, S3, and Hugging Face ecosystems.

unibox simplifies loading, saving, and exploring data—whether it's a local CSV, an S3-hosted image, or an entire Hugging Face dataset. With a single API, you can handle diverse file types and storage backends effortlessly.

Installation

pip install unibox

Or with uv:

uv tool install unibox

Quick Start

Load anything, anywhere:

import unibox as ub

# Local parquet file
df = ub.loads("data/sample.parquet")

# S3-hosted text file
lines = ub.loads("s3://my-bucket/notes.txt")

# Hugging Face dataset
dataset = ub.loads("hf://user/repo")

Save with ease:

ub.saves(df, "s3://my-bucket/processed.parquet")
ub.saves(dataset, "hf://my-org/new-dataset")

List files or peek at data:

# List all JPGs in an S3 folder
images = ub.ls("s3://bucket/images", exts=[".jpg"])

# Preview a dataset
ub.peeks(dataset)

Why unibox?

  • Versatile: Handles CSVs, images, datasets, and more—locally or remotely.
  • Simple: One function call to load or save, no matter the source.
  • Transformative: From quick data peeks to concurrent downloads, it scales with your needs.

Explore the full power in our documentation.

Contributing

Love unibox? Join us! Check out CONTRIBUTING.md to get started.

Extra dev notes: see README_dev.md.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

unibox-0.12.0.tar.gz (191.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

unibox-0.12.0-py3-none-any.whl (60.6 kB view details)

Uploaded Python 3

File details

Details for the file unibox-0.12.0.tar.gz.

File metadata

  • Download URL: unibox-0.12.0.tar.gz
  • Upload date:
  • Size: 191.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.16

File hashes

Hashes for unibox-0.12.0.tar.gz
Algorithm Hash digest
SHA256 3aa28f96ac53a479526e143dd4517e68f1a02cea141070def362e0a64ffdcc2d
MD5 ca83e7cdf4dd9de6ed80d592fe937962
BLAKE2b-256 d11cf93dd05f2514f8304e596958dd6387c1d7350c8005b2eb2090b678b55d46

See more details on using hashes here.

File details

Details for the file unibox-0.12.0-py3-none-any.whl.

File metadata

  • Download URL: unibox-0.12.0-py3-none-any.whl
  • Upload date:
  • Size: 60.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.16

File hashes

Hashes for unibox-0.12.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3f4b814c345379e85814069633e4dab2e823daa0a7c1f42e368b60cd4644cd9a
MD5 08d924a1b3e3028e96b464bdfd0cc6c5
BLAKE2b-256 d3721152f87f5698def9c9acd082497526921e942b9ef090ae6dce4b386b4488

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page