Skip to main content

unibox provides unified interface for common file operations

Project description

unibox

ci documentation pypi version gitter

A unified interface for seamless file operations across local, S3, and Hugging Face ecosystems.

unibox simplifies loading, saving, and exploring data—whether it's a local CSV, an S3-hosted image, or an entire Hugging Face dataset. With a single API, you can handle diverse file types and storage backends effortlessly.

Installation

pip install unibox

Or with uv:

uv tool install unibox

Quick Start

Load anything, anywhere:

import unibox as ub

# Local parquet file
df = ub.loads("data/sample.parquet")

# S3-hosted text file
lines = ub.loads("s3://my-bucket/notes.txt")

# Hugging Face dataset
dataset = ub.loads("hf://user/repo")

Save with ease:

ub.saves(df, "s3://my-bucket/processed.parquet")
ub.saves(dataset, "hf://my-org/new-dataset")

List files or peek at data:

# List all JPGs in an S3 folder
images = ub.ls("s3://bucket/images", exts=[".jpg"])

# Preview a dataset
ub.peeks(dataset)

Why unibox?

  • Versatile: Handles CSVs, images, datasets, and more—locally or remotely.
  • Simple: One function call to load or save, no matter the source.
  • Transformative: From quick data peeks to concurrent downloads, it scales with your needs.

Explore the full power in our documentation.

Contributing

Love unibox? Join us! Check out CONTRIBUTING.md to get started.

Extra dev notes: see README_dev.md.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

unibox-0.10.0.tar.gz (265.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

unibox-0.10.0-py3-none-any.whl (149.8 kB view details)

Uploaded Python 3

File details

Details for the file unibox-0.10.0.tar.gz.

File metadata

  • Download URL: unibox-0.10.0.tar.gz
  • Upload date:
  • Size: 265.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for unibox-0.10.0.tar.gz
Algorithm Hash digest
SHA256 8c38f8524c0eb68cde567dac3b933c46ad2a4d20e52e1fd3f19e5e4f75db357d
MD5 65efbd1343717ee69d3e4cccfe4b82b2
BLAKE2b-256 eec868fba045485c5f75f0537cd3c09d1eee60d96228c31e0e589d4befffd38d

See more details on using hashes here.

File details

Details for the file unibox-0.10.0-py3-none-any.whl.

File metadata

  • Download URL: unibox-0.10.0-py3-none-any.whl
  • Upload date:
  • Size: 149.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for unibox-0.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f1bd42681ce5f21896f67ebded7c6e79465b0ea24cb3a4758a891a1a1c4aba87
MD5 b49713dcb1be592d33aa61e966ce246c
BLAKE2b-256 88917bec22c05888f08ed20423b572dd04b95245d145e805ee05279249006c8d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page