harbr 0.0.0

Git-like dataset versioning and resumable transfer for your own S3 bucket.

harbr

Git-like dataset versioning and resumable transfer for your own S3 bucket.

The HuggingFace-Hub developer experience, pointed at storage you control. Push, pull, and version ML datasets and models on any S3-compatible store (AWS S3, Cloudflare R2, RustFS) with content-addressed dedup and resumable transfers. Open source, MIT.

Under active development. This is an early placeholder release. Follow progress at https://harbr.cloud

Planned

import harbr

b = harbr.connect(bucket="my-data")     # uses your existing AWS credentials
b.push("imagenet/", name="imagenet", version="v2")
b.pull("imagenet", version="v2")        # -> local files, byte-identical

License

MIT