Skip to main content

librivox-mirror

Fast, structured, continuously updated LibriVox audio mirror.

Original MP3s are mirrored to Hugging Face as deterministic WebDataset TARs with compact Parquet indexes. Dedicated infrastructure handles the initial backfill; GitHub Actions handles updates.

Install

uvx librivox-mirror --help

Use

librivox-mirror plan
librivox-mirror mirror 47
librivox-mirror backfill --start-id 1 --end-id 1000

Set HF_DATASET_REPO and HF_TOKEN to publish. Local SQLite checkpoints make backfills resumable.

Dataset

  • preview (default): browser-playable original MP3 samples
  • sections: one Parquet row per audio section
  • books: one Parquet row per book
  • data/: streaming WebDataset audio and sample metadata

Audio is never transcoded. Complete LibriVox and Internet Archive metadata and checksums are preserved.

Develop

uv sync --locked --group dev --no-group integration

Python 3.12–3.14 is supported. See CONTRIBUTING.md.

Licenses

Code is MIT. Mirror-specific curation, indexes, metadata, and documentation are CC BY 4.0. Original LibriVox audio remains public domain in the United States.

Metadata

Release files for librivox-mirror 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for librivox-mirror 0.1.0
File Size Uploaded
librivox_mirror-0.1.0.tar.gz 27.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for librivox-mirror 0.1.0
File Interpreter ABI Platform
librivox_mirror-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 59.5 kB

Release files / librivox_mirror-0.1.0.tar.gz

Download URL librivox_mirror-0.1.0.tar.gz
Size 27.0 kB
Tags Source
SHA-256 checksum
How to use checksums
a2987f320c8e2c4955968fcc73ba0fb90934bfa49c50282546ec3616f664dc1d
BLAKE2b-256 checksum
How to use checksums
7e7aedb1c5ffe38ee0d5cd570c34cb63308b4640e6c8850b488b2308244c099c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / librivox_mirror-0.1.0-py3-none-any.whl

Download URL librivox_mirror-0.1.0-py3-none-any.whl
Size 32.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
26576b9831979820bd49ada9e358b2cc220411016bdaf157ace4af34b579b525
BLAKE2b-256 checksum
How to use checksums
e36a0bc169c631532e48a45d5575d752387f6471f127c2950f3f82fc87a57f11
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

0.2.0

2 release files

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page