Skip to main content

The audio-dataset-converter library allows the conversion between various dataset formats of audio datasets. Filters can be supplied as well, e.g., for cleaning up the data.

Dataset formats:

  • classification: ADAMS (r/w), sub-dir (r/w), TXT (r/w)

  • speech: ADAMS (r/w), CommonVoice (r/w), Festvox (r/w), Huggingface Audiofolder (r/w), TXT (r/w)

Examples can be found here:

https://github.com/waikato-llm/audio-dataset-converter-examples

Changelog

0.1.0 (2025-10-31)

  • split-records filter now allows specifying the meta-data field in which to store the split name

  • the tee meta-filter can now forward or drop the incoming data based on a meta-data evaluation

  • the sub-process filter can be used for processing data with sub-flow of filters, can be conditional based on meta-data evaluation

  • the metadata-from-name filter can work on the path now as well (must be present)

  • switched to kasperl library for base API and generic pipeline plugins

  • added @abc.abstractmethod decorator where appropriate

  • the adc-exec tool now uses all remaining parameters as the pipeline components rather than having to specify them via the -p/–pipeline parameter, making it easy to simply prefix the adc-exec command to an existing adc-convert command-line

  • added the text-file and csv-file generators that work off files to populate the variable(s)

  • added support for class lister with ignored classes

  • adc-exec can load pipelines from file now as well, useful when dealing with large pipelines

  • added –load_pipeline option to adc-convert

  • added from-text-file reader and to-text-file writer

  • readers now locate files the first time the read() method gets called rather than in the initialized(), to allow more dynamic placeholders

  • added from-text-file reader and to-text-file writer

  • added block, stop filters for controlling the flow of data (via meta-data conditions)

  • added email support with get-email reader and send-email writer

  • added list-files reader for listing files in a directory

  • added list-to-sequence stream filter that forwards list items one by one

  • added console writer for outputting the data on stdout that is coming through

  • added watch-dir meta-reader that uses the watchdog library to react to file-system events rather than using fixed-interval polling like poll-dir

  • added delete-files writer

  • added copy-files filter

  • added support for caching plugins via ADC_CLASS_CACHE environment variable

  • added to-metadata writer that outputs the meta-data of an image

  • added attach-metadata filter that loads meta-data from a directory and attaches it to the data passing through

  • added annotation-to-storage and annotation-from-storage filters

  • annotation data is now being type-checked when setting it

  • requiring seppl>=0.3.0 now

0.0.4 (2025-07-15)

  • requiring seppl>=0.2.20 now for improved help requests in adc-convert tool

0.0.3 (2025-07-10)

  • added set-placeholder filter for dynamically setting (temporary) placeholders at runtime

  • added –resume_from option to relevant readers that allows resuming the data processing from the first file that matches this glob expression (e.g., */012345.wav)

  • requiring seppl>=0.2.17 now for resume, split group, skippable plugin support and avoiding deprecated use of pkg_resources

  • to-adams-sp writer now uses -t short flag for the transcript like the from-adams-sp reader

  • added the from-multi meta-reader that combines multiple base readers and returns their output

  • added the to-multi meta-writer that forwards the data to multiple base writers

  • using wai_common instead of wai.common now

  • added split_group parameter to splittable writers (stream/batch)

  • fixed the construction of the error messages in the pyfunc reader/filter/writer classes

  • added metadata-to-placeholder filter to transfer meta-data files into placeholders

0.0.2 (2025-03-14)

  • added setuptools as dependency

  • switched to underscores in project name

  • added discard-by-name filter

  • requiring seppl>=0.2.13 now

  • added support for aliases

  • added placeholder support to tools: adc-convert, adc-exec

  • added placeholder support to readers: from-adams-ac, from-subdir-ac, from-txt-ac, from-adams-sp, from-commonvoice-sp, from-festvox-sp, from-hf-audiofolder-sp, from-txt-sp, from-data, poll-dir, from-pyfunc

  • added placeholder support to writers: to-adams-ac, to-subdir-ac, to-txt-ac, to-adams-sp, to-commonvoice-sp, to-festvox-sp, to-hf-audiofolder-sp, to-txt-sp, to-audioinfo, to-data

0.0.1 (2024-07-05)

  • initial release

Metadata

Release files for audio-dataset-converter 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for audio-dataset-converter 0.1.0
File Size Uploaded Provenance
audio_dataset_converter-0.1.0.tar.gz 41.6 kB Without provenance Details

Release files / audio_dataset_converter-0.1.0.tar.gz

Download URL audio_dataset_converter-0.1.0.tar.gz
Size 41.6 kB
Tags Source
SHA-256 checksum
How to use checksums
f12c569164427ec5caaa14e2e2982473895ef76e8fca448eb9f1c1edc3d0eee4
BLAKE2b-256 checksum
How to use checksums
1801dbf7ba6f965d2fa0e2b70b39bf1ae747a644ef8477936d4b273659712d57
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.12.3

Security for audio-dataset-converter 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page