Skip to main content

ValidDataSet

About [ Menu ]

ValidDataSet was created to help validate datasets created based on the Lj Speech Dataset (for Tacotron, Flowtron, Waveglow, or RadTTS).

VDS works based on plugins (which can be dynamically added by the user in the future).

Descriptions of current plugins can be found in the Plugins section.

Plugins [ Menu ]

Below is a list of currently used plugins (new ones will be added over time).

ID Name Version Description
F001 WavsTranscriptionChecker 23.3.9 Check if all files have been added to the transcription files
F002 WavPropertiesChecker 23.3.9 Check if all files are mono, 22050 Hz with length between 2 and 10 seconds
T001 DatasetStructureChecker 23.3.9 Check if the "wavs" folder and transcription files exist in the dataset
T002 EmptyLineChecker 23.3.9 Check if there are empty lines in the transcriptions
T003 FilesInTranscriptionChecker 23.3.9 Check if all files added to transcription exist
T004 ExistingWavFileTranscriptionChecker 23.3.9 Check if all files added to transcription have a transcription
T005 PunctuationMarksChecker 23.3.9 Check if all transcriptions end with punctuation marks: ".", "?" or "!"
T006 PunctuationMarksChecker 23.3.9 Check if all lines have the same number of PIPE characters
T007 DuplicatedTranscriptionChecker 23.3.9 Check if there are any duplicate paths to WAV files in the transcriptions

Installation [ Menu ]

To install ValidDataSet, use the following command:

pip install vds

Usage [ Menu ]

Command in Linux: vds or vds-win

Command in Windows: vds-win

List of parameters supported by VDS:

 -v, --verbose                    Print additional information
 -o, --output                     Save output to file

     --plugins.list               List plugins
     --plugins.disable            List of plugins to disable like: F001,T002,T006

     --args.path                  Path to dataset
     --args.files                 Set transcription file names like: train.txt,val.txt
     --args.dir-name              wavs folder name (default: wavs)
     --args.sample-rate           Set sample rate (default: 22050)
     --args.number-of-channels    Set number of channels (default: 1 [mono])
     --args.min-duration          Set minimum duration in miliseconds (1000 ms = 1 second)
     --args.max-duration          Set maximum duration in miliseconds (1000 ms = 1 second)
     --args.number-of-pipes       Set number of pipes (|) (default: 1)

Sample commands and their description:

List all plugins:

vds --plugins.list

Run VDS with all plugins without additional information:

vds --args.path /media/username/Disk/Dataset_name/

Run VDS with all plugins with additional information:

vds --args.path /media/username/Disk/Dataset_name/ -v

Run VDS without plugins F001,T002,T006 with additional information:

vds --args.path /media/username/Disk/Dataset_name/ --plugins.disable F001,T002,T006 -v

Run VDS without plugins F001,T002,T006 with own transcription names and with additional information:

vds --args.path /media/username/Disk/Dataset_name/ --plugins.disable F001,T002,T006 --args.files train.txt,val.txt -v

Run VDS and print files which are longer than 20 seconds, shorter than 2 seconds and not in mono:

vds --args.path /media/username/Disk/Dataset_name/ --args.min-duration 2000 --args.max-duration 20000 --args.number-of-channels 2 -v

Metadata

Release files for vds 23.3.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vds 23.3.9
File Size Uploaded Provenance Actions
vds-23.3.9.tar.gz 10.3 kB Without provenance Details for vds-23.3.9.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for vds 23.3.9
File Interpreter ABI Platform Actions
vds-23.3.9-py3-none-any.whl Python 3 none any Details for vds-23.3.9-py3-none-any.whl

Total release size: 25.5 kB

Release files / vds-23.3.9.tar.gz

Download URL vds-23.3.9.tar.gz
Size 10.3 kB
Tags Source
SHA-256 checksum
How to use checksums
dc8ab3dce2a25a5ad80dad3bdd6188d8bd4f973e0db629a5334d3bab94d98a9b
BLAKE2b-256 checksum
How to use checksums
24f2ec6e61ce398f9827a10b478eff53fc4d3a27204da535321dfd83c87fcbd5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.1 CPython/3.10.9 Linux/6.1.0-5-amd64

Release files / vds-23.3.9-py3-none-any.whl

Download URL vds-23.3.9-py3-none-any.whl
Size 15.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
352d7f28c3f86108f39440ce68dd58d7087d28bf210faa9d015405101573e545
BLAKE2b-256 checksum
How to use checksums
35524ac4c12815c18510264ae61dac7a50102c076c324eb6a15b9441b7aaaaea
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.1 CPython/3.10.9 Linux/6.1.0-5-amd64

Security for vds 23.3.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page