whisper-lid 0.0.1

Spoken Language IDentification (LID) using multilingual Whisper model

This is a spoken language identification system that is based on the Whisper model. The system uses the Whisper-based algorithm to identify spoken languages or non-speech event. The Section 2.3 of the paper about Whisper (https://arxiv.org/abs/2212.04356) states that language tags or non-speech tags need to be predicted after the <|startoftranscript|> special token. Based on this information, the system estimates a probability distribution for the next token after the <|startoftranscript|> and selects the token with the highest probability as the final spoken language prediction. Since the predicted token can be either a language tag or a non-speech tag, the system combines the features of a spoken language identifier and a voice activity detector.