sonata-asr 0.0.8

SONATA: SOund and Narrative Advanced Transcription Assistant

SONATA 🎵🔊

English | 한국어 | 中文 | 日本語

SOund and Narrative Advanced Transcription Assistant

SONATA(SOund and Narrative Advanced Transcription Assistant) is advanced ASR system that captures human expressions including emotive sounds and non-verbal cues.

✨ Features

• 🎙️ High-accuracy speech-to-text transcription using WhisperX
• 😀 Recognition of 523+ emotive sounds and non-verbal cues
• 🌍 Multi-language support with 10 languages
• 👥 Speaker diarization for multi-speaker transcription (online and offline modes)
• ⏱️ Rich timestamp information at the word level
• 🔄 Audio preprocessing capabilities

📚 See detailed features documentation

🚀 Installation

Install the package from PyPI:

pip install sonata-asr

Or install from source:

git clone https://github.com/hwk06023/SONATA.git
cd SONATA
pip install -e .

📖 Quick Start

Basic Transcription

from sonata.core.transcriber import IntegratedTranscriber

# Initialize the transcriber
transcriber = IntegratedTranscriber(asr_model="large-v3", device="cpu")

# Transcribe an audio file
result = transcriber.process_audio("path/to/audio.wav", language="en")
print(result["integrated_transcript"]["plain_text"])

CLI Usage

# Basic usage
sonata-asr path/to/audio.wav

# With speaker diarization
sonata-asr path/to/audio.wav --diarize --hf-token YOUR_HUGGINGFACE_TOKEN

# With offline speaker diarization (no token needed after setup)
sonata-asr path/to/audio.wav --diarize --offline-diarize --offline-config ~/.sonata/models/offline_config.yaml

📚 See full usage documentation
⌨️ See complete CLI documentation
🎤 See offline diarization guide

🗣️ Supported Languages

SONATA supports 10 languages including English, Korean, Chinese, Japanese, French, German, Spanish, Italian, Portuguese, and Russian.

🌐 See languages documentation

🔊 Audio Event Detection

SONATA can detect over 500 different audio events, from laughter and applause to ambient sounds and music. The customizable event detection thresholds allow you to fine-tune sensitivity for specific audio events to match your unique use cases, such as podcast analysis, meeting transcription, or nature recording analysis.

🎵 See audio events documentation

🚀 Next Steps

• 🧠 Advanced ASR model diversity
• 😢 Improved emotive detection
• 🔊 Better speaker diarization
• ⚡ Performance optimization

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

📝 See contribution guidelines

📄 License

This project is licensed under the GNU General Public License v3.0.

🙏 Acknowledgements

• WhisperX - Fast speech recognition
• AudioSet AST - Audio event detection
• PyAnnote Audio - Speaker diarization
• HuggingFace Transformers - NLP tools