MCP server for audio understanding via Gemini
Project description
Claudio
MCP server for audio understanding via Gemini. Ask questions about audio files - describe music, transcribe lyrics, identify instruments, and more.
What is this?
Claudio is an MCP (Model Context Protocol) server that gives AI assistants like Claude the ability to listen to and analyze audio files. It uses Google's Gemini API for audio understanding.
This is not a standalone CLI tool. It's a server that MCP clients (like Claude Code or Claude Desktop) connect to.
Setup
1. Get a Gemini API Key
Get an API key at Google AI Studio.
2. Add to your MCP client
Claude Code:
claude mcp add claudio -e GEMINI_API_KEY=your-key -- uvx claudio
Claude Desktop / Manual config:
Add to your MCP config file:
{
"mcpServers": {
"claudio": {
"command": "uvx",
"args": ["claudio"],
"env": { "GEMINI_API_KEY": "your-key" }
}
}
}
Tools
listen_to_audio
Start listening to an audio file and ask a question about it.
| Parameter | Type | Description |
|---|---|---|
file_path |
string | Absolute path to a local audio file |
question |
string | Your question about the audio (e.g., "Describe this music", "Transcribe the lyrics") |
Returns an answer and a session ID for follow-up questions.
ask_about_audio
Ask a follow-up question about audio from an existing session.
| Parameter | Type | Description |
|---|---|---|
session_id |
string | Session ID from a previous listen_to_audio call |
question |
string | Your follow-up question |
Supported Formats
WAV, MP3, AIFF, AAC, OGG, FLAC
Files under 20MB are sent inline; larger files are uploaded via Gemini's Files API.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file claudio-0.2.2.tar.gz.
File metadata
- Download URL: claudio-0.2.2.tar.gz
- Upload date:
- Size: 3.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
01995c1ce45f44877dfcd4cf80a4a684743fcd108c1df9c6f196eb99b5252a44
|
|
| MD5 |
13a42868fa4f5adbda1479e207db0239
|
|
| BLAKE2b-256 |
583f2be518e869650756a36bd69cce71b8d755d19541b966e5638f84f56e86f1
|
File details
Details for the file claudio-0.2.2-py3-none-any.whl.
File metadata
- Download URL: claudio-0.2.2-py3-none-any.whl
- Upload date:
- Size: 3.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
237afab64445d9f3c4b98912801056b35cc43b3136a2b20d50e0f12f0775d167
|
|
| MD5 |
0044eb9a0ece3a44c5295d7e6c3e5c7c
|
|
| BLAKE2b-256 |
a93d6b30982afe9b91e1ca597901b6323118a8858d296176781a80556593d437
|