Skip to main content

MCP server for audio understanding via Gemini

Project description

Claudio

MCP server for audio understanding via Gemini. Ask questions about audio files - describe music, transcribe lyrics, identify instruments, and more.

What is this?

Claudio is an MCP (Model Context Protocol) server that gives AI assistants like Claude the ability to listen to and analyze audio files. It uses Google's Gemini API for audio understanding.

This is not a standalone CLI tool. It's a server that MCP clients (like Claude Code or Claude Desktop) connect to.

Setup

1. Get a Gemini API Key

Get an API key at Google AI Studio.

2. Add to your MCP client

Claude Code:

claude mcp add claudio -e GEMINI_API_KEY=your-key -- uvx claudio

Claude Desktop / Manual config:

Add to your MCP config file:

{
  "mcpServers": {
    "claudio": {
      "command": "uvx",
      "args": ["claudio"],
      "env": { "GEMINI_API_KEY": "your-key" }
    }
  }
}

Tools

listen_to_audio

Start listening to an audio file and ask a question about it.

Parameter Type Description
file_path string Absolute path to a local audio file
question string Your question about the audio (e.g., "Describe this music", "Transcribe the lyrics")

Returns an answer and a session ID for follow-up questions.

ask_about_audio

Ask a follow-up question about audio from an existing session.

Parameter Type Description
session_id string Session ID from a previous listen_to_audio call
question string Your follow-up question

Supported Formats

WAV, MP3, AIFF, AAC, OGG, FLAC

Files under 20MB are sent inline; larger files are uploaded via Gemini's Files API.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

claudio-0.2.2.tar.gz (3.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

claudio-0.2.2-py3-none-any.whl (3.9 kB view details)

Uploaded Python 3

File details

Details for the file claudio-0.2.2.tar.gz.

File metadata

  • Download URL: claudio-0.2.2.tar.gz
  • Upload date:
  • Size: 3.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.6.10

File hashes

Hashes for claudio-0.2.2.tar.gz
Algorithm Hash digest
SHA256 01995c1ce45f44877dfcd4cf80a4a684743fcd108c1df9c6f196eb99b5252a44
MD5 13a42868fa4f5adbda1479e207db0239
BLAKE2b-256 583f2be518e869650756a36bd69cce71b8d755d19541b966e5638f84f56e86f1

See more details on using hashes here.

File details

Details for the file claudio-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: claudio-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 3.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.6.10

File hashes

Hashes for claudio-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 237afab64445d9f3c4b98912801056b35cc43b3136a2b20d50e0f12f0775d167
MD5 0044eb9a0ece3a44c5295d7e6c3e5c7c
BLAKE2b-256 a93d6b30982afe9b91e1ca597901b6323118a8858d296176781a80556593d437

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page