Skip to main content

MCP server for Xiaomi MiMo multimodal understanding (image, audio, video)

Project description

MiMo Multimodal Understanding MCP Server

MCP server for Xiaomi MiMo multimodal understanding API (image, audio, video).

Features

  • Image Understanding: Single/multiple images, URL and local file support
  • Audio Understanding: Single/multiple audio, URL and local file support
  • Video Understanding: Single/multiple video, URL and local file support, configurable fps and resolution

Setup

1. Install dependencies

uv sync

2. Configure API Key

Copy .env.example to .env and fill in your API key:

cp .env.example .env

Or set environment variable directly:

export MIMO_API_KEY=your_api_key_here

Get your API key from: https://platform.xiaomimimo.com

3. (Optional) Configure API Base URL

By default, the server uses https://api.xiaomimimo.com/v1. To use a different API endpoint:

export MIMO_API_BASE=https://your-custom-endpoint/v1

Or add it to your .env file:

MIMO_API_BASE=https://your-custom-endpoint/v1

Usage

Development mode (with MCP Inspector)

uv run mcp dev src/mimo_multimodal_mcp/server.py

Install to Claude Desktop

uv run mcp install src/mimo_multimodal_mcp/server.py

Direct execution

uv run python src/mimo_multimodal_mcp/server.py

Tools

understand_image

Analyze images using Xiaomi MiMo multimodal model.

Parameter Type Required Description
prompt string Yes Image understanding task description
image_url string No Single image URL or data:image base64
image_path string No Single local image file path
image_urls list[string] No Multiple image URLs
image_paths list[string] No Multiple local image file paths
system_prompt string No Custom system prompt
max_tokens integer No Max output length (default: 32768)

Supported formats: JPEG, PNG, GIF, WebP Size limit: 10MB

understand_audio

Analyze audio using Xiaomi MiMo multimodal model.

Parameter Type Required Description
prompt string Yes Audio understanding task description
audio_url string No Single audio URL
audio_path string No Single local audio file path
audio_urls list[string] No Multiple audio URLs
audio_paths list[string] No Multiple local audio file paths
system_prompt string No Custom system prompt
max_tokens integer No Max output length (default: 32768)

Supported formats: MP3, WAV, FLAC, M4A, OGG Size limit: URL 100MB, Base64 50MB

understand_video

Analyze video using Xiaomi MiMo multimodal model.

Parameter Type Required Description
prompt string Yes Video understanding task description
video_url string No Single video URL
video_path string No Single local video file path
video_urls list[string] No Multiple video URLs
video_paths list[string] No Multiple local video file paths
fps float No Frames per second, range [0.1, 10], default: 2
media_resolution string No Resolution: "default" or "max"
system_prompt string No Custom system prompt
max_tokens integer No Max output length (default: 32768)

Supported formats: MP4, MOV, AVI, WMV Size limit: URL 300MB, Base64 50MB

Examples

Image Understanding

# URL
await understand_image(prompt="Describe this image", image_url="https://example.com/image.jpg")

# Local file
await understand_image(prompt="What text is in this?", image_path="/path/to/screenshot.png")

# Multiple images
await understand_image(prompt="Compare these", image_urls=["url1", "url2"])

Audio Understanding

# URL
await understand_audio(prompt="Transcribe this audio", audio_url="https://example.com/audio.wav")

# Local file
await understand_audio(prompt="What is being said?", audio_path="/path/to/audio.mp3")

Video Understanding

# URL with default settings
await understand_video(prompt="Describe this video", video_url="https://example.com/video.mp4")

# URL with custom fps and resolution
await understand_video(
    prompt="Describe the action",
    video_url="https://example.com/video.mp4",
    fps=5.0,
    media_resolution="max"
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mimo_multimodal_mcp-0.3.0.tar.gz (73.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mimo_multimodal_mcp-0.3.0-py3-none-any.whl (5.9 kB view details)

Uploaded Python 3

File details

Details for the file mimo_multimodal_mcp-0.3.0.tar.gz.

File metadata

  • Download URL: mimo_multimodal_mcp-0.3.0.tar.gz
  • Upload date:
  • Size: 73.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for mimo_multimodal_mcp-0.3.0.tar.gz
Algorithm Hash digest
SHA256 14c75703c8fbbcd03b89128718740c2be4d11744ad898c1f5954a636a320aa80
MD5 94b651b86a060ca2ea648d0dbfed5cfe
BLAKE2b-256 39f8560d8e85029c70ef1bca8fceb9a9f52ee57c4eb9e35c195554ebfb93a5f4

See more details on using hashes here.

Provenance

The following attestation bundles were made for mimo_multimodal_mcp-0.3.0.tar.gz:

Publisher: publish.yml on ChanthMiao/MiMo-Multimodal-Understanding-MCP

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file mimo_multimodal_mcp-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mimo_multimodal_mcp-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 df88d211ae3a0be45aa448b17cea8ca3eee797cdb0436972bd4b0b8ae43a1337
MD5 00c08496c9dc918c89f7eaff193df69d
BLAKE2b-256 64f8bea8f46de3da1d46c9d5e7a16dd3551be28527e88c4cfb591e6c82742d77

See more details on using hashes here.

Provenance

The following attestation bundles were made for mimo_multimodal_mcp-0.3.0-py3-none-any.whl:

Publisher: publish.yml on ChanthMiao/MiMo-Multimodal-Understanding-MCP

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page