Skip to main content

VoxCPM TTS model with Apple Neural Engine backend server

Project description

VoxCPMANE

VoxCPM TTS model with Apple Neural Engine (ANE) backend server. CoreML models available in Huggingface repository.

  • 🎤 Voice Cloning: Support for custom voice prompts and cached voices
  • 📡 Streaming Support: Real-time audio streaming for low latency
  • 🎧 Server-side Playback: Direct audio playback on the server
  • 🌐 Web Interface: Interactive playground for testing

Voice Cloning

https://github.com/user-attachments/assets/02ffa400-b2fd-422e-a3ad-a0ea232a55aa

Included Voices Listen samples

https://github.com/user-attachments/assets/28880ed2-2e21-4eb4-b0ce-18a100403e87

Installation

Prerequisites

  • macOS with Apple Silicon for ANE acceleration
  • Python 3.9-3.12
  • uv package manager (recommended)
  • pydub required for audio formats other than wav in /speech endpoint

Install with pip or uv

uv pip install voxcpmane
pip install voxcpmane

The server will start on http://localhost:8000 by default. You can access the web playground at the root URL.

Configuration

Command Line Options

uv run voxcpmane-server --help
  • --host: Host to bind the server to (default: 0.0.0.0)
  • --port: Port to run the server on (default: 8000)
  • --cache-dir: Directory for custom voice caches (default: ~/.cache/ane_tts)

Custom Voices

You can create reusable cached voices in two ways:

  1. Via the Web Playground/API: Use the "Create Voice" tab or POST /v1/voices endpoint.
  2. Startup Compilation: Place pairs of audio files (e.g., .wav, .mp3) and transcriptions (.txt) in the custom cache directory. The server will automatically compile them into voice caches (.npy) on startup.

Example: If you place myvoice.mp3 and myvoice.txt in the cache directory, the server will generate myvoice.npy on start, making "myvoice" available for generation.

API Reference

The full API documentation is available in docs/API.md.

Changelog

Version 0.0.3

  • Added support for creation of custom voices

Roadmap

  • Automatic prompt caching
  • Chunked long audio generation
  • Custom voices

Acknowledgments

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

voxcpmane-0.0.5b2.tar.gz (36.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

voxcpmane-0.0.5b2-py3-none-any.whl (33.9 kB view details)

Uploaded Python 3

File details

Details for the file voxcpmane-0.0.5b2.tar.gz.

File metadata

  • Download URL: voxcpmane-0.0.5b2.tar.gz
  • Upload date:
  • Size: 36.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.7

File hashes

Hashes for voxcpmane-0.0.5b2.tar.gz
Algorithm Hash digest
SHA256 b8c480a06b0c1691e2938cafac02015d4fad134e8b3ca73925652f260d67880b
MD5 16a9962d7758a610b33cf5102dba8531
BLAKE2b-256 a763796d58336df743eaf4938e67dbc481e64d65ba4c731f37b8f8c8c1c72fc5

See more details on using hashes here.

File details

Details for the file voxcpmane-0.0.5b2-py3-none-any.whl.

File metadata

File hashes

Hashes for voxcpmane-0.0.5b2-py3-none-any.whl
Algorithm Hash digest
SHA256 e20f7299c4615ffe9109c0253b5639a434e9b0a0e8e8e75a2461523e1d8e0f9d
MD5 cc14c62ce644969b54a1c99e6716c1c7
BLAKE2b-256 c3dc5f274083d283a24f273a16b8fac1d0b235825c6756e6918075151927cbdf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page