Skip to main content

pipecat

PyPI Tests codecov Docs Discord Ask DeepWiki

🎙️ Pipecat: Real-Time Voice & Multimodal AI Agents

Pipecat is an open-source Python framework for building real-time voice and multimodal conversational agents. Build a single voice agent or a full multi-agent system where specialists hand off, fan out in parallel, and coordinate over a shared bus, locally or distributed across processes and machines. Orchestrate audio and video, AI services, transports, and conversation pipelines effortlessly, so you can focus on what makes your agents unique.

Want to dive right in? Run pipecat init quickstart or follow the quickstart guide.

🚀 What you can build

  • Voice Assistants – natural, streaming conversations with AI
  • Multi-Agent Systems – specialists that hand off, fan out in parallel, or run as sidecars over a shared bus
  • AI Companions – coaches, meeting assistants, characters
  • Multimodal Interfaces – voice, video, images, and more
  • Interactive Storytelling – creative tools with generative media
  • Business Agents – customer intake, support bots, guided flows
  • Complex Dialog Systems – design logic with structured conversations

🧠 Why Pipecat?

  • Voice-first: Integrates speech recognition, text-to-speech, and conversation handling
  • Pluggable: Supports many AI services and tools
  • Composable Pipelines: Build complex behavior from modular components
  • Multi-Agent Ready: Each pipeline is an agent. Compose them with handoff, parallel fan-out, sidecar workers, or distributed deployments
  • Real-Time: Ultra-low latency interaction with different transports (e.g. WebSockets or WebRTC)

🌐 Pipecat ecosystem

📱 Client SDKs

Building client applications? You can connect to Pipecat from any platform using our official SDKs:

JavaScript | React | React Native | Swift | Kotlin | C++ | ESP32

🧭 Structured conversations

Need predefined or dynamic conversation paths with state management? Pipecat Flows is built into Pipecat. Browse the examples to see it in action.

🪄 Beautiful UIs

Want to build beautiful and engaging experiences? Check out Pipecat UI, a shadcn registry of components for building voice AI applications. Browse the documentation for component previews and installation guides.

🛠️ Create and deploy projects

The Pipecat CLI ships with pipecat-ai — install it with uv tool install "pipecat-ai[cli]". Run pipecat init to start a project: it sets you up so an AI coding assistant (Claude Code, Codex) builds it for you, and can scaffold a runnable bot in under a minute. Then use the CLI to monitor and deploy your agent to production.

🔍 Debugging

Looking for help debugging your pipeline and processors? Check out Whisker, a real-time Pipecat debugger.

🖥️ Terminal

Love terminal applications? Check out Tail, a terminal dashboard for Pipecat.

🤖 Claude Code skills

Use Pipecat Skills with Claude Code to scaffold projects, deploy to Pipecat Cloud, and more. Install the marketplace with:

claude plugin marketplace add pipecat-ai/skills

and install any of the available plugins.

🧩 Community integrations

Build and share your own Pipecat service integrations! Browse existing community integrations or check out our guide to create your own.

📺️ Pipecat TV channel

Catch new features, interviews, and how-tos on our Pipecat TV channel.

🎬 See it in action

Example What it shows
📞 Phone agent Answers incoming calls and places outbound calls. Examples for Twilio, Telnyx, Plivo, Exotel, Vonage, Genesys and Daily PSTN and SIP.
🧠 Voice LLM with a tool-calling backend LLMWithBackend pairs a fast voice model with a slower backend model that runs the tools, and the voice keeps talking while the backend works.
🎭 Expressive conversation The LLM writes emotion and sound tags such as laughter into its replies, and the TTS performs them. The tags follow the Real-time Context Standard, with examples for ten TTS providers.
🔢 IVR navigation IVRNavigator dials out and works through a phone menu with DTMF keypad tones and speech until it reaches a person.
🍽️ Pipecat Flows: restaurant reservation A booking conversation defined in YAML, where FlowManager moves through each step and branches on table availability.
📝 Multi-agent UI control A UIWorker lets voice commands read and act on a web page, and runs two reviewer agents in parallel as a job group.

🧩 Available services

Category Services
Speech-to-Text AssemblyAI, AWS, Azure, Cartesia, Deepgram, ElevenLabs, Fal Wizper, FunASR, Gladia, Google, Gradium, Groq (Whisper), Meta, Mistral, Moonshine, NVIDIA, OpenAI (Whisper), Rime, Sarvam, Soniox, Speechmatics, Together, Whisper, xAI, Zoom
LLMs Anthropic, AWS, Azure, Baseten, Cerebras, Crusoe, DeepSeek, Fireworks AI, Gemini, Grok, Groq, Inception, Mistral, Nebius, Novita, NVIDIA NIM, Ollama, OpenAI, OpenAI Responses, OpenRouter, Perplexity, Qwen, SambaNova, Sarvam, Smallest, Together AI
Text-to-Speech AssemblyAI, Async, AWS, Azure, Bland, Camb AI, Cartesia, Deepgram, ElevenLabs, Fish, Google, Gradium, Groq, HeyGen, Inworld, Kokoro, MiniMax, Mistral, Neuphonic, NVIDIA, OpenAI, Piper, Resemble, Rime, Sarvam, Smallest, Soniox, Speechify, Speechmatics, Together, xAI, XTTS
Speech-to-Speech AWS Nova Sonic, Azure Voice Live, Gemini Multimodal Live, Grok Voice Agent, OpenAI Realtime, Ultravox, Zoom AI Voice Agent
Transport Daily (WebRTC), FastAPI Websocket, LiveKit (WebRTC), SmallWebRTCTransport, Vonage (WebRTC), WebSocket Server, WhatsApp, Local
Serializers Exotel, Genesys, Plivo, Twilio, Telnyx, Vonage
Video HeyGen, LemonSlice, Tavus, Simli
Classifiers Cloudflare Clef, Hume Audio, OpenAI Decisions, Typesafe Jev
Memory mem0
Vision & Image fal, Google, Moondream
Audio Processing Silero VAD, Krisp Viva, Koala, ai-coustics, RNNoise
Analytics & Metrics OpenTelemetry, Sentry
Community Browse community integrations →

📚 View full services documentation →

⚡ Getting started

Run Pipecat on your local machine, then move your agent processes to the cloud when you're ready. Either way, you'll need uv — install it first:

curl -LsSf https://astral.sh/uv/install.sh | sh

Start a new project with the CLI

The quickest path: install the Pipecat CLI and scaffold a new phone or web/mobile bot interactively.

uv tool install "pipecat-ai[cli]"
pipecat init

Follow the quickstart guide to get your very first bot running, or dive a little deeper into bootstrapping a project.

Add to an existing project

uv add pipecat-ai

To keep things lightweight, only the core framework is included by default. Add extras for the third-party AI services you use:

uv add "pipecat-ai[option,...]"

Using pip? pip install pipecat-ai and pip install "pipecat-ai[option,...]" work too.

Pipecat runs on Python 3.11 through 3.14. Python 3.15 is not supported yet, because onnxruntime publishes no wheels for it. Pin your project to a supported version, for example with uv python pin 3.14.

From here, the code examples below are the best way to learn — agents you can run, read, and adapt.

🧪 Code examples

  • Focused examples — small agents that each illustrate one or two specific services or concepts
  • Example apps — complete applications you can use as starting points for development

🛠️ Developing Pipecat

Prerequisites

Minimum Python Version: 3.11 Recommended Python Version: >= 3.12

Setup steps

  1. Clone the repository and navigate to it:

    git clone https://github.com/pipecat-ai/pipecat.git
    cd pipecat
    
  2. Install development and testing dependencies:

    uv sync --group dev --all-extras \
      --no-extra gstreamer \
      --no-extra local
    
  3. Install the git pre-commit hooks:

    uv run pre-commit install
    

Note: Some extras (local, gstreamer) require system dependencies. See documentation if you encounter build errors.

Claude Code skills

Install development workflow skills for contributing to Pipecat with Claude Code:

claude plugin marketplace add pipecat-ai/pipecat
claude plugin install pipecat-dev@pipecat-dev-skills

Running tests

To run all tests, from the root directory:

uv run pytest

Tests run in parallel, one worker per CPU core. Pass -n 0 to run them in a single process.

Run a specific test suite:

uv run pytest tests/test_name.py

🤝 Contributing

We welcome contributions from the community! Whether you're fixing bugs, improving documentation, or adding new features, here's how you can help:

  • Found a bug? Open an issue
  • Have a feature idea? Start a discussion
  • Want to contribute code? Check our CONTRIBUTING.md guide
  • Documentation improvements? Docs PRs are always welcome

Before submitting a pull request, please check existing issues and PRs to avoid duplicates.

We aim to review all contributions promptly and provide constructive feedback to help get your changes merged.

🛟 Getting help

➡️ Join our Discord

➡️ Read the docs

➡️ Reach us on X

➡️ Enterprise support for consulting and support agreements

Metadata

Release files for pipecat-ai 1.16.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pipecat-ai 1.16.0
File Size Uploaded Provenance Actions
pipecat_ai-1.16.0.tar.gz 13.7 MB With provenance Details for pipecat_ai-1.16.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for pipecat-ai 1.16.0
File Interpreter ABI Platform Actions
pipecat_ai-1.16.0-py3-none-any.whl Python 3 none any Details for pipecat_ai-1.16.0-py3-none-any.whl

Total release size: 26.1 MB

Release files / pipecat_ai-1.16.0.tar.gz

Download URL pipecat_ai-1.16.0.tar.gz
Size 13.7 MB
Tags Source
SHA-256 checksum
How to use checksums
1598e0a3557ff38bdde93ba1e42a668708b911a5f1efa9960141b033963f51c5
BLAKE2b-256 checksum
How to use checksums
be37f8349ba153e78aaf25ac7613ef59701acc8d9ecb7bdedd18654fadc69371
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 12, 2026.

Transparency log

Release files / pipecat_ai-1.16.0-py3-none-any.whl

Download URL pipecat_ai-1.16.0-py3-none-any.whl
Size 12.4 MB
Tags Python 3
SHA-256 checksum
How to use checksums
613604ec4c6bb4301a26004e80011765c1a18d92394994097a65df07fbf1916d
BLAKE2b-256 checksum
How to use checksums
716701f9b6a635a5a517436cfdcb1f1e8fda4e0bc5dd00c111b27e19a757e604
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 12, 2026.

Transparency log

Security for pipecat-ai 1.16.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for pipecat_ai-1.16.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 12, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.16.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page