Skip to main content

An agentic Python package that converts ideas and documents into audio – PDF papers, reports, and regulations turned into podcast-style audio files.

Project description

audia — turn your ideas into audio

Python 3.10+ License: MIT PyPI version PyPI Downloads Tests Coverage GitHub last commit

audia is an agentic Python package that converts PDFs — academic papers, reports, regulations — into podcast-style audio files. It uses an LLM to rewrite content into natural spoken language (math in plain English, tables as sentences, no citations) before passing it to a TTS engine, so the result actually sounds good when read aloud.

The audia CLI

Features

  • LLM-curated text — mandatory LLM pass rewrites math notation, condenses tables and acknowledgements, removes citation artefacts, and ensures smooth spoken flow
  • Chunk-level stitching — long documents are split at paragraph boundaries; each chunk receives the tail of the previous curated output as transition context
  • ArXiv research — search papers by query and convert them to audio in one command
  • Voice input (STT) — record a spoken query to trigger an ArXiv search
  • Multiple TTS backendsedge-tts (default, free), kokoro (local), or OpenAI TTS
  • Multiple LLM backends — OpenAI (gpt-4o-mini default) or Anthropic
  • CLIaudia convert, research, listen, serve, info
  • Web UI — FastAPI backend + SPA frontend
  • Local storage — SQLite database for papers and audio files via SQLAlchemy
  • Debug output — every run saves raw, preprocessed, and curated text to ~/.audia/debug/<run_id>/

Tech Stack

Backend

  • Python 3.10+ — package language
  • FastAPI — backend for the web UI
  • LangGraph — agentic pipeline orchestration (PDF → preprocess → LLM curate → TTS)
  • LangChain — LLM abstraction
    • Current support for LLMs from Anthropic, Google, and OpenAI
  • edge-tts — default TTS backend, no API key required
  • faster-whisper — STT for voice input
  • PyMuPDF — PDF text extraction
  • SQLite — local database for papers and audio files

Frontend

  • React — interactive frontend
  • Vite — fast dev server and production bundler
  • Tailwind CSS — utility-first styling
  • TypeScript — type-safe component and API code

CLI

  • Typer + Rich — CLI with coloured progress output

Packaging

  • PyPI — distributed as an installable Python package

Installation

pip install audia

For CLI usage, pipx is recommended — it installs audia in an isolated environment while exposing the command globally:

pipx install audia

Optional extras:

Extra Installs
kokoro local Kokoro TTS
pip install "audia[kokoro]"

Configuration

Copy .env.example to .env in your working directory and set your API key:

cp .env.example .env

Minimum required settings:

AUDIA_LLM_PROVIDER=openai           # or anthropic
AUDIA_OPENAI_API_KEY=sk-...

All settings use the AUDIA_ prefix. Run audia info to see the active configuration.

Quick Start

Show active configuration:

audia info

Convert a local PDF:

audia convert paper.pdf

Convert multiple PDFs to a specific output folder:

audia convert paper1.pdf paper2.pdf --output ~/audiobooks

Search ArXiv and convert the top results:

audia research "retrieval augmented generation" --max-results 3 --convert

Start the web UI:

audia serve
# → http://localhost:8000

The audia UI

Pipeline

The pipeline can be entered in three ways:

Entry point Command
Voice input audia listen — record speech, LLM distils a search query, confirm, then runs the full pipeline
Text query audia research "retrieval augmented generation" — search ArXiv by text, select papers, run pipeline
Local PDF audia convert paper.pdf — skip Steps 0, go straight to extraction

When starting from voice or text, the full five-step LangGraph pipeline runs. For local PDFs, Steps 1–4 run directly:

 [voice input]          [text query]
      │                      │
      ▼                      │
  Microphone                 │
  (faster-whisper STT)       │
      │                      │
      ▼                      │
  LLM query distillation     │        ← extracts concise ArXiv search terms
      │                      │           from natural speech
      ▼                      │
  Confirm / re-record?       │
      │  yes                 │
      ▼                      ▼
Step 0 — ArXiv search    (or use local PDF)
 │        arxiv API: fetch metadata, download PDF
 │
 ▼
Step 1 — PDF extraction       PyMuPDF: text + metadata per page
 │
 ▼
Step 2 — Heuristic pre-pass   Regex: strip citations, LaTeX commands, figure captions
 │
 ▼
Step 3 — LLM curation         Chunked LLM pass: math → English, tables → sentences,
 │                             smooth spoken transitions between chunks
 ▼
Step 4 — TTS synthesis        edge-tts (or kokoro / OpenAI): split into ~3800-char
                               chunks, synthesise, concatenate → .mp3

Output files for a run on 2025_Xu+.pdf:

~/.audia/audio/2025_Xu+_20260329_084445.mp3
~/.audia/debug/2025_Xu+_20260329_084445/
    1_raw.txt            ← PyMuPDF output
    2_preprocessed.txt   ← after heuristic pass
    3_curated.txt        ← after LLM curation

Contributing

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/my-change)
  3. Make your changes
  4. Run the test suite: pytest --cov=src --cov-report=term-missing
  5. Submit a pull request

License

MIT — see LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

audia-0.4.3.tar.gz (148.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

audia-0.4.3-py3-none-any.whl (141.0 kB view details)

Uploaded Python 3

File details

Details for the file audia-0.4.3.tar.gz.

File metadata

  • Download URL: audia-0.4.3.tar.gz
  • Upload date:
  • Size: 148.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for audia-0.4.3.tar.gz
Algorithm Hash digest
SHA256 e45b500eae279042e11e5f4a0353edd81eae80216ecc33573802736d204a3fe1
MD5 3255852ed977e00e7c30fd0b649fdfbd
BLAKE2b-256 05ae0716f0b5c3cd06fe98b974ef880054a3ac8d5001a808c739890e04b1c67e

See more details on using hashes here.

File details

Details for the file audia-0.4.3-py3-none-any.whl.

File metadata

  • Download URL: audia-0.4.3-py3-none-any.whl
  • Upload date:
  • Size: 141.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for audia-0.4.3-py3-none-any.whl
Algorithm Hash digest
SHA256 66b650359cdbafbd214b6197fe8177204948fa8b0a2bd5e8392214625a4beafc
MD5 88736a3fafd91a4e91457452f150a8ed
BLAKE2b-256 87a42ca0bc72a04c0e529eec525078cf05b19ca68fd09d3a5949400e2fd12a75

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page