Skip to main content

YouTube transcripts to RAG-ready volumes

Project description

ytrag

YouTube transcripts → RAG-ready volumes.

Download YouTube subtitles and consolidate them into LLM-ready volumes.

Quick Start

# Install from PyPI
pipx install ytrag

# Download and process a YouTube channel
ytrag all "https://youtube.com/@ChannelName"

That's it! The transcripts will be cleaned and organized into volumes ready for use with LLMs.

Installation

With pipx (recommended)

pipx install ytrag

With pip

pip install ytrag

From Source

git clone https://github.com/chakkyy/ytrag.git
cd ytrag
pip install .

Usage

# Process a YouTube channel
ytrag all "https://youtube.com/@ChannelName"

# Process a single video
ytrag all "https://www.youtube.com/watch?v=dQw4w9WgXcQ"

# Process a playlist
ytrag all "https://www.youtube.com/playlist?list=PLxxxxxxx"

Options

# Specify languages (default: auto-detect from video)
ytrag all "https://..." --lang es,en,pt

# Custom output directory
ytrag all "https://..." --output ./my-transcripts

# Adjust transcripts per volume (default: 50)
ytrag all "https://..." --per-volume 50

# Rebuild outputs from an existing folder of .vtt subtitle files
ytrag rebuild "./ChannelName" "Channel Name"

# Slow down large channel downloads to avoid YouTube rate limits
ytrag all "https://..." --sleep-interval 15 --max-sleep-interval 30

# Check status of current directory
ytrag status

# Show version
ytrag --version

Output Structure

After running ytrag all, your directory will look like:

./
└── ytrag-ChannelName/
    ├── raw-subtitles/             # Downloaded .vtt subtitle files
    ├── clean-transcripts/         # One cleaned .md transcript per video
    ├── rag-volumes/               # NotebookLM/RAG-ready volumes only
    │   ├── ChannelName_Vol01.txt
    │   └── ChannelName_Vol02.txt
    ├── manifest.json              # Metadata
    └── .ytrag_archive             # Resume tracking

Each volume contains cleaned, consolidated transcripts ready for use with LLMs and RAG systems.

Features

  • Simple: One command does everything
  • Auto language detection: Defaults to video's original language
  • Resume support: Re-run to continue where you left off
  • Clear progress: Shows current/total videos and ETA while downloading large channels
  • Accurate channel counts: Channel root URLs automatically target the Videos tab
  • NotebookLM-friendly volumes: Smaller default volumes and a dedicated rag-volumes folder
  • Smart deduplication: Skips regional variants (en-US if en exists)
  • Adaptive rate limiting: Automatically handles YouTube rate limits
  • Clean output: No intermediate files, just the volumes you need

Requirements

  • Python 3.10+

Troubleshooting

"No subtitles found"

Some videos don't have subtitles enabled. Try:

  • Using --lang with different language codes
  • Auto-generated subtitles are downloaded by default

Rate limiting errors

YouTube may rate-limit large channel downloads. ytrag uses conservative delays by default and retries extractor failures with exponential backoff. If YouTube still rate-limits the session, failed videos are not added to .ytrag_archive; run the same command again later and ytrag will retry the missing videos.

Useful controls:

ytrag all "https://..." \
  --sleep-interval 15 \
  --max-sleep-interval 30 \
  --stop-after-errors 3

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ytrag-2.2.0.tar.gz (25.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ytrag-2.2.0-py3-none-any.whl (15.4 kB view details)

Uploaded Python 3

File details

Details for the file ytrag-2.2.0.tar.gz.

File metadata

  • Download URL: ytrag-2.2.0.tar.gz
  • Upload date:
  • Size: 25.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ytrag-2.2.0.tar.gz
Algorithm Hash digest
SHA256 f180fc18dbefc5422692559dd3650038b8195a472d0b2076daa6c798bf30dac4
MD5 6b2aa5a3f607922c8e26fe5511285328
BLAKE2b-256 244b5173cdbc696a11dccfca206c4186da540f794f8f52fd09e227c9f3f71240

See more details on using hashes here.

File details

Details for the file ytrag-2.2.0-py3-none-any.whl.

File metadata

  • Download URL: ytrag-2.2.0-py3-none-any.whl
  • Upload date:
  • Size: 15.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ytrag-2.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 bac60f32339adbad2443391af41269001d2c53764ef2dcb061eab0e18ffe324f
MD5 da7022524c43af8f67ce877bc63848fb
BLAKE2b-256 27c92bc7404503c76792278a609fab94795267d20a347a0c24c6515a07ebc6da

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page