Skip to main content

YouTube transcripts to RAG-ready volumes

Project description

ytrag

YouTube transcripts → RAG-ready volumes.

Download YouTube subtitles and consolidate them into LLM-ready volumes.

Quick Start

# Install from PyPI
pipx install ytrag

# Download and process a YouTube channel
ytrag all "https://youtube.com/@ChannelName"

That's it! The transcripts will be cleaned and organized into volumes ready for use with LLMs.

Installation

With pipx (recommended)

pipx install ytrag

With pip

pip install ytrag

From Source

git clone https://github.com/chakkyy/ytrag.git
cd ytrag
pip install .

Usage

# Process a YouTube channel
ytrag all "https://youtube.com/@ChannelName"

# Process a single video
ytrag all "https://www.youtube.com/watch?v=dQw4w9WgXcQ"

# Process a playlist
ytrag all "https://www.youtube.com/playlist?list=PLxxxxxxx"

Options

# Specify languages (default: auto-detect from video)
ytrag all "https://..." --lang es,en,pt

# Custom output directory
ytrag all "https://..." --output ./my-transcripts

# Target a source limit for NotebookLM (default: 50, Plus can use 100)
ytrag all "https://..." --target-volumes 100

# Advanced override: fixed transcripts per volume
ytrag all "https://..." --per-volume 50

# Prefer a language for download and deduplication
ytrag all "https://..." --lang es

# Rebuild outputs from an existing folder of .vtt subtitle files
ytrag rebuild "./ChannelName" "Channel Name" --target-volumes 100

# Slow down large channel downloads to avoid YouTube rate limits
ytrag all "https://..." --sleep-interval 15 --max-sleep-interval 30

# Check status of current directory
ytrag status

# Show version
ytrag --version

Output Structure

After running ytrag all, your directory will look like:

./
└── ytrag-ChannelName/
    ├── raw-subtitles/             # Downloaded .vtt subtitle files
    ├── clean-transcripts/         # One cleaned .md transcript per video
    ├── rag-volumes/               # NotebookLM/RAG-ready volumes only
    │   ├── ChannelName_Vol01.txt
    │   └── ChannelName_Vol02.txt
    ├── manifest.json              # Metadata
    └── .ytrag_archive             # Resume tracking

Each volume contains cleaned, consolidated transcripts ready for use with LLMs and RAG systems.

raw-subtitles/ is only created when --keep-raw is used. By default ytrag keeps the cleaned transcripts and RAG-ready volumes.

Features

  • Simple: One command does everything
  • Auto language detection: Defaults to video's original language
  • Resume support: Re-run to continue where you left off
  • Clear progress: Shows current/total videos and ETA while downloading large channels
  • Accurate channel counts: Channel root URLs automatically target the Videos tab
  • NotebookLM-friendly volumes: Smaller default volumes and a dedicated rag-volumes folder
  • Citable source markers: Repeats video/date markers throughout transcripts so NotebookLM hovers show useful context
  • Language-aware deduplication: Honors --lang, otherwise prefers the majority subtitle language
  • Smart deduplication: Skips regional variants (en-US if en exists)
  • Adaptive rate limiting: Automatically handles YouTube rate limits
  • Clean output: No intermediate files, just the volumes you need

Requirements

  • Python 3.10+

Troubleshooting

"No subtitles found"

Some videos don't have subtitles enabled. Try:

  • Using --lang with different language codes
  • Auto-generated subtitles are downloaded by default

Rate limiting errors

YouTube may rate-limit large channel downloads. ytrag uses conservative delays by default and retries extractor failures with exponential backoff. If YouTube still rate-limits the session, failed videos are not added to .ytrag_archive; run the same command again later and ytrag will retry the missing videos.

Useful controls:

ytrag all "https://..." \
  --sleep-interval 15 \
  --max-sleep-interval 30 \
  --stop-after-errors 3

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ytrag-2.3.0.tar.gz (28.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ytrag-2.3.0-py3-none-any.whl (17.4 kB view details)

Uploaded Python 3

File details

Details for the file ytrag-2.3.0.tar.gz.

File metadata

  • Download URL: ytrag-2.3.0.tar.gz
  • Upload date:
  • Size: 28.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ytrag-2.3.0.tar.gz
Algorithm Hash digest
SHA256 753fb5e97d370d15eb0457f3282a71ccd14b53b9dcd6425ab00e996562036c7e
MD5 05a1d616ae5093c155a1a7689452d5c8
BLAKE2b-256 fdc8e2719c22903b6ad851f32ea264f1de08651d51c663f8da8ba1763f614749

See more details on using hashes here.

File details

Details for the file ytrag-2.3.0-py3-none-any.whl.

File metadata

  • Download URL: ytrag-2.3.0-py3-none-any.whl
  • Upload date:
  • Size: 17.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for ytrag-2.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 fa95db1f001b213908beb45c551350a37c9d34fe5c650f7a74dc257193263fb5
MD5 eefdee2196da25a84bb82f47f11d0b73
BLAKE2b-256 d2eeab360aa07aefc0346e37eb3a80ccd22bf8ca27403eead3bd9ffbf6b9cbc4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page