akiba-harvester

A CLI tool to harvest download links from the akiba-online.com Idol DVD & Bluray Downloads forum.

Install

pip install .

Usage

# Interactive mode — fuzzy search all threads, pick one, download links
akiba-harvester

# Search directly
akiba-harvester -s "minami hori"

# Show latest threads (fast, from RSS feed — no index needed)
akiba-harvester --latest

# Rebuild the thread index (scrapes all 1200+ forum pages)
akiba-harvester --refresh-index

# Config
akiba-harvester --config
akiba-harvester --set-download-dir ~/Downloads/IdolVideos
akiba-harvester --set-threads 8
akiba-harvester --set-max-pages 50   # only scrape first 50 pages (0 = all)
akiba-harvester --reset-config

How it works

1. Index building: Scrapes all forum listing pages (1200+) to build a local cache of every thread title and URL. Cached for 7 days.
2. Fuzzy search: Search the cached index interactively with a live fuzzy picker.
3. Link extraction: Opens the selected thread and extracts all filehost download links (FileJoker, KatFile, RapidGator, Mega, etc.) from the first post.
4. Download: Multi-threaded segmented download with resume support for direct links.

Notes

• Many filehost links (FileJoker, etc.) require a premium account on that filehost to download. The tool will attempt to download them directly; if the filehost requires authentication, it will fail gracefully.
• The RSS feed mode (--latest) is instant — it fetches the 20 most recent threads without needing to build the full index.