genaiforgenews 0.1.0

AI-driven news aggregation: multi-source fetch, AI scoring, bilingual summaries (EN/HI), MCP server.

genaiforgenews

AI curates the tech news. You just read.

genaiforgenews collects news from multiple customizable sources, uses AI to score and filter them, and generates a daily briefing — complete with summaries, community discussions, and background explanations in English and/or Hindi.

📖 Live Demo · 📋 Configuration Guide · हिंदी

Screenshots

Daily Overview

News Detail

Terminal Output

Features

• 📡 Multi-Source Aggregation — Collects from Hacker News, RSS feeds, Reddit, Telegram channels, and GitHub (releases & user events)
• 🤖 AI-Powered Scoring — Uses Claude, GPT-4, Gemini, DeepSeek, Doubao, MiniMax, or any OpenAI-compatible API to rate each item 0-10, filtering out the noise
• 🌐 Bilingual Summaries — Generates daily reports in English and/or Hindi (hi in config)
• 🔍 Content Enrichment — Searches the web to provide background knowledge for unfamiliar concepts
• 💬 Community Voices — Collects and summarizes discussions from comments on HackerNews, Reddit, etc.
• 🔗 Cross-Source Deduplication — Merges duplicate items from different platforms automatically
• 📧 Email Subscription — Self-hosted newsletter system (SMTP/IMAP) that handles "Subscribe" requests automatically
• 📝 Static Site Generation — Deploys as a GitHub Pages site via GitHub Actions, updated on a schedule
• ⚙️ Fully Configurable — Single JSON config file, easy to customize sources, thresholds, and AI providers
• 🧙 Setup Wizard — Interactive CLI that recommends sources based on your interests, with a curated preset library open to community contributions

How It Works

              ┌──────────┐
              │ Hacker   │
┌─────────┐   │ News     │   ┌──────────┐   ┌──────────┐   ┌──────────┐
│  RSS    │──▶│ Reddit   │──▶│ AI Score │──▶│ Enrich   │──▶│ Summary  │
│ Telegram│   │ GitHub   │   │ & Filter │   │ & Search │   │ & Deploy │
└─────────┘   └──────────┘   └──────────┘   └──────────┘   └──────────┘
  Fetch from      Merge &        Score          Web search     Generate
  all sources    deduplicate     0-10 each      background     Markdown &
                                & filter        knowledge      deploy site

1. Fetch — Pull latest content from all configured sources concurrently
2. Deduplicate — Merge items pointing to the same URL across different platforms
3. Score — AI rates each item 0-10 based on technical depth, novelty, and impact
4. Filter — Keep only items above your configured threshold (default: 6.0)
5. Enrich — For high-scoring items, search the web for background context and collect community discussions
6. Summarize — Generate a structured Markdown report with summaries, tags, and references
7. Deploy — Optionally publish to GitHub Pages as a daily-updated static site

Quick Start

1. Install

Option A: From PyPI (quickest)

Install from PyPI and use a dedicated working directory (the app reads ./data/ and .env from your current folder):

pip install genaiforgenews
mkdir ~/my-genaiforgenews && cd ~/my-genaiforgenews
# Add API keys to .env (see .env.example in the repo)
genaiforgenews-wizard   # writes data/config.json
genaiforgenews

Full notes for pip users and maintainer publishing steps (build, TestPyPI, Twine) are in docs/PYPI.md.

Option B: Local installation (git clone)

git clone https://github.com/vikas972/genAINews.git
cd genAINews

# Install with uv (recommended)
uv sync

# Or with pip (editable)
pip install -e .

Option C: Docker

git clone https://github.com/vikas972/genAINews.git
cd genAINews

# Configure environment
cp .env.example .env
cp data/config.example.json data/config.json
# Edit .env and data/config.json with your API keys and preferences

# Run with Docker Compose
docker compose run --rm genaiforgenews

# Or run with custom time window
docker compose run --rm genaiforgenews --hours 48

2. Configure

Option A: Interactive wizard (recommended)

uv run genaiforgenews-wizard

The wizard asks about your interests (e.g. "LLM inference", "嵌入式", "web security") and auto-generates data/config.json from a curated preset library + optional AI recommendations.

Option B: Manual configuration

cp .env.example .env          # Add your API keys
cp data/config.example.json data/config.json  # Customize your sources

Here's what a config looks like:

{
  "ai": {
    "provider": "openai",       // or "anthropic", "gemini", "doubao", "minimax"
    "model": "gpt-4",
    "api_key_env": "OPENAI_API_KEY",
    "languages": ["en", "hi"]   // English + Hindi output
  },
  "sources": {
    "hackernews": { "enabled": true, "fetch_top_stories": 20, "min_score": 100 },
    "rss": [
      { "name": "Simon Willison", "url": "https://simonwillison.net/atom/everything/" }
    ],
    "reddit": {
      "subreddits": [{ "subreddit": "MachineLearning", "sort": "hot" }],
      "fetch_comments": 5
    },
    "telegram": {
      "channels": [{ "channel": "zaihuapd", "fetch_limit": 20 }]
    }
  },
  "filtering": {
    "ai_score_threshold": 6.0,
    "time_window_hours": 24
  }
}

For the full reference, see the Configuration Guide.

3. Run

Local Installation

uv run genaiforgenews           # Run with default 24h window
uv run genaiforgenews --hours 48  # Fetch from last 48 hours

With Docker

docker compose run --rm genaiforgenews           # Run with default 24h window
docker compose run --rm genaiforgenews --hours 48  # Fetch from last 48 hours

The generated report will be saved to data/summaries/.

4. Automate (Optional)

genaiforgenews works great as a GitHub Actions cron job. See .github/workflows/daily-summary.yml for a ready-to-use workflow that generates and deploys your daily briefing to GitHub Pages automatically.

Supported Sources

Source	What it fetches	Comments
Hacker News	Top stories by score	Yes (top N comments)
RSS / Atom	Any RSS or Atom feed	—
Reddit	Subreddits + user posts	Yes (top N comments)
Telegram	Public channel messages	—
GitHub	User events & repo releases	—

MCP Integration

genaiforgenews ships with a built-in MCP server so AI assistants can drive the pipeline programmatically.

# Start the MCP server (stdio mode)
uv run genaiforgenews-mcp

Available tools include hz_validate_config, hz_fetch_items, hz_score_items, hz_filter_items, hz_enrich_items, hz_generate_summary, and hz_run_pipeline.

See src/mcp/README.md for the full tool reference and src/mcp/integration.md for client setup.

Roadmap

• Multi-source aggregation (HN, RSS, Reddit, Telegram, GitHub)
• AI scoring with multiple providers
• Bilingual summary generation (EN/HI)
• Web search for background enrichment
• Community discussion collection
• GitHub Pages deployment
• Email Subscription (SMTP/IMAP automated newsletter)
• Docker deployment support
• MCP server integration
• Web UI dashboard
• Setup Wizard — interactive CLI that recommends sources based on user interests
• Improved Web UI — better digest and article detail experience
• Slack / Webhook notification
• More source types (Twitter/X, Discord, etc.)
• Custom scoring prompts per source

Contributing

Contributions are welcome! Feel free to open issues or submit pull requests.

Contribute Source Presets

genaiforgenews's setup wizard uses a community-maintained preset library to recommend sources. We'd love your help expanding it!

1. Fork this repo
2. Add your sources to data/presets.json (provide both English and Hindi description / description_hi where useful)
3. Submit a PR

Great candidates: niche RSS feeds, active subreddits, notable GitHub accounts, or Telegram channels in your area of expertise.

Acknowledgements

• Special thanks to LINUX.DO for providing a promotion platform.
• Special thanks to HelloGitHub for valuable guidance and suggestions.

License

MIT