Skip to main content

Deep Web Research Tool - Auto-classifies topics, prioritizes relevant sources, generates 300+ word AI conclusions

Project description

ACHEM - Deep Web Research Tool

ACHEM Banner

ACHEM (Arabic: آشم) is an intelligent research tool that automatically classifies your query, finds relevant specialized sources, and generates comprehensive 300+ word AI conclusions.

Features

Smart Topic Classification

Automatically detects your query type and prioritizes relevant sources:

Topic Priority Sites
Anime & Manga MyAnimeList, Crunchyroll, Anime News Network
Football/Soccer The Analyst, ESPN, Sky Sports, Goal.com
MMA/Fighting Tapology, Sherdog, MMA Junkie
Gaming IGN, GameSpot, Metacritic, Steam
Movies/TV IMDb, Rotten Tomatoes, Metacritic
Health/Medicine Mayo Clinic, WebMD, WHO
Science Scientific American, Nature, NASA
Technology Stack Overflow, GitHub, TechCrunch
History Britannica, History.com

Comprehensive Research

  • 100+ Sources: Searches DuckDuckGo with topic-prioritized results
  • Full Content Extraction: Scrapes complete articles from specialized sites
  • Smart Filtering: Removes ads/boilerplate, keeps relevant content
  • 300+ Word Conclusions: Detailed AI-generated analysis

How Results Are Sorted

Results are sorted by relevance:

  1. Most relevant sources for your topic first
  2. Specialized sites for your query type
  3. General sources last

Installation

git clone https://github.com/sarok-exe/achem.git
cd achem
uv venv .venv && source .venv/bin/activate
uv pip install -e .

API Configuration

Create ~/.ACHEM/api.env:

OPENROUTER_API_KEY=your_openrouter_key_here
OPENROUTER_MODEL=google/gemma-4-31b-it:free

Get API key: https://openrouter.ai/settings

Usage

achem "What are the health risks of smoking?" --ddg-limit 50
achem "Who will win Bayern vs Real Madrid?" --ddg-limit 100
achem "Latest One Piece chapter summary" --ddg-limit 50

Options

--ddg-limit N     Number of sources (default: 100)
--mode ai         AI conclusions (default)
--mode local      Local TF-IDF (no API)
--lang en/fr/ar   Response language

How It Works

┌──────────────────────────────────────────────────────┐
│ 1. CLASSIFY                                          │
│    Detects topic: anime, football, health, etc.       │
│    Identifies priority sites for your topic           │
├──────────────────────────────────────────────────────┤
│ 2. SEARCH (100+ sources)                             │
│    Prioritizes specialized sites                      │
│    Sorts by topic relevance                          │
├──────────────────────────────────────────────────────┤
│ 3. SCRAPE                                            │
│    Extracts full article text                        │
│    Removes ads and boilerplate                       │
├──────────────────────────────────────────────────────┤
│ 4. ANALYZE & CONCLUDE                                │
│    Generates 300+ word comprehensive analysis        │
│    Synthesizes all sources into detailed paragraphs  │
└──────────────────────────────────────────────────────┘

Output

Reports saved to ~/Documents/ACHEM/:

  • AI Conclusion: 300+ word detailed analysis
  • All Articles: Full extracted content
  • Topic Classification: Shows detected category

License

MIT License

Acknowledgments

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

achem-1.2.0.tar.gz (52.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

achem-1.2.0-py3-none-any.whl (62.7 kB view details)

Uploaded Python 3

File details

Details for the file achem-1.2.0.tar.gz.

File metadata

  • Download URL: achem-1.2.0.tar.gz
  • Upload date:
  • Size: 52.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for achem-1.2.0.tar.gz
Algorithm Hash digest
SHA256 9f33b092c2fe93d9dedc378dc5a47d3a0d79fac390ecbebb2c13f69e96a02382
MD5 ad266788e796195f2b008071406d9dd2
BLAKE2b-256 57291b1c5d7b4f0064f4a2171f8ec4c42cd9b7aace271bd3bc1b143331cadc86

See more details on using hashes here.

Provenance

The following attestation bundles were made for achem-1.2.0.tar.gz:

Publisher: release.yml on sarok-exe/achem

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file achem-1.2.0-py3-none-any.whl.

File metadata

  • Download URL: achem-1.2.0-py3-none-any.whl
  • Upload date:
  • Size: 62.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for achem-1.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5969a6865cb70757fcff84c780a76957722bb3a85b39497b44536490b24257d5
MD5 eb7b7e9b16f5145c63f0cc70c56b2e11
BLAKE2b-256 6661b307d78c5c209245132d99a7f442f046c5aedd09c6ccecf2309d0d4dfcef

See more details on using hashes here.

Provenance

The following attestation bundles were made for achem-1.2.0-py3-none-any.whl:

Publisher: release.yml on sarok-exe/achem

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page