WebTools CLI
try :
WebTools CLI is an advanced web intelligence suite for researchers, OSINT enthusiasts, and developers. It brings the power of deep web analysis and automated scraping directly into your terminal.
🚀 Why WebTools CLI?
- 🎯 Stealth & Speed: Smart proxy rotation and Turbo-Fetch logic for evasion and performance.
- 🧠 AI-Powered: Automated content summarization, sentiment analysis, and readability scoring.
- ☁️ Cloud-Native: Integrated Mega.nz storage for seamless media backups and file management.
- 🔧 Security-Centric: Built-in honeypot detection, threat leveling, and image forensic analysis.
- 💻 Terminal-First: Designed for power users who live in the command line.
- 🛡️ Cross-Platform: Works seamlessly on Windows, Linux, and macOS (with auto-download for Windows tunnels).
- 🔌 SPA Ready: Automatic Playwright fallback for JavaScript-heavy sites like LinkedIn/Instagram.
📦 Installation
See the installation guide for recommended system specifications.
Quick Install
Install globally via pip:
pip install webtools-cli
To upgrade to the latest version:
pip install webtools-cli --upgrade
📋 Key Features
Advanced Scraping & Stealth
- Smart Proxy Rotation: Automatically rotates User-Agents and Proxies to evade detection.
- Turbo-Fetch: Parallel chunk downloads for large media (Videos/Images).
- Mega Cloud Drive: Native integration with Mega.nz for multi-account storage and file management.
- One-Click Save: Instantly save scraped images and videos directly to your cloud storage.
- Deep Crawl: Recursive link mapping up to 3 levels deep.
- Headless Fallback: Integrated Playwright support for auth-walled or SPA environments.
Intelligence & Security Analysis
- OSINT Toolkit: Auto-extract emails, phones, locations, social media, and tech stacks.
- SEO Auditor: Page score, heading hierarchy, link integrity, and image alt-text auditing.
- Image Forensics: CLI-based Error Level Analysis (ELA) and AI-likelihood detection.
- Honeypot Detector: Identifies hidden traps and anti-bot measures (Cloudflare/CAPTCHAs).
AI Generation & Creative Tools
- ComfyUI Integration: Seamlessly launch a full Stable Diffusion interface directly from the CLI.
- Anime Studio (Anima): Specialized "Make Anime" mode with automated Anima model downloads (UNET, Text Encoder, VAE) from Hugging Face.
- Colab Optimized: Pre-configured for Google Colab with T4 GPU support and automated environment setup.
- Secure Tunnels: Instant Cloudflare tunnel generation for remote UI access with live logging.
Modern Experience
- Premium Visual Engine: Sleek glassmorphism, fluid gradients, and premium Motion One animations.
- Responsive Preview: Live rendering scaling for desktop and mobile viewpoints.
- History & Stats: Phase-by-phase performance tracking and historical session management.
🚀 Getting Started
Basic Usage
Launch Interactive Menu
webtools
Non-Interactive Script Mode
python -m webtools
Slash Commands Reference
Navigate the suite using quick terminal commands:
| Command | Alias | Description |
|---|---|---|
/web |
/w |
Launch Web UI (Cloudflare Tunnel + QR) |
/cli |
/c |
Launch CLI Intelligence scan |
/image |
/i |
Image Forensics & AI Likelihood |
/cui |
- | ComfyUI AI Generation (GPU Required) |
/history |
/hi |
View and manage scan history |
/help |
/h |
Show full command documentation |
/clear |
- | Purge all locally scraped data |
/quit |
/q |
Exit the application |
☁️ Deployment Options
- Local Development: Run on your machine with a generated QR code for mobile access.
- Cloud Tunnels: Automatic
cloudflaredintegration to expose your UI globally. - Google Colab: Compatible with Colab for cloud-based scraping (see badge above).
🤝 Resources & Support
- GitHub Repository - Source code and updates.
- Issue Tracker - Report bugs or request features.
- License - MIT License.
⚖️ Legal
This tool is for educational and testing purposes only. Always respect robots.txt and the Terms of Service of the websites you scrape. Neither the author nor the contributors are responsible for any misuse of this tool.
Built with ❤️ by Abhinav Adarsh and the open source community
1 maintainer
Release files for webtools-cli 1.3.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| webtools_cli-1.3.9.tar.gz | 130.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| webtools_cli-1.3.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 262.9 kB
Release files / webtools_cli-1.3.9.tar.gz
| Download URL | webtools_cli-1.3.9.tar.gz |
|---|---|
| Size | 130.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b7ad016b1f3b431400d9e793e5dc70d06ad84a045d27270ad3e343c0cb4059f4
|
|
BLAKE2b-256 checksum How to use checksums |
2db38dd76e2b9970f2de3f3838a8c36a95dc88617399be1bad89e6411986026b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.10
|
Release files / webtools_cli-1.3.9-py3-none-any.whl
| Download URL | webtools_cli-1.3.9-py3-none-any.whl |
|---|---|
| Size | 132.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
71ed15b873a3fcbcb1b7e402f16a7c4ff48338d57d85d691e2d7fed5062a2105
|
|
BLAKE2b-256 checksum How to use checksums |
08feaa6c03fba37e491d0de31b0011d0ebc05a7f86301bee1bf4a4f7fd45a62c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.10
|
