webtools-cli 1.3.3

Advanced Web Intelligence & Scraping Toolkit with CLI and Web UI

WebTools CLI

try :

WebTools CLI is an advanced web intelligence suite for researchers, OSINT enthusiasts, and developers. It brings the power of deep web analysis and automated scraping directly into your terminal.

---

🚀 Why WebTools CLI?

• 🎯 Stealth & Speed: Smart proxy rotation and Turbo-Fetch logic for evasion and performance.
• 🧠 AI-Powered: Automated content summarization, sentiment analysis, and readability scoring.
• ☁️ Cloud-Native: Integrated Mega.nz storage for seamless media backups and file management.
• 🔧 Security-Centric: Built-in honeypot detection, threat leveling, and image forensic analysis.
• 💻 Terminal-First: Designed for power users who live in the command line.
• 🛡️ Cross-Platform: Works seamlessly on Windows, Linux, and macOS (with auto-download for Windows tunnels).
• 🔌 SPA Ready: Automatic Playwright fallback for JavaScript-heavy sites like LinkedIn/Instagram.

---

📦 Installation

See the installation guide for recommended system specifications.

Quick Install

Install globally via pip:

pip install webtools-cli

To upgrade to the latest version:

pip install webtools-cli --upgrade

---

📋 Key Features

Advanced Scraping & Stealth

• Smart Proxy Rotation: Automatically rotates User-Agents and Proxies to evade detection.
• Turbo-Fetch: Parallel chunk downloads for large media (Videos/Images).
• Mega Cloud Drive: Native integration with Mega.nz for multi-account storage and file management.
• One-Click Save: Instantly save scraped images and videos directly to your cloud storage.
• Deep Crawl: Recursive link mapping up to 3 levels deep.
• Headless Fallback: Integrated Playwright support for auth-walled or SPA environments.

Intelligence & Security Analysis

• OSINT Toolkit: Auto-extract emails, phones, locations, social media, and tech stacks.
• SEO Auditor: Page score, heading hierarchy, link integrity, and image alt-text auditing.
• Image Forensics: CLI-based Error Level Analysis (ELA) and AI-likelihood detection.
• Honeypot Detector: Identifies hidden traps and anti-bot measures (Cloudflare/CAPTCHAs).

AI Generation & Creative Tools

• ComfyUI Integration: Seamlessly launch a full Stable Diffusion interface directly from the CLI.
• Anime Studio (Anima): Specialized "Make Anime" mode with automated Anima model downloads (UNET, Text Encoder, VAE) from Hugging Face.
• Colab Optimized: Pre-configured for Google Colab with T4 GPU support and automated environment setup.
• Secure Tunnels: Instant Cloudflare tunnel generation for remote UI access with live logging.

Modern Experience

• Premium Visual Engine: Sleek glassmorphism, fluid gradients, and premium Motion One animations.
• Responsive Preview: Live rendering scaling for desktop and mobile viewpoints.
• History & Stats: Phase-by-phase performance tracking and historical session management.

---

🚀 Getting Started

Basic Usage

Launch Interactive Menu

webtools

Non-Interactive Script Mode

python -m webtools

Slash Commands Reference

Navigate the suite using quick terminal commands:

Command	Alias	Description
/web	/w	Launch Web UI (Cloudflare Tunnel + QR)
/cli	/c	Launch CLI Intelligence scan
/image	/i	Image Forensics & AI Likelihood
/cui	-	ComfyUI AI Generation (GPU Required)
/history	/hi	View and manage scan history
/help	/h	Show full command documentation
/clear	-	Purge all locally scraped data
/quit	/q	Exit the application

---

☁️ Deployment Options

• Local Development: Run on your machine with a generated QR code for mobile access.
• Cloud Tunnels: Automatic cloudflared integration to expose your UI globally.
• Google Colab: Compatible with Colab for cloud-based scraping (see badge above).

---

🤝 Resources & Support

• GitHub Repository - Source code and updates.
• Issue Tracker - Report bugs or request features.
• License - MIT License.

---

⚖️ Legal

This tool is for educational and testing purposes only. Always respect robots.txt and the Terms of Service of the websites you scrape. Neither the author nor the contributors are responsible for any misuse of this tool.

---

Built with ❤️ by Abhinav Adarsh and the open source community