Clutch Scraper

A powerful CLI tool to scrape company reviews from Clutch.co with CSV output and graceful pause functionality.

Features

• 🏢 Scrape companies from multiple categories (Development, Marketing, Design, IT Services)
• 📊 Export reviews to separate CSV files per company
• ⏸️ Graceful pause/stop with Ctrl+C (no data loss)
• 💾 Automatic progress saving
• 🚀 Easy CLI installation and usage
• 📈 Real-time progress tracking

Installation

pip install clutch-scraper

Usage

Simply run the command after installation:

clutch-scraper

The tool will guide you through:

1. Selecting a category and subcategory
2. Choosing number of companies to scrape
3. Automatic scraping with progress updates

Pausing/Stopping

Press Ctrl+C at any time to gracefully stop the scraper. All scraped data will be saved to CSV files.

Output

The tool creates a timestamped directory containing:

• Individual CSV files for each company's reviews
• Progress tracking file
• Structured data with reviewer information

CSV Structure

Each company's CSV contains:

• company_name: Name of the company
• company_url: Clutch.co profile URL
• title: Review title
• text: Review content
• reviewer_name: Name of reviewer
• reviewer_position: Job title of reviewer
• reviewer_location: Location of reviewer
• scrape_timestamp: When the data was scraped

Example

$ clutch-scraper

==================================================
CLUTCH.CO COMPANY & REVIEWS SCRAPER
==================================================

Select a main category:
1. Development
2. Marketing
3. Design
4. IT Services

Enter category number: 1

Select from Development:
1. Web Developers
2. Software Developers
3. Mobile App Development
...

Requirements

• Python 3.7+
• Internet connection
• Dependencies: cloudscraper, beautifulsoup4, pandas, lxml

Development

Local Installation

git clone https://github.com/yourusername/clutch-scraper
cd clutch-scraper
pip install -e .

Building

python setup.py sdist bdist_wheel

License

MIT License

Disclaimer

This tool is for educational and research purposes. Please respect Clutch.co's robots.txt and terms of service. Use responsibly with appropriate delays between requests.