ScrapeDesk

A friendly desktop web scraper. Paste a link, choose what you want (images, tables, links, text, emails or custom fields) and export it to Excel, CSV, JSON, SQLite and more. You don't need to write any code.

pip install scrapedesk
scrapedesk

Works on Windows, macOS and Linux with Python 3.9+.

Highlights

Install

pip install scrapedesk

Start the app:

scrapedesk               # or:  python -m scrapedesk
scrapedesk https://example.com   # open with a URL already filled in

Linux: tkinter is sometimes packaged separately: sudo apt install python3-tk.

JavaScript-heavy websites (optional)

If a site builds its content with JavaScript (React or Vue apps, infinite scroll), install the browser extra and turn on Settings → JavaScript websites → Playwright:

pip install "scrapedesk[js]"
python -m playwright install chromium

If you skip the last step, ScrapeDesk falls back to an installed Google Chrome or Microsoft Edge.

How to use

1. Home: paste a URL (or several), then click the cards for what you want to collect and press Start.
2. Watch the counters update. When the job finishes, a notification takes you to the results.
3. Images: click thumbnails to select them, double-click to see full size, then Download selected.
4. Tables: pick a table, then Export it (Excel, CSV…) or Copy it straight into Excel.
5. Custom Fields: press Load example to see how product names and prices are extracted.
6. Press Ctrl+E to export everything in one Excel workbook.

Keyboard shortcuts:

Command line

Everything also works without the window:

# all images wider than 300 px
scrapedesk-cli https://example.com --images --download --min-width 300 --types jpg,png

# every table to Excel
scrapedesk-cli https://example.com/stats --tables -o stats.xlsx

# one row per product across 50 pages
scrapedesk-cli https://books.toscrape.com --paginate --max-pages 50 \
    --row article.product_pod --css "title=h3 a@title" --css "price=.price_color" -o books.csv

# crawl a site and export everything
scrapedesk-cli https://example.com --crawl --depth 2 --max-pages 100 --report everything.xlsx

Run scrapedesk-cli --help for all options.

Use it from Python

from scrapedesk import ScrapeSettings, WebScraper
from scrapedesk.exporters import export_dataframes, tables_to_frames

settings = ScrapeSettings(extract_images=True, extract_tables=True, min_width=200)
scraper = WebScraper(settings)
pages = scraper.run(["https://example.com"])

tables = [t for p in pages for t in p.tables]
export_dataframes(tables_to_frames(tables), "tables.xlsx")
scraper.download_images([img for p in pages for img in p.images])

Responsible use

Only scrape content you are allowed to access. Respect each website's terms of service, robots.txt (there is a setting for it) and rate limits (use the delay setting), and follow privacy laws such as GDPR when you collect personal data. ScrapeDesk does not bypass logins, CAPTCHAs or anti-bot protection.

License

MIT