Extract data from websites to CSV or JSON using CSS selectors
Project description
Web Scraper Pro
Extract data from any website to CSV or JSON with a single command.
Install
pip install web-scraper-pro
Usage
Extract all page titles:
scrape -u https://example.com -s "h1" -o titles.csv
Extract image sources:
scrape -u https://example.com -s "img" --attr src -o images.csv
Scrape multiple URLs from a file:
scrape -u urls.txt -s "h2.title" --delay 2
Extract structured data:
scrape -u https://shop.com --item ".product" --fields "title,.name,price,.cost"
Features
- CSS selector based extraction
- Text or attribute extraction (href, src, etc.)
- Multiple URL support (from file or arguments)
- Configurable delay between requests
- Proxy support
- CSV and JSON export
- Auto-rotating user agents
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
web_scraper_pro-1.0.0.tar.gz
(3.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file web_scraper_pro-1.0.0.tar.gz.
File metadata
- Download URL: web_scraper_pro-1.0.0.tar.gz
- Upload date:
- Size: 3.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2b18c2a440b7a96e039ed16a407721a88841ec9d9df462396be5df97478270a6
|
|
| MD5 |
b389ea6274709b52a083228e7bb7b876
|
|
| BLAKE2b-256 |
0d4b175db1da48b40b82f6ca58e69c2ccd1f0ebd616fefecec9a813f4c212084
|
File details
Details for the file web_scraper_pro-1.0.0-py3-none-any.whl.
File metadata
- Download URL: web_scraper_pro-1.0.0-py3-none-any.whl
- Upload date:
- Size: 4.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
021c157d36d976a2ba0161f9c5d80091257c9d12751f7c9e3b86fa5c361ec4e2
|
|
| MD5 |
4866c10e60aa3ace70caad9bedf30562
|
|
| BLAKE2b-256 |
f217194dbdab6be16ff2aa1f46cf849d7ad769c241c356cdaa35074d40e5b7eb
|
