A fun Python web scraper if you need me comment on the github page lemonsrC00l is just my alt UPDATE i have added tor scaping as a function
Project description
WebScraper
Thank you for checking out my web scraper! This tool allows you to easily scrape websites for titles, text, links, and meta tags, with options for depth crawling and JSON output.
Features
- Scrape a single page or crawl multiple pages with a depth option
- Extract page title, text, links, and meta tags
- Save results as JSON or print them nicely with pretty print
- Optional live status reporting
- Fun banners and legal notice (can be disabled)
- CLI interface for easy usage
- im the sole developer im so tired bro
Update
- Have added a small update to my code which allows tor scraping
- you will need proxies if there are no proxies configured it will try to connect to tor via tor browser so you must have it open and connected
- if you want to use the tor expert bundle you can type tor bundle for proxies
- Thats it for 2.2
Installation
pip install git+https://github.com/skelliyB/scrapscraper
```python
pip install scrapscraper
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file scrapscraper-2.2.0.tar.gz.
File metadata
- Download URL: scrapscraper-2.2.0.tar.gz
- Upload date:
- Size: 5.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e86e2b44c51fbda384cf82d3866f5b421d01dfc5dde82f15c832433d602e2c92
|
|
| MD5 |
f8e2a0b9511f8a42cdfff218ad1b0be4
|
|
| BLAKE2b-256 |
924b84905660afb3785f1a40fbe13c012c5dce4eb920c470e738b29a18424007
|
File details
Details for the file scrapscraper-2.2.0-py3-none-any.whl.
File metadata
- Download URL: scrapscraper-2.2.0-py3-none-any.whl
- Upload date:
- Size: 5.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ef5a483756601f7089bcfe9403298bb1125c96e6bfd5cae99b9146ae405f5ed9
|
|
| MD5 |
5a97e3a4e14f504b0e8d1ee1c7cfb9a3
|
|
| BLAKE2b-256 |
28411327c4143b65bb9c320c4dc53d451d1b623def92e36fdfc998a6a005665e
|