Skip to main content

A fun Python web scraper if you need me comment on the github page lemonsrC00l is just my alt UPDATE i have added tor scaping as a function

Project description

WebScraper

Thank you for checking out my web scraper! This tool allows you to easily scrape websites for titles, text, links, and meta tags, with options for depth crawling and JSON output.


Features

  • Scrape a single page or crawl multiple pages with a depth option
  • Extract page title, text, links, and meta tags
  • Save results as JSON or print them nicely with pretty print
  • Optional live status reporting
  • Fun banners and legal notice (can be disabled)
  • CLI interface for easy usage
  • im the sole developer im so tired bro

Update

  • Have added a small update to my code which allows tor scraping
  • you will need proxies if there are no proxies configured it will try to connect to tor via tor browser so you must have it open and connected
  • if you want to use the tor expert bundle you can type tor bundle for proxies
  • Thats it for 2.2

Installation

pip install git+https://github.com/skelliyB/scrapscraper

```python
pip install scrapscraper

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapscraper-2.2.0.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scrapscraper-2.2.0-py3-none-any.whl (5.8 kB view details)

Uploaded Python 3

File details

Details for the file scrapscraper-2.2.0.tar.gz.

File metadata

  • Download URL: scrapscraper-2.2.0.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for scrapscraper-2.2.0.tar.gz
Algorithm Hash digest
SHA256 e86e2b44c51fbda384cf82d3866f5b421d01dfc5dde82f15c832433d602e2c92
MD5 f8e2a0b9511f8a42cdfff218ad1b0be4
BLAKE2b-256 924b84905660afb3785f1a40fbe13c012c5dce4eb920c470e738b29a18424007

See more details on using hashes here.

File details

Details for the file scrapscraper-2.2.0-py3-none-any.whl.

File metadata

  • Download URL: scrapscraper-2.2.0-py3-none-any.whl
  • Upload date:
  • Size: 5.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for scrapscraper-2.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ef5a483756601f7089bcfe9403298bb1125c96e6bfd5cae99b9146ae405f5ed9
MD5 5a97e3a4e14f504b0e8d1ee1c7cfb9a3
BLAKE2b-256 28411327c4143b65bb9c320c4dc53d451d1b623def92e36fdfc998a6a005665e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page