Skip to main content

StaticWeb

A fast, multi-threaded CLI tool to scrape static websites.

Installation

pip install staticweb

Usage

sw https://example.com --link

Features

  • Extract links (--link)
  • Extract paragraphs (--para)
  • Extract full text (--all)
  • Extract custom tags (--tag h1)
  • JSON output (--json)
  • Save output (--save file.txt)
  • Multi-threaded (--threads)
  • Rich UI with progress bar

Example

sw https://example.com --para sw https://example.com --tag h1 sw https://example.com --link --json

Disclaimer

Use responsibly. Respect website terms and robots.txt.

Metadata

Release files for staticweb 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for staticweb 0.7.0
File Size Uploaded
staticweb-0.7.0.tar.gz 3.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for staticweb 0.7.0
File Interpreter ABI Platform
staticweb-0.7.0-py3-none-any.whl Python 3 none any Details

Total release size: 7.5 kB

Release files / staticweb-0.7.0.tar.gz

Download URL staticweb-0.7.0.tar.gz
Size 3.5 kB
Tags Source
SHA-256 checksum
How to use checksums
1acce016629ee8e81c1f5fa4bd420b6559a83f1811bc20078a768f6e45959326
BLAKE2b-256 checksum
How to use checksums
03ff8a1870d6ec10414fd0b6952014e1aea8b91a79ee965d3104ffcd0b7cdcbf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.14

Release files / staticweb-0.7.0-py3-none-any.whl

Download URL staticweb-0.7.0-py3-none-any.whl
Size 4.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
50636ca4ede26189d849f15815cf739290d312bfc6f6ba464c4342ea43f7c833
BLAKE2b-256 checksum
How to use checksums
3862ea3648b5ba9c45d9319eeb7e5f6510800659fbf0007711ea322f43535210
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.14

Release history Release notifications | RSS feed

This release

0.7.0 This release

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page