Skip to main content
https://github.com/scrapy/w3lib/actions/workflows/tests.yml/badge.svg Coverage report

Overview

This is a Python library of web-related functions, such as:

  • remove comments, or tags from HTML snippets

  • extract base url from HTML snippets

  • translate entites on HTML strings

  • convert raw HTTP headers to dicts and vice-versa

  • construct HTTP auth header

  • converting HTML pages to unicode

  • sanitize urls (like browsers do)

  • extract arguments from urls

Requirements

Python 3.9+

Install

pip install w3lib

Documentation

See http://w3lib.readthedocs.org/

License

The w3lib library is licensed under the BSD license.

Release files for w3lib 2.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for w3lib 2.3.0
File Size Uploaded
w3lib-2.3.0.tar.gz 49.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for w3lib 2.3.0
File Interpreter ABI Platform
w3lib-2.3.0-py3-none-any.whl Python 3 none any Details

Total release size: 71.3 kB

Release files / w3lib-2.3.0.tar.gz

Download URL w3lib-2.3.0.tar.gz
Size 49.5 kB
Tags Source
SHA-256 checksum
How to use checksums
5f45fa29863740bbd45cfd1f9d3e7c30e08b74b0a7f0c09d2b7d4e74253c17b8
BLAKE2b-256 checksum
How to use checksums
51b637d42e87e58b165f7bde60f779988125241dfc23341d2062002ffbfb3213
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.1

Release files / w3lib-2.3.0-py3-none-any.whl

Download URL w3lib-2.3.0-py3-none-any.whl
Size 21.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c768e58b57db417612e94b3e5031a9676f619b56b65bb41a2459531160254b7a
BLAKE2b-256 checksum
How to use checksums
b8532e3ba8c0552c93162c1ab1a588a34f54ffdee24dbfadf9329158a06d3b8b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.1

Release history Release notifications | RSS feed

2.4.1

2 release files

2.4.0

2 release files

2.3.1

2 release files

This release

2.3.0 This release

2 release files

2.2.1

2 release files

2.2.0

2 release files

2.1.2

2 release files

2.1.1

2 release files

2.1.0

2 release files

2.0.1

2 release files

2.0.0

2 release files

1.22.0

2 release files

1.20.0

2 release files

1.19.0

2 release files

1.16.0

2 release files

1.15.0

2 release files

1.14.3

2 release files

1.14.2

2 release files

1.12.0

2 release files

1.11.0

2 release files

1.10.0

2 release files

1.9.0

2 release files

1.8.1

2 release files

1.8.0

2 release files

1.7.1

2 release files

1.7.0

2 release files

1.6

1 release file

1.5

1 release file

1.4

1 release file

1.3

1 release file

1.2

1 release file

1.1

1 release file

1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page