Skip to main content

w3lib

https://github.com/scrapy/w3lib/actions/workflows/test.yml/badge.svg Coverage report

Overview

This is a Python library of web-related functions, such as:

  • remove comments, or tags from HTML snippets

  • extract base url from HTML snippets

  • translate entities on HTML strings

  • convert raw HTTP headers to dicts and vice-versa

  • construct HTTP auth header

  • converting HTML pages to unicode

  • sanitize urls (like browsers do)

  • extract arguments from urls

Requirements

Python 3.11+

Install

pip install w3lib

Documentation

See https://w3lib.readthedocs.io/

License

The w3lib library is licensed under the BSD license.

Metadata

Release files for w3lib 2.6.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for w3lib 2.6.0
File Size Uploaded Provenance Actions
w3lib-2.6.0.tar.gz 746.1 kB With provenance Details for w3lib-2.6.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for w3lib 2.6.0
File Interpreter ABI Platform Actions
w3lib-2.6.0-py3-none-any.whl Python 3 none any Details for w3lib-2.6.0-py3-none-any.whl

Total release size: 786.2 kB

Release files / w3lib-2.6.0.tar.gz

Download URL w3lib-2.6.0.tar.gz
Size 746.1 kB
Tags Source
SHA-256 checksum
How to use checksums
821f78cfdeb9e675c736ffe0b874bd1e50e9e02997e675ce046b373c009f27be
BLAKE2b-256 checksum
How to use checksums
c14a76a2b98d6d93eb1d7e69b382faf3290f571547d9eb13f612d5ddab740f60
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 5, 2026.

Transparency log

Release files / w3lib-2.6.0-py3-none-any.whl

Download URL w3lib-2.6.0-py3-none-any.whl
Size 40.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e62ce6b7f845b5e8588223d44e64990673a0fefd6815d6b3f2e6d39bf9ef308c
BLAKE2b-256 checksum
How to use checksums
aa51c3a48500fd4f211126b09d07850df33874455c432b7e8e5e0cfef8fcf7ba
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 5, 2026.

Transparency log

Security for w3lib 2.6.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for w3lib-2.6.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 5, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

2.6.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page