Skip to main content

w3lib

https://secure.travis-ci.org/scrapy/w3lib.png?branch=master

Overview

This is a Python library of web-related functions, such as:

  • remove comments, or tags from HTML snippets

  • extract base url from HTML snippets

  • translate entites on HTML strings

  • convert raw HTTP headers to dicts and vice-versa

  • construct HTTP auth header

  • converting HTML pages to unicode

  • sanitize urls (like browsers do)

  • extract arguments from urls

Requirements

Python 2.7 or Python 3.3+

Install

pip install w3lib

Documentation

See http://w3lib.readthedocs.org/

License

The w3lib library is licensed under the BSD license.

Metadata

Release files for w3lib 1.11.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for w3lib 1.11.0
File Size Uploaded Provenance Actions
w3lib-1.11.0.tar.gz 12.1 kB Without provenance Details for w3lib-1.11.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for w3lib 1.11.0
File Interpreter ABI Platform Actions
w3lib-1.11.0-py2.py3-none-any.whl Python 3, Python 2 none any Details for w3lib-1.11.0-py2.py3-none-any.whl

Total release size: 26.9 kB

Release files / w3lib-1.11.0.tar.gz

Download URL w3lib-1.11.0.tar.gz
Size 12.1 kB
Tags Source
SHA-256 checksum
How to use checksums
826f6184232c385b7c8038ef7ae5506f1cb3f8fa470ac12ce0fb6fb0a592fb92
BLAKE2b-256 checksum
How to use checksums
381f3bcd2549e7e8cf26c2574474a8ffc03f91d13a9f9d3fff86e8a47e23e7c7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / w3lib-1.11.0-py2.py3-none-any.whl

Download URL w3lib-1.11.0-py2.py3-none-any.whl
Size 14.8 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
d06df19d0a7dfd06fb8d4b7c58e3f3bdc1862a2c92e145bbb7d5526008a54f8a
BLAKE2b-256 checksum
How to use checksums
36e18717334035de69a638b42cbec59736adda4da1cdc67aec6a09075f9c0800
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for w3lib 1.11.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.11.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page