Skip to main content
https://secure.travis-ci.org/scrapy/w3lib.png?branch=master

Overview

This is a Python library of web-related functions, such as:

  • remove comments, or tags from HTML snippets

  • extract base url from HTML snippets

  • translate entites on HTML strings

  • convert raw HTTP headers to dicts and vice-versa

  • construct HTTP auth header

  • converting HTML pages to unicode

  • sanitize urls (like browsers do)

  • extract arguments from urls

Requirements

Python 2.7 or Python 3.3+

Install

pip install w3lib

Documentation

See http://w3lib.readthedocs.org/

License

The w3lib library is licensed under the BSD license.

Metadata

Release files for w3lib 1.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for w3lib 1.7.0
File Size Uploaded Provenance
w3lib-1.7.0.tar.gz 12.0 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for w3lib 1.7.0
File Interpreter ABI Platform
w3lib-1.7.0-py2-none-any.whl Python 2 none any Details

Total release size: 26.7 kB

Release files / w3lib-1.7.0.tar.gz

Download URL w3lib-1.7.0.tar.gz
Size 12.0 kB
Tags Source
SHA-256 checksum
How to use checksums
76ecda47264ddfb22873e22ca34c0a90525f2aa0721e4d28234cdeb6fda1a177
BLAKE2b-256 checksum
How to use checksums
83a99233f46fdf2378d6bc884fa2d8e01a60fb6313c5c6544bd4b80a24bd5190
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / w3lib-1.7.0-py2-none-any.whl

Download URL w3lib-1.7.0-py2-none-any.whl
Size 14.7 kB
Tags Python 2
SHA-256 checksum
How to use checksums
1c75d1752703e17a4d7772fd56e63d2f1f236f3758f5ca3b93a9272e0beaf25d
BLAKE2b-256 checksum
How to use checksums
48849af1710553c760bee60125a7c9745ebc96981d788da75d56a84157bd804f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for w3lib 1.7.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.7.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page