Skip to main content

Screen-scraping library

Reason this release was yanked:

Minimum Python version was incorrectly pinned to 3.6.

Project description

Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.

Quick start

>>> from bs4 import BeautifulSoup
>>> soup = BeautifulSoup("<p>Some<b>bad<i>HTML")
>>> print(soup.prettify())
<html>
 <body>
  <p>
   Some
   <b>
    bad
    <i>
     HTML
    </i>
   </b>
  </p>
 </body>
</html>
>>> soup.find(string="bad")
'bad'
>>> soup.i
<i>HTML</i>
#
>>> soup = BeautifulSoup("<tag1>Some<tag2/>bad<tag3>XML", "xml")
#
>>> print(soup.prettify())
<?xml version="1.0" encoding="utf-8"?>
<tag1>
 Some
 <tag2/>
 bad
 <tag3>
  XML
 </tag3>
</tag1>

To go beyond the basics, comprehensive documentation is available.

Links

Note on Python 2 sunsetting

Beautiful Soup's support for Python 2 was discontinued on December 31, 2020: one year after the sunset date for Python 2 itself. From this point onward, new Beautiful Soup development will exclusively target Python 3. The final release of Beautiful Soup 4 to support Python 2 was 4.9.3.

Supporting the project

If you use Beautiful Soup as part of your professional work, please consider a Tidelift subscription. This will support many of the free software projects your organization depends on, not just Beautiful Soup.

If you use Beautiful Soup for personal projects, the best way to say thank you is to read Tool Safety, a zine I wrote about what Beautiful Soup has taught me about software development.

Building the documentation

The bs4/doc/ directory contains full documentation in Sphinx format. Run make html in that directory to create HTML documentation.

Running the unit tests

Beautiful Soup supports unit test discovery using Pytest:

$ pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

beautifulsoup4-4.13.0.tar.gz (558.5 kB view details)

Uploaded Source

Built Distribution

beautifulsoup4-4.13.0-py3-none-any.whl (185.0 kB view details)

Uploaded Python 3

File details

Details for the file beautifulsoup4-4.13.0.tar.gz.

File metadata

  • Download URL: beautifulsoup4-4.13.0.tar.gz
  • Upload date:
  • Size: 558.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.0

File hashes

Hashes for beautifulsoup4-4.13.0.tar.gz
Algorithm Hash digest
SHA256 b6e5afb3a2b1472c8db751a92eabf7834e5c7099f990c5e4b35f1f16b60bae64
MD5 134903679c2ca0bf0b4588586ee4c6f7
BLAKE2b-256 4bd36f4047d1de55b7a290ef8d4b4ebf59dcc24742920ebbed0909f823424205

See more details on using hashes here.

File details

Details for the file beautifulsoup4-4.13.0-py3-none-any.whl.

File metadata

File hashes

Hashes for beautifulsoup4-4.13.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9c4c3dfa67aba55f6cd03769c441b21e6a369797fd6766e4b4c6b3399aae2735
MD5 24fdcdcc11e8cf97ab6a2c536551bd2c
BLAKE2b-256 6e74d53cf0c527b20fc87351e6fd9d51aac9b5d1e32ec5a3a32b84671806ab40

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page