Skip to main content

Screen-scraping library

Project description

Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.

Quick start

>>> from bs4 import BeautifulSoup
>>> soup = BeautifulSoup("<p>Some<b>bad<i>HTML")
>>> print(soup.prettify())
<html>
 <body>
  <p>
   Some
   <b>
    bad
    <i>
     HTML
    </i>
   </b>
  </p>
 </body>
</html>
>>> soup.find(string="bad")
'bad'
>>> soup.i
<i>HTML</i>
#
>>> soup = BeautifulSoup("<tag1>Some<tag2/>bad<tag3>XML", "xml")
#
>>> print(soup.prettify())
<?xml version="1.0" encoding="utf-8"?>
<tag1>
 Some
 <tag2/>
 bad
 <tag3>
  XML
 </tag3>
</tag1>

To go beyond the basics, comprehensive documentation is available.

Links

Note on Python 2 sunsetting

Beautiful Soup's support for Python 2 was discontinued on December 31, 2020: one year after the sunset date for Python 2 itself. From this point onward, new Beautiful Soup development will exclusively target Python 3. The final release of Beautiful Soup 4 to support Python 2 was 4.9.3.

Supporting the project

If you use Beautiful Soup as part of your professional work, please consider a Tidelift subscription. This will support many of the free software projects your organization depends on, not just Beautiful Soup.

If you use Beautiful Soup for personal projects, the best way to say thank you is to read Tool Safety, a zine I wrote about what Beautiful Soup has taught me about software development.

Building the documentation

The bs4/doc/ directory contains full documentation in Sphinx format. Run make html in that directory to create HTML documentation.

Running the unit tests

Beautiful Soup supports unit test discovery using Pytest:

$ pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

beautifulsoup4-4.13.3.tar.gz (619.5 kB view details)

Uploaded Source

Built Distribution

beautifulsoup4-4.13.3-py3-none-any.whl (186.0 kB view details)

Uploaded Python 3

File details

Details for the file beautifulsoup4-4.13.3.tar.gz.

File metadata

  • Download URL: beautifulsoup4-4.13.3.tar.gz
  • Upload date:
  • Size: 619.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.0

File hashes

Hashes for beautifulsoup4-4.13.3.tar.gz
Algorithm Hash digest
SHA256 1bd32405dacc920b42b83ba01644747ed77456a65760e285fbc47633ceddaf8b
MD5 63b9e66839aa5e67701c76455d3be92a
BLAKE2b-256 f03cadaf39ce1fb4afdd21b611e3d530b183bb7759c9b673d60db0e347fd4439

See more details on using hashes here.

File details

Details for the file beautifulsoup4-4.13.3-py3-none-any.whl.

File metadata

File hashes

Hashes for beautifulsoup4-4.13.3-py3-none-any.whl
Algorithm Hash digest
SHA256 99045d7d3f08f91f0d656bc9b7efbae189426cd913d830294a15eefa0ea4df16
MD5 d6efcd7e445bbc4f02252625f7e9d8ab
BLAKE2b-256 f9496abb616eb3cbab6a7cca303dc02fdf3836de2e0b834bf966a7f5271a34d8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page