Skip to main content

Screen-scraping library

Project description

Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.

Quick start

>>> from bs4 import BeautifulSoup
>>> soup = BeautifulSoup("<p>Some<b>bad<i>HTML")
>>> print(soup.prettify())
<html>
 <body>
  <p>
   Some
   <b>
    bad
    <i>
     HTML
    </i>
   </b>
  </p>
 </body>
</html>
>>> soup.find(text="bad")
'bad'
>>> soup.i
<i>HTML</i>
#
>>> soup = BeautifulSoup("<tag1>Some<tag2/>bad<tag3>XML", "xml")
#
>>> print(soup.prettify())
<?xml version="1.0" encoding="utf-8"?>
<tag1>
 Some
 <tag2/>
 bad
 <tag3>
  XML
 </tag3>
</tag1>

To go beyond the basics, comprehensive documentation is available.

Links

Note on Python 2 sunsetting

Beautiful Soup's support for Python 2 was discontinued on December 31, 2020: one year after the sunset date for Python 2 itself. From this point onward, new Beautiful Soup development will exclusively target Python 3. The final release of Beautiful Soup 4 to support Python 2 was 4.9.3.

Supporting the project

If you use Beautiful Soup as part of your professional work, please consider a Tidelift subscription. This will support many of the free software projects your organization depends on, not just Beautiful Soup.

If you use Beautiful Soup for personal projects, the best way to say thank you is to read Tool Safety, a zine I wrote about what Beautiful Soup has taught me about software development.

Building the documentation

The bs4/doc/ directory contains full documentation in Sphinx format. Run make html in that directory to create HTML documentation.

Running the unit tests

Beautiful Soup supports unit test discovery from the project root directory:

$ nosetests
$ python3 -m unittest discover -s bs4

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

beautifulsoup4-4.10.0.tar.gz (399.9 kB view details)

Uploaded Source

Built Distribution

beautifulsoup4-4.10.0-py3-none-any.whl (97.4 kB view details)

Uploaded Python 3

File details

Details for the file beautifulsoup4-4.10.0.tar.gz.

File metadata

  • Download URL: beautifulsoup4-4.10.0.tar.gz
  • Upload date:
  • Size: 399.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for beautifulsoup4-4.10.0.tar.gz
Algorithm Hash digest
SHA256 c23ad23c521d818955a4151a67d81580319d4bf548d3d49f4223ae041ff98891
MD5 e754242642253dd31d249d00358d552e
BLAKE2b-256 a169daeee6d8f22c997e522cdbeb59641c4d31ab120aba0f2c799500f7456b7e

See more details on using hashes here.

File details

Details for the file beautifulsoup4-4.10.0-py3-none-any.whl.

File metadata

  • Download URL: beautifulsoup4-4.10.0-py3-none-any.whl
  • Upload date:
  • Size: 97.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for beautifulsoup4-4.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9a315ce70049920ea4572a4055bc4bd700c940521d36fc858205ad4fcde149bf
MD5 d131bd9701fff9a9ebdb42d921e234fd
BLAKE2b-256 69bff0f194d3379d3f3347478bd267f754fc68c11cbf2fe302a6ab69447b1417

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page