Skip to main content

Screen-scraping library

Project description

Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.

Quick start

  >>> from bs4 import BeautifulSoup
  >>> soup = BeautifulSoup("<p>Some<b>bad<i>HTML")
  >>> print soup.prettify()
  <html>
   <body>
    <p>
     Some
     <b>
      bad
      <i>
       HTML
      </i>
     </b>
    </p>
   </body>
  </html>
  >>> soup.find(text="bad")
  u'bad'

  >>> soup.i
  <i>HTML</i>

  >>> soup = BeautifulSoup("<tag1>Some<tag2/>bad<tag3>XML", "xml")
  >>> print soup.prettify()
  <?xml version="1.0" encoding="utf-8">
  <tag1>
   Some
   <tag2 />
   bad
   <tag3>
    XML
   </tag3>
  </tag1>

To go beyond the basics, comprehensive documentation is available.

Links

Building the documentation

The bs4/doc/ directory contains full documentation in Sphinx format. Run make html in that directory to create HTML documentation.

Running the unit tests

Beautiful Soup supports unit test discovery from the project root directory:

 $ nosetests
 $ python -m unittest discover -s bs4 # Python 2.7 and up

If you checked out the source tree, you should see a script in the home directory called test-all-versions. This script will run the unit tests under Python 2.7, then create a temporary Python 3 conversion of the source and run the unit tests again under Python 3.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

beautifulsoup4-4.7.0.tar.gz (150.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

beautifulsoup4-4.7.0-py3-none-any.whl (93.0 kB view details)

Uploaded Python 3

beautifulsoup4-4.7.0-py2-none-any.whl (94.6 kB view details)

Uploaded Python 2

File details

Details for the file beautifulsoup4-4.7.0.tar.gz.

File metadata

  • Download URL: beautifulsoup4-4.7.0.tar.gz
  • Upload date:
  • Size: 150.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/18.4 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.0+

File hashes

Hashes for beautifulsoup4-4.7.0.tar.gz
Algorithm Hash digest
SHA256 e394827904cc4923f443e8dd2e9968343669c8e1ad7a8d62d7541e780884acb8
MD5 a0b77ccfc942332f6ce1137ab070e3da
BLAKE2b-256 7144e937fd69fb1eb1999b3bc6a640571dfd0c3e66372ed87aead70a69aa0d09

See more details on using hashes here.

File details

Details for the file beautifulsoup4-4.7.0-py3-none-any.whl.

File metadata

  • Download URL: beautifulsoup4-4.7.0-py3-none-any.whl
  • Upload date:
  • Size: 93.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/18.4 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.0+

File hashes

Hashes for beautifulsoup4-4.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1ed70a0e99742653953d68462378a1a8eb65dca5f7c8fa44a05a2a0b3545df67
MD5 2cef6ba872f8f79cd09b8ffbeabb6f5e
BLAKE2b-256 3fef40271f62429deec36f2d040283e722856abcfd34bac063435a2213b77bef

See more details on using hashes here.

File details

Details for the file beautifulsoup4-4.7.0-py2-none-any.whl.

File metadata

  • Download URL: beautifulsoup4-4.7.0-py2-none-any.whl
  • Upload date:
  • Size: 94.6 kB
  • Tags: Python 2
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/18.4 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.0+

File hashes

Hashes for beautifulsoup4-4.7.0-py2-none-any.whl
Algorithm Hash digest
SHA256 6a7f5e0efc563cd1ffeefba6d528b97aa0d313c02dd126ba6c455e5fe5bd48eb
MD5 199d5274c7ca7158fe8c9555e0b70d5f
BLAKE2b-256 7d66f2676324158d591e4a920e71d60fc9301a035f5e39c520cf2ad766712c83

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page