Skip to main content

A wrapper created to make using requests and BeautifulSoup in conjunction easier

Project description

Welcome to RequestSoup!

Downloads

RequestSoup was created with the goal to make Python web-scraping easier. The package interfaces both requests and BeautifulSoup, making them easier to use in conjunction with one another.

Installation

The installation process for RequestSoup is pretty easy! Just enter the following command in your terminal:

pip install RequestSoup

Usage

Usage of the package is almost identical to the indiviual use of requests and BeautifulSoup. Here is an example:

import RequestSoup as scraper

r = scraper.get("https://google.com")
# The Variable r is a Request Response Object

elements = scraper.findAll("a",{"href":"/"})
#elements will now be a list of all "a" elements on the page with an herf that points to "/"

For more detailed usage check out: https://requestsoup.readthedocs.io/en/latest/

Sessions

The package also features the ability to create Request Sessions. An example of this is provided here:

import RequestSoup as scraper

session = scraper.Session()
session.get("https://google.com")
#The session object makes it much easier to work with and send multiple requests to the same website

Feedback

This is my first public python package and I would appreciate any user feedback. For feature requests or changes, feel free to create an issue or pull request on the GitHub repo.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

RequestSoup-1.0.4-py3-none-any.whl (4.5 kB view details)

Uploaded Python 3

RequestSoup-1.0.4-py2-none-any.whl (4.5 kB view details)

Uploaded Python 2

File details

Details for the file RequestSoup-1.0.4-py3-none-any.whl.

File metadata

  • Download URL: RequestSoup-1.0.4-py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.3

File hashes

Hashes for RequestSoup-1.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 7b4988c7bf2e35efde322cff1d653b520608ae3d22cf73603f0b88b7bbfd6d2a
MD5 fa236cad27fb135417a4efec68470c08
BLAKE2b-256 9641f483e25d925675ecba3af301f640b7a259303f111c6596214464c996339b

See more details on using hashes here.

File details

Details for the file RequestSoup-1.0.4-py2-none-any.whl.

File metadata

  • Download URL: RequestSoup-1.0.4-py2-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 2
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.3

File hashes

Hashes for RequestSoup-1.0.4-py2-none-any.whl
Algorithm Hash digest
SHA256 ffdb8658e5e34b006cf6ac8ad05d76b833d21094eb2e6c235ccbc842711e8100
MD5 07a81814ac28a5854d19ccb35dcd3906
BLAKE2b-256 11e70c838ee8534d5b1441159c7aa5aa697c0ff3744cdb6ec365ee8b2844f1b4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page