A wrapper created to make using requests and BeautifulSoup in conjunction easier
Project description
Welcome to RequestSoup!
RequestSoup was created with the goal to make Python web-scraping easier. The package interfaces both requests and BeautifulSoup, making them easier to use in conjunction with one another.
Installation
The installation process for RequestSoup is pretty easy! Just enter the following command in your terminal:
pip install RequestSoup
Usage
Usage of the package is almost identical to the indiviual use of requests and BeautifulSoup. Here is an example:
import RequestSoup as scraper
r = scraper.get("https://google.com")
# The Variable r is a Request Response Object
elements = scraper.findAll("a",{"href":"/"})
#elements will now be a list of all "a" elements on the page with an herf that points to "/"
For more detailed usage check out: https://requestsoup.readthedocs.io/en/latest/
Sessions
The package also features the ability to create Request Sessions. An example of this is provided here:
import RequestSoup as scraper
session = scraper.Session()
session.get("https://google.com")
#The session object makes it much easier to work with and send multiple requests to the same website
Feedback
This is my first public python package and I would appreciate any user feedback. For feature requests or changes, feel free to create an issue or pull request on the GitHub repo.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
File details
Details for the file RequestSoup-1.0.4-py3-none-any.whl
.
File metadata
- Download URL: RequestSoup-1.0.4-py3-none-any.whl
- Upload date:
- Size: 4.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7b4988c7bf2e35efde322cff1d653b520608ae3d22cf73603f0b88b7bbfd6d2a |
|
MD5 | fa236cad27fb135417a4efec68470c08 |
|
BLAKE2b-256 | 9641f483e25d925675ecba3af301f640b7a259303f111c6596214464c996339b |
File details
Details for the file RequestSoup-1.0.4-py2-none-any.whl
.
File metadata
- Download URL: RequestSoup-1.0.4-py2-none-any.whl
- Upload date:
- Size: 4.5 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ffdb8658e5e34b006cf6ac8ad05d76b833d21094eb2e6c235ccbc842711e8100 |
|
MD5 | 07a81814ac28a5854d19ccb35dcd3906 |
|
BLAKE2b-256 | 11e70c838ee8534d5b1441159c7aa5aa697c0ff3744cdb6ec365ee8b2844f1b4 |