Selenium Requests
Extends Selenium WebDriver classes to include the request function from the Requests library, while doing all the needed cookie and request headers handling.
Before the actual request is made, a local HTTP server is started that serves a single request made by the webdriver instance to get the "standard" HTTP request headers sent by this webdriver; these are cached (only happens once during its lifetime) and later used in conjunction with the Requests library to make the requests look identical to those that would have been sent by the webdriver. Cookies held by the webdriver instance are added to the request headers and those returned in a response automatically set for the webdriver instance.
Features
- Determines and sends the default HTTP headers (User-Agent etc.) for the chosen WebDriver
- Manages cookies bidirectionally between requests and Selenium
- Switches to already existing window handles or temporarily creates them to work with the webdriver's cookies when making a request
- All operations preserve the original state of the WebDriver (active window handle and window handles)
- Tested to work with Selenium (v4.1.0) using Mozilla Firefox (v97.0) and Chromium (v98.0.4758.80)
Usage
# Import any WebDriver class that you would usually import from
# selenium.webdriver from the seleniumrequests module
from seleniumrequests import Firefox
# Simple usage with built-in WebDrivers:
webdriver = Firefox()
response = webdriver.request('GET', 'https://www.google.com/')
print(response)
# More complex usage, using a WebDriver from another Selenium-related module:
from seleniumrequests.request import RequestsSessionMixin
from someothermodule import CustomWebDriver
class MyCustomWebDriver(RequestsSessionMixin, CustomWebDriver):
pass
custom_webdriver = MyCustomWebDriver()
response = custom_webdriver.request('GET', 'https://www.google.com/')
print(response)
Installation
pip install selenium-requests
Remote WebDriver
When using webdriver.Remote it is very likely that the HTTP proxy server spawned by selenium-requests does not run
on the same machine. By default, the webdriver tries to access the proxy server under 127.0.0.1. This can be changed
by passing the proxy_host= argument with the correct IP or hostname to the webdriver.
driver = seleniumrequests.Remote(
'http://192.168.101.1:4444/wd/hub',
options=chrome_options,
proxy_host='192.168.101.2'
)
1 maintainer
Release files for selenium-requests 2.0.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| selenium_requests-2.0.4.tar.gz | 6.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| selenium_requests-2.0.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 12.9 kB
Release files / selenium_requests-2.0.4.tar.gz
| Download URL | selenium_requests-2.0.4.tar.gz |
|---|---|
| Size | 6.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8c5366561a366a6eeb05caa8c9141a18b4dbb672c90404e240d00c5301409251
|
|
BLAKE2b-256 checksum How to use checksums |
de5da8b846d23566d806035f8220945563c8cbd819635b5cdf50da8916ba6c49
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.7.1 CPython/3.11.7 Linux/6.7.6-arch1-1
|
Release files / selenium_requests-2.0.4-py3-none-any.whl
| Download URL | selenium_requests-2.0.4-py3-none-any.whl |
|---|---|
| Size | 6.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ab6e4ebee0fdd7185dcf289c90227cec4bd1056d097cf690c78105fbcb9c29d3
|
|
BLAKE2b-256 checksum How to use checksums |
7b2c9c3b3fbe42f3e1643ec24e31f76bd52642cc3a3e43423d62be7ea61d4342
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.7.1 CPython/3.11.7 Linux/6.7.6-arch1-1
|
