Skip to main content

Extends Selenium WebDriver classes to include the request function from the Requests library, while doing all the needed cookie and request headers handling.

Project description

Selenium Requests

Extends Selenium WebDriver classes to include the request function from the Requests library, while doing all the needed cookie and request headers handling.

Before the actual request is made, a local HTTP server is started that serves a single request made by the webdriver instance to get the "standard" HTTP request headers sent by this webdriver; these are cached (only happens once during its lifetime) and later used in conjunction with the Requests library to make the requests look identical to those that would have been sent by the webdriver. Cookies held by the webdriver instance are added to the request headers and those returned in a response automatically set for the webdriver instance.

Features

  • Determines and sends the default HTTP headers (User-Agent etc.) for the chosen WebDriver
  • Manages cookies bidirectionally between requests and Selenium
  • Switches to already existing window handles or temporarily creates them to work with the webdriver's cookies when making a request
  • All operations preserve the original state of the WebDriver (active window handle and window handles)
  • Tested to work with Selenium (v4.1.0) using Mozilla Firefox (v97.0) and Chromium (v98.0.4758.80)

Usage

# Import any WebDriver class that you would usually import from
# selenium.webdriver from the seleniumrequests module
from seleniumrequests import Firefox

# Simple usage with built-in WebDrivers:
webdriver = Firefox()
response = webdriver.request('GET', 'https://www.google.com/')
print(response)


# More complex usage, using a WebDriver from another Selenium-related module:
from seleniumrequests.request import RequestsSessionMixin
from someothermodule import CustomWebDriver


class MyCustomWebDriver(RequestsSessionMixin, CustomWebDriver):
    pass


custom_webdriver = MyCustomWebDriver()
response = custom_webdriver.request('GET', 'https://www.google.com/')
print(response)

Installation

pip install selenium-requests

Remote WebDriver

When using webdriver.Remote it is very likely that the HTTP proxy server spawned by selenium-requests does not run on the same machine. By default, the webdriver tries to access the proxy server under 127.0.0.1. This can be changed by passing the proxy_host= argument with the correct IP or hostname to the webdriver.

driver = seleniumrequests.Remote(
    'http://192.168.101.1:4444/wd/hub',
    options=chrome_options,
    proxy_host='192.168.101.2'
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

selenium_requests-2.0.4.tar.gz (6.1 kB view details)

Uploaded Source

Built Distribution

selenium_requests-2.0.4-py3-none-any.whl (6.8 kB view details)

Uploaded Python 3

File details

Details for the file selenium_requests-2.0.4.tar.gz.

File metadata

  • Download URL: selenium_requests-2.0.4.tar.gz
  • Upload date:
  • Size: 6.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.7 Linux/6.7.6-arch1-1

File hashes

Hashes for selenium_requests-2.0.4.tar.gz
Algorithm Hash digest
SHA256 8c5366561a366a6eeb05caa8c9141a18b4dbb672c90404e240d00c5301409251
MD5 479c2e1efd9226755a4431dc3eddf64c
BLAKE2b-256 de5da8b846d23566d806035f8220945563c8cbd819635b5cdf50da8916ba6c49

See more details on using hashes here.

File details

Details for the file selenium_requests-2.0.4-py3-none-any.whl.

File metadata

  • Download URL: selenium_requests-2.0.4-py3-none-any.whl
  • Upload date:
  • Size: 6.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.7 Linux/6.7.6-arch1-1

File hashes

Hashes for selenium_requests-2.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ab6e4ebee0fdd7185dcf289c90227cec4bd1056d097cf690c78105fbcb9c29d3
MD5 0d13ff6ad40ff70c6a7cdd95eb7b2148
BLAKE2b-256 7b2c9c3b3fbe42f3e1643ec24e31f76bd52642cc3a3e43423d62be7ea61d4342

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page