Skip to main content

Easiest zero-config selenium webdriver for Python

Project description

open-webdriver

The simplest and easiest way to get a selenium webdriver

Platform Unit Tests

Actions Status Actions Status Actions Status

Platform binary nuitka build

Actions Status Actions Status Actions Status

Ubuntu Install Tests

Actions Status

Install

python -m pip install open-webdriver

Api

from open_webdriver import open_webdriver

with open_webdriver(headless=False) as driver:
    driver.get("https://www.google.com")
    assert driver.title == "Google"

About

Yet another selenium webdriver wrapper API in python, with the aims of being the easist to use with only two lines of code to get running.

Unlike other selenium web driver wrappers, this one has tests for Windows10/MacOS/Ubuntu platforms.

One function is provided, open_webdriver(...) which takes care of downloading, installing and then running selenium.

Additionally, sane defaults are set, such as headless by default and ssl certs turned off. This code is also tested and examples are provided for use with the nuitka cross compiler, which allows you to create an binary executable. This is great for distributing a compiled binary for Windows/MacOS/Ubuntu of your selenium bot with all original source code removed, making it impossible to reverse engineer.

open-webdriver is built on top of webdriver-manager https://pypi.org/project/webdriver-manager/ library, but with the following changes/fixes:

os.environ['WDM_SSL_VERIFY'] = '0'

And other sensible platform specific fixes are applied in order for the selenium driver stack to pass the test suite.

Additionally, a versioned chromium binary is downloaded for Linux & Windows, while whatever Chrome system is used for Mac, due to app signing requirements.

When your app is launched, there will be a side folder name .wdm which contain the download of the webdriver used and brawser used. The disk cache for the driver is set for 7 day, after which it will be checked for a new version.

Benefits:

  • Production ready. Cross platform tests.
  • ssl certs are turned off to reduce errors for many websites.
  • Downloading the proper binary for your platform and stashing it next to the app.
  • Headless by default.
  • Intelligently forces headless in a linux environment without a display card (prevents crash).
  • Platform tests to ensure a stable cross platform experience.
  • Pins to a specific version of selenium driver stack to ensure reproducable behavior.
  • Nuitka Binary Builds for all platforms are tested.

Downsides:

  • Only chrome is supported right now.

Version

Chromium uses version: 101.0.4951.64-1

Tests

Dev:

Just simply run tox at the command line and everything should be tested. You may need to install tox with python -m pip tox.

Package Test:

Run open_webdriver_test for package tests. This is useful if you are on a server and want to figure out if open_webdriver will be able to be run in headless mode using the chrome driver.

Docker

Please see Dockerfile for requirements for including open_webdriver in your Docker app.

Docker is supported in this build. Please see the Dockerfile and docker-compose.yml for bringup instructions. Simply use docker-compose up and then ssh into the docker instance and run open_webdriver_test and verify that the test completes normally.

Nuitka

This package supports the Nuitka cross compiler to binary app. However to make this work YOU MUST include the package data for selenium or you will get errors about missing javascript files when the program loads. To get around this you'll need to add package data:

python -m nuitka --include-package-data=selenium ...

For example see the example build file: https://github.com/zackees/open-webdriver/blob/main/open_webdriver/tests/nuitka/test_binary_build.py

Pull Requests

Pull requests are welcome for this code base. When you submit your pull request you will need to have the following:

  • New code must have a unit/test.
  • Must pass the linting requirements. Run tox (also run on your pull request).

Changes

  • 1.3.4: Fixes nuitka builds that broke with panda's update. Nuitka updated from 0.7.7->1.2.2
  • 1.3.3: Adds user_agent.
  • 1.3.2: Adds disable_dev_shm_usage.
  • 1.3.1: Adds disable gpu.
  • 1.3.0: Concurrent support added for open_webdriver() using a lockfile.
  • 1.2.9: Sets downloaded chromedriver version to 101.0.4951.41
  • 1.2.8: Docker support has been added.
  • 1.2.3: Fix bug in 7za unarchiver path.
  • 1.2.2: 7za unarchiver is now included.
  • 1.2.1: Bug fixes and other improvements that easy deployment.
  • 1.2.0: All platforms supported now. Linux / Win32 now downloads a chromioum browser. Firefox has been removed.
  • 1.1.14: Fixes bugs for open_webdriver_test cmd
  • 1.1.10: Adds package test open_webdriver_test cmd
  • 1.1.9: Moves tests into package to allow running tests from package.
  • 1.1.8: Minor fixes
  • 1.1.7: Nit readme.
  • 1.1.6: Fixes failing win-tox tests due to missing "PROGRAMW6432" value in os.environ (?!). Brave browser removed as it actually didn't work.
  • 1.1.5: Cert warnings now suppressable with non headless sessions.
  • 1.1.3: Suppress more cert warnings.
  • 1.1.2: Suppress certificate warnings.
  • 1.1.1: Update readme.
  • 1.1.0: Platform binary builds using nuitka are now tested.
  • 1.0.4: Now pins dependencies.
  • 1.0.0: Initial code submit.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

open_webdriver-1.3.4.tar.gz (12.0 kB view details)

Uploaded Source

Built Distribution

open_webdriver-1.3.4-py2.py3-none-any.whl (10.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file open_webdriver-1.3.4.tar.gz.

File metadata

  • Download URL: open_webdriver-1.3.4.tar.gz
  • Upload date:
  • Size: 12.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.8

File hashes

Hashes for open_webdriver-1.3.4.tar.gz
Algorithm Hash digest
SHA256 d6ba08a7544c90641fcef7d71bbda82155d78fd8477f68d7b753c46b4fbc12b8
MD5 1984544d345357c780144b3f28d06a91
BLAKE2b-256 791eb85474398478e0ec7d4f884d530ffd30736b39bfa0d5531013a633a8325c

See more details on using hashes here.

File details

Details for the file open_webdriver-1.3.4-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for open_webdriver-1.3.4-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 d812581cefaf884b67f3532b48cc63c872c8652bb01d50ec5a2ee5a4542193fa
MD5 ce3268e61569c408338faaed216b939c
BLAKE2b-256 d6a2153d06f76ba9d59ca09e095892f63dfbd5949cab2e4b974cbbbcc861691a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page