Skip to main content

Utilities for Web Scraping

Project description

WebScraping Utils

https://img.shields.io/pypi/dm/d-utils

###Project description Python module to facilitate downloading and deploying WebDriver binaries. The classes in this module can be used to automatically search for and download the latest version (or a specific version) of a WebDriver binary (will download to $HOME/webdriver or /usr/local/webdriver if run with sudo), extract the binary from the downloaded archive and create a symlink in either /usr/local/bin (if run with sudo) or $HOME/bin. Note: For non-root users, the $HOME/bin directory may not be in the search PATH. If you are unable to add this directory your search path, a workaround is to capture the return value from the download() or download_and_install() method (see the docstrings for those methods for more information on the return values) and pass the path to the downloaded webdriver binary as a parameter to the constructor for the Selenium WebDriver instance. See the documentation for the executable_path parameter for the relevant WebDriver class for more information.

###Installation This module is available on the Python Package Index (PyPI) and can be installed as follows:

$ pip3 install d-utils

###Classes The following classes are available:

  • ChromeDriverDownloader for downloading and installing chromedriver (for Google Chrome).
  • GeckoDriverDownloader for downloading and installing geckodriver (for Mozilla Firefox).
  • OperaChromiumDriverDownloader for downloading and installing operadriver (for Chromium based Opera browsers). ###Example module usage ####Supported Modules:
  • platform_driver("Path")

use the path whether it exists or not /home/USER/bin/chromedriver

driver = platform_driver("/home/USER/bin/chromedriver")
driver.get(url)
  • cicle_browser("BrowserName")
driver = cicle_browser("Firefox")
driver.get(url)
  • switch_to("BrowserName")
driver = switch_to("Firefox")
driver.get(url)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

d-utils-0.0.9.tar.gz (15.3 kB view hashes)

Uploaded Source

Built Distribution

d_utils-0.0.9-py3-none-any.whl (15.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page