Skip to main content

Utilities for Web Scraping

Project description

WebScraping Utils

https://img.shields.io/pypi/dm/d-utils

###Project description Python module to facilitate downloading and deploying WebDriver binaries. The classes in this module can be used to automatically search for and download the latest version (or a specific version) of a WebDriver binary (will download to $HOME/webdriver or /usr/local/webdriver if run with sudo), extract the binary from the downloaded archive and create a symlink in either /usr/local/bin (if run with sudo) or $HOME/bin. Note: For non-root users, the $HOME/bin directory may not be in the search PATH. If you are unable to add this directory your search path, a workaround is to capture the return value from the download() or download_and_install() method (see the docstrings for those methods for more information on the return values) and pass the path to the downloaded webdriver binary as a parameter to the constructor for the Selenium WebDriver instance. See the documentation for the executable_path parameter for the relevant WebDriver class for more information.

###Installation This module is available on the Python Package Index (PyPI) and can be installed as follows:

$ pip3 install d-utils

###Classes The following classes are available:

  • ChromeDriverDownloader for downloading and installing chromedriver (for Google Chrome).
  • GeckoDriverDownloader for downloading and installing geckodriver (for Mozilla Firefox).
  • OperaChromiumDriverDownloader for downloading and installing operadriver (for Chromium based Opera browsers). ###Example module usage ####Supported Modules:
  • platform_driver("Path")

use the path whether it exists or not /home/USER/bin/chromedriver

driver = platform_driver("/home/USER/bin/chromedriver")
driver.get(url)
  • cicle_browser("BrowserName")
driver = cicle_browser("Firefox")
driver.get(url)
  • switch_to("BrowserName")
driver = switch_to("Firefox")
driver.get(url)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

d-utils-0.0.9.tar.gz (15.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

d_utils-0.0.9-py3-none-any.whl (15.1 kB view details)

Uploaded Python 3

File details

Details for the file d-utils-0.0.9.tar.gz.

File metadata

  • Download URL: d-utils-0.0.9.tar.gz
  • Upload date:
  • Size: 15.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.2

File hashes

Hashes for d-utils-0.0.9.tar.gz
Algorithm Hash digest
SHA256 4c252e6ce81a2be404fbb8e98e60cf282d764e2169c366845f0288b2eeba62e0
MD5 c684b9a266d336fce33d2438cbf407a4
BLAKE2b-256 990dadfe250f861c2c985ac1e29c00eaac7e4259921dba9e70f455bf47ff4878

See more details on using hashes here.

File details

Details for the file d_utils-0.0.9-py3-none-any.whl.

File metadata

  • Download URL: d_utils-0.0.9-py3-none-any.whl
  • Upload date:
  • Size: 15.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.2

File hashes

Hashes for d_utils-0.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 dbd0c311da93003c4eaac3045ba2e373b9e779564ebe3867542ab1e34aa46c14
MD5 8deadbc8c143e3a6b951e2793d027399
BLAKE2b-256 4289a0825558ded7b31c689ce1a2723b97ba3c8a0b5df7058ea88a30a24fa0ca

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page