Skip to main content

A blazing fast, async-first, undetectable webscraping/web automation framework

Project description

Zendriver ✌️

This package is a fork of the ultrafunkamsterdam/nodriver, created to add new features, compile unmerged bugfixes, and increase community engagement.

Documentation: https://slensky.com/zendriver

Zendriver is a blazing fast, async-first, undetectable webscraping/web automation framework implemented using the Chrome Devtools Protocol. Visit websites, scrape content, and run JavaScript using a real browser (no Selenium/Webdriver) all with just a few lines of Python.

Docker support is here! Check out stephanlensky/zendriver-docker for an example of how to run Zendriver with a real, GPU-accelerated browser (not headless) in a Docker container. (Linux-only)

Features

  • Undetectable - Zendriver uses the Chrome Devtools Protocol instead of Selenium/WebDriver, making it (almost) impossible to detect
  • Blazing fast - Chrome Devtools Protocol is fast, much faster than previous Selenium/WebDriver solutions. CDP combined with an async Python API makes Zendriver highly performant.
  • Feature complete and easy to use - Packed with allowing you to get up and running in just a few lines of code.
  • First-class Docker support - Traditionally, browser automation has been incredibly difficult to package with Docker, especially if you want to run real, GPU-accelerated Chrome (not headless). Now, deploying with Docker is easier than ever using the officially supported zendriver-docker project template.
  • Automatic cookie and profile management - By default, uses fresh profile on each run, cleaning up on exit. Or, save and load cookies to a file to avoid repeating tedious login steps.
  • Smart element lookup - Find elements selector or text, including iframe content. This could also be used as wait condition for a element to appear, since it will retry for the duration of timeout until found. Single element lookup by text using tab.find() accepts a best_match flag, which will not naively return the first match, but will match candidates by closest matching text length.
  • Easy debugging - Descriptive repr for elements, which represents the element as HTML, makes debugging much easier.

Installation

To install, simply use pip (or your favorite package manager):

pip install zendriver
# or uv add zendriver, poetry add zendriver, etc.

Usage

Example for visiting https://www.browserscan.net/bot-detection and saving a screenshot of the results:

import asyncio

import zendriver as zd


async def main():
    browser = await zd.start()
    page = await browser.get("https://www.browserscan.net/bot-detection")
    await page.save_screenshot("browserscan.png")
    await browser.stop()


if __name__ == "__main__":
    asyncio.run(main())

Check out the Quickstart for more information and examples.

Rationale for the fork

Zendriver remains committed to nodriver's goals of staying undetected for all modern anti-bot solutions and also keeps with the batteries-included approach of its predecessor. Unfortunately, contributions to the original nodriver repo are heavily restricted, making it difficult to submit issues or pull requests. At the time of writing, there are several pull requests open to fix critical bugs which have beeen left unaddressed for many months.

Zendriver aims to change this by:

  1. Including open pull requests in the original nodriver repo as part of the initial release
  2. Modernizing the development process to include static analysis tools such as ruff and mypy, reducing the number of easy-to-catch bugs which make it through in the future
  3. Opening up the issue tracker and pull requests for community contributions, allowing the project to continue to grow along with its community.

With these changes in place, we hope to further development of state-of-the-art open-source web automation tools even further, helping to once again make the web truly open for all.

Contributing

Contributions of all types are always welcome! Please see CONTRIBUTING.md for details on how to contribute.

Getting additional help

If you have a question, bug report, or want to make a general inquiry about the project, please create a new GitHub issue. If you are having a problem with Zendriver, please make sure to include your operating system, Chrome version, code example demonstrating the issue, and any other information that may be relevant.

Questions directed to any personal accounts outside of GitHub will be ignored.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

zendriver_flare_bypasser-0.2.6.1.tar.gz (356.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

zendriver_flare_bypasser-0.2.6.1-py3-none-any.whl (332.2 kB view details)

Uploaded Python 3

File details

Details for the file zendriver_flare_bypasser-0.2.6.1.tar.gz.

File metadata

File hashes

Hashes for zendriver_flare_bypasser-0.2.6.1.tar.gz
Algorithm Hash digest
SHA256 943f843c1ebf4c88422de19a2fa9184b3ef52652770f3714632e58d05eed7797
MD5 fa2314af6272e00b7ed9021f594c8e13
BLAKE2b-256 c68fbc565f772ec2c74b2c7300927933a8bd36918de8b87dcb802e46f97d5f21

See more details on using hashes here.

Provenance

The following attestation bundles were made for zendriver_flare_bypasser-0.2.6.1.tar.gz:

Publisher: publish.yml on yoori/zendriver

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file zendriver_flare_bypasser-0.2.6.1-py3-none-any.whl.

File metadata

File hashes

Hashes for zendriver_flare_bypasser-0.2.6.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5abddfecd3dace244b5d4d1df47cdb5277c80b86bf24a82190b4d7dce63c6d85
MD5 2bb0967c1ef214488cc9435825add288
BLAKE2b-256 daa286dfb637d38cccef3dbf52afb9a78cae5c4eaa0ecf083952bc0f4e24905d

See more details on using hashes here.

Provenance

The following attestation bundles were made for zendriver_flare_bypasser-0.2.6.1-py3-none-any.whl:

Publisher: publish.yml on yoori/zendriver

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page