Skip to main content

Playwright request to make regular request for sites that blocks regular requests like www.amazon.com or www.tripadvisor.com

Project description

Playwright Request for Python

This is a library aiming to help programmers to create requests by using playwright browser and bypass sites like www.amazon.com or www.tripadvisor.com in general, all sites that block regular requests or require a proxy to crawl pages in parallel

This library contains: the code to perform requests and a class to extend and manipulate pages

Installation

pip install playwright-request

Usage

from playwright_request import PlaywrightRequest
#crawl
requester = PlaywrightRequest()
html = requester.get(url="YOUR/SITE")
#alternative to read 
htmls = requester.async_get(urls=["url1","url2"])

# Install CLI tools
``pip install .``

# Author
Pedro Mayorga.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

playwright-request-1.1.0.tar.gz (11.3 kB view hashes)

Uploaded Source

Built Distribution

playwright_request-1.1.0-py3-none-any.whl (10.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page