Skip to main content

The handler working with aCrawler and Prometheus

Project description

acrawler-cfscrape

The handler works with aCrawler and cloudflare-scrape

Installation

$ pip install acrawler_cfscrape

Usage

Add Handler:

class MyCrawler(Crawler):
    middleware_config = {
        "acrawler_cfscrape.CfscrapeHandler": True,
    }

    config = {
        "CFS_COOKIES_FILE": Path.home() / ".cfscookies",
        "CFS_URL": "http://www.example.com",
        "CFS_PROXIES": None,
    }

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

acrawler_cfscrape-0.0.3.tar.gz (2.1 kB view details)

Uploaded Source

File details

Details for the file acrawler_cfscrape-0.0.3.tar.gz.

File metadata

  • Download URL: acrawler_cfscrape-0.0.3.tar.gz
  • Upload date:
  • Size: 2.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.6.7

File hashes

Hashes for acrawler_cfscrape-0.0.3.tar.gz
Algorithm Hash digest
SHA256 c62ced6a40700cb302c0d8e18d67a1ba8743463ba91532ec34e9817db6926970
MD5 5806357f5dee8ea39799b716af8065d9
BLAKE2b-256 a3d6b3180c063c92200bc8661175cec8b6c2e50059a98a637a6f14c3e79e784a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page