acrawler-cfscrape

The handler works with aCrawler and cloudscraper

Installation

$ pip install acrawler_cfscrape

Usage

Add Handler:

class MyCrawler(Crawler):
    middleware_config = {
        "acrawler_cfscrape.CfscrapeHandler": True,
    }

    config = {
        "CFS_COOKIES_FILE": Path.home() / ".cfscookies",
        "CFS_URL": "http://www.example.com",
        "CFS_PROXIES": None,
    }

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

acrawler_cfscrape-0.0.5.tar.gz (2.1 kB view details)

Uploaded Nov 12, 2019 Source

File details

Details for the file acrawler_cfscrape-0.0.5.tar.gz.

File metadata

Download URL: acrawler_cfscrape-0.0.5.tar.gz
Upload date: Nov 12, 2019
Size: 2.1 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.37.0 CPython/3.7.4

File hashes

Hashes for acrawler_cfscrape-0.0.5.tar.gz
Algorithm	Hash digest
SHA256	`a98a8830496034233b39fb954f094a087f589ecff3863636bf9426ba44613fce`
MD5	`f0fc097fb64fe679cf18b8ff9addb803`
BLAKE2b-256	`dcff4e5f16ade5e11f9f8641b18f93188c8e1612f8cc134573a5d203b1969a11`