scrapy-ja3 0.1.3

Scrapy download handler for JA3 fingerprinting

Scrapy-JA3

Scrapy-JA3 is used to forge JA3 fingerprints in Scrapy, by modifying DEFAULT_CIPHERS, which is used in the packaging of Scrapy TLS

LICENSE

MIT license

Requirements

• Python >= 3.6.0

• Scrapy >= 2.6.0

• Works on Linux, Windows, macOS

Installation

From pip

pip install scrapy-ja3

From GitHub

Uninstall

pip uninstall scrapy-ja3

Usage

from scrapy import Request, Spider


class Ja3TestSpider(Spider):
    name = 'ja3_test'

    custom_settings = {
        'DOWNLOAD_HANDLERS': {
            'http': 'scrapy_ja3.download_handler.JA3DownloadHandler',
            'https': 'scrapy_ja3.download_handler.JA3DownloadHandler',
        }
    }

    def start_requests(self):
        start_urls = [
            'https://tls.browserleaks.com/json',
        ]
        for url in start_urls:
            yield Request(url=url, callback=self.parse_ja3)

    def parse_ja3(self, response):
        self.logger.info(response.text)
        self.logger.info("ja3_hash: " + response.json()['ja3_hash'])

History

0.1.2 (2024-08-13)

• Fix file not found bug

0.1.1 (2024-08-13)

• Optimize Readme file

0.1.0 (2024-08-13)

• First release on PyPI.