Skip to main content

Scrapy-JA3

Scrapy-JA3 is used to forge JA3 fingerprints in Scrapy, by modifying DEFAULT_CIPHERS, which is used in the packaging of Scrapy TLS

LICENSE

MIT license

Requirements

  • Python >= 3.6.0

  • Scrapy >= 2.6.0

  • Works on Linux, Windows, macOS

Installation

From pip

pip install scrapy-ja3

From GitHub

Uninstall

pip uninstall scrapy-ja3

Usage

from scrapy import Request, Spider


class Ja3TestSpider(Spider):
    name = 'ja3_test'

    custom_settings = {
        'DOWNLOAD_HANDLERS': {
            'http': 'scrapy_ja3.download_handler.JA3DownloadHandler',
            'https': 'scrapy_ja3.download_handler.JA3DownloadHandler',
        }
    }

    def start_requests(self):
        start_urls = [
            'https://tls.browserleaks.com/json',
        ]
        for url in start_urls:
            yield Request(url=url, callback=self.parse_ja3)

    def parse_ja3(self, response):
        self.logger.info(response.text)
        self.logger.info("ja3_hash: " + response.json()['ja3_hash'])

History

0.1.2 (2024-08-13)

  • Fix file not found bug

0.1.1 (2024-08-13)

  • Optimize Readme file

0.1.0 (2024-08-13)

  • First release on PyPI.

Metadata

Release files for scrapy-ja3 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scrapy-ja3 0.1.3
File Size Uploaded
scrapy-ja3-0.1.3.tar.gz 3.4 kB Details

Release files / scrapy-ja3-0.1.3.tar.gz

Download URL scrapy-ja3-0.1.3.tar.gz
Size 3.4 kB
Tags Source
SHA-256 checksum
How to use checksums
b3e9d4c378b96c02e0dbcfb45819de851020cb54fcad1212c064745df9e33d8c
BLAKE2b-256 checksum
How to use checksums
92b710cb221b53868d63e80942044890c4e1983617ca5d4a0c6652c9a771a069
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.10.6

Release history Release notifications | RSS feed

This release

0.1.3 This release

1 release file

0.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page