Skip to main content

Scrapy-JA3

Scrapy-JA3 is used to forge JA3 fingerprints in Scrapy, by modifying DEFAULT_CIPHERS, which is used in the packaging of Scrapy TLS

LICENSE

MIT license

Requirements

  • Python >= 3.6.0

  • Scrapy >= 2.6.0

  • Works on Linux, Windows, macOS

Installation

From pip

pip install scrapy-ja3

From GitHub

Uninstall

pip uninstall scrapy-ja3

Usage

from scrapy import Request, Spider


class Ja3TestSpider(Spider):
    name = 'ja3_test'

    custom_settings = {
        'DOWNLOAD_HANDLERS': {
            'http': 'scrapy_ja3.download_handler.JA3DownloadHandler',
            'https': 'scrapy_ja3.download_handler.JA3DownloadHandler',
        }
    }

    def start_requests(self):
        start_urls = [
            'https://tls.browserleaks.com/json',
        ]
        for url in start_urls:
            yield Request(url=url, callback=self.parse_ja3)

    def parse_ja3(self, response):
        self.logger.info(response.text)
        self.logger.info("ja3_hash: " + response.json()['ja3_hash'])

History

0.1.2 (2024-08-13)

  • Fix file not found bug

0.1.1 (2024-08-13)

  • Optimize Readme file

0.1.0 (2024-08-13)

  • First release on PyPI.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-ja3-0.1.3.tar.gz (3.4 kB view details)

Uploaded Source

File details

Details for the file scrapy-ja3-0.1.3.tar.gz.

File metadata

  • Download URL: scrapy-ja3-0.1.3.tar.gz
  • Upload date:
  • Size: 3.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.6

File hashes

Hashes for scrapy-ja3-0.1.3.tar.gz
Algorithm Hash digest
SHA256 b3e9d4c378b96c02e0dbcfb45819de851020cb54fcad1212c064745df9e33d8c
MD5 6d94af82cb9cf70961baeacc936f5a80
BLAKE2b-256 92b710cb221b53868d63e80942044890c4e1983617ca5d4a0c6652c9a771a069

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.1.3 This release

1 file

0.1.0

1 file

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page