Skip to main content

A package for advanced Scrapy functionality and utilities.

Project description

Scraid

scraid is a Python library that provides advanced utilities for Scrapy, including an advanced features and utilities.

Installation

You can install scraid from PyPI:

pip install scraid

Usage

Here's a basic example of how to use the AdvancedRequest class:

from scraid.advanced_request import advancedRequest

request = AdvancedRequest('http://example.com')
print(request.headers['User-Agent'])  # prints the random User-Agent

License

MIT

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

TODO

  • Add more scrapy most common utilities (middlewares, pipelines, etc.)
  • Add more advanced request features
  • Add more documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scraid-0.11.tar.gz (2.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scraid-0.11-py3-none-any.whl (2.7 kB view details)

Uploaded Python 3

File details

Details for the file scraid-0.11.tar.gz.

File metadata

  • Download URL: scraid-0.11.tar.gz
  • Upload date:
  • Size: 2.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.11.tar.gz
Algorithm Hash digest
SHA256 72b164ae4dd7efff3bfcc1b0e1a7556e2c012919b9a4550385fb083e80217bc1
MD5 7743512a05bc3b0bee6900f6efdd2668
BLAKE2b-256 fe14e9b695a07006ed93daecf12d893dccb3161ebb92f77097c072e42d362873

See more details on using hashes here.

File details

Details for the file scraid-0.11-py3-none-any.whl.

File metadata

  • Download URL: scraid-0.11-py3-none-any.whl
  • Upload date:
  • Size: 2.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 a2538d4b156d17198b0b806486527256626746f5cce6b7d363d164f9e8ca6c41
MD5 6cce188f7bc90decc91316438222fc2f
BLAKE2b-256 a4bc93040b96a6fa2261992eab3ae00267b018ba4d6d962952fb7c33384679d0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page