Skip to main content

A package for advanced Scrapy functionality and utilities.

Project description

Scraid

scraid is a Python library that provides advanced utilities for Scrapy, including an advanced features and utilities.

Installation

You can install scraid from PyPI:

pip install scraid

Usage

Here's a basic example of how to use the AdvancedRequest class:

from scraid.advanced_request import advancedRequest

request = AdvancedRequest('http://example.com')
print(request.headers['User-Agent'])  # prints the random User-Agent

License

MIT

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

TODO

  • Add more scrapy most common utilities (middlewares, pipelines, etc.)
  • Add more advanced request features
  • Add more documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scraid-0.1.tar.gz (2.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scraid-0.1-py2.py3-none-any.whl (2.7 kB view details)

Uploaded Python 2Python 3

File details

Details for the file scraid-0.1.tar.gz.

File metadata

  • Download URL: scraid-0.1.tar.gz
  • Upload date:
  • Size: 2.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.1.tar.gz
Algorithm Hash digest
SHA256 004c450c0ed06a053add603fe71a39375b510160801a7de5b2658b9930efc3b5
MD5 66e1f000d1ac80b3dbdbb42f3c1ba22e
BLAKE2b-256 c46cae5784983f18f34f99340a54739d871c8f6365a089631208711bfdb2eb4a

See more details on using hashes here.

File details

Details for the file scraid-0.1-py2.py3-none-any.whl.

File metadata

  • Download URL: scraid-0.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 2.7 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 02bb40b1881ab6fcf281e1397395767860acc5ccb0d5261526992b87735524ba
MD5 41ecfbbf2ecdb7267bcce3fcf1507af7
BLAKE2b-256 4718928eee3e0b715f6b210d3905e719d110cadc992cbb63318da750799544c1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page