Skip to main content

A package for advanced Scrapy functionality and utilities.

Project description

Scraid

scraid is a Python library that provides advanced utilities for Scrapy, including an advanced features and utilities.

Installation

You can install scraid from PyPI:

pip install scraid

Usage

Here's a basic example of how to use the AdvancedRequest class:

from scraid.advanced_request import advancedRequest

request = AdvancedRequest('http://example.com')
print(request.headers['User-Agent'])  # prints the random User-Agent

License

MIT

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

TODO

  • Add more scrapy most common utilities (middlewares, pipelines, etc.)
  • Add more advanced request features
  • Add more documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scraid-0.12.tar.gz (2.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scraid-0.12-py3-none-any.whl (2.7 kB view details)

Uploaded Python 3

File details

Details for the file scraid-0.12.tar.gz.

File metadata

  • Download URL: scraid-0.12.tar.gz
  • Upload date:
  • Size: 2.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.12.tar.gz
Algorithm Hash digest
SHA256 fd12bfa20128e5d4d87ac7466a08109c57611d6fbdda3217211365c4f011ee9b
MD5 38b4b0064764d0ee52e462b31e9fd482
BLAKE2b-256 a9f62ba61c9a1e938660f11d2a3225ba749967841829c32da1d2f309ebf3f234

See more details on using hashes here.

File details

Details for the file scraid-0.12-py3-none-any.whl.

File metadata

  • Download URL: scraid-0.12-py3-none-any.whl
  • Upload date:
  • Size: 2.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for scraid-0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 42b25b41e1de069923f9421d014096e16ac9d25364982bcf835cacf94c0464de
MD5 892d98cdacb49f8bb64058f6ed2bc0aa
BLAKE2b-256 b0081bb9ac5f7bb7295eff2ee46b1bff13d7e02c4ebef7eab61febea1bfd56ee

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page