Skip to main content

LLM integration for Scrapy

Project description

Scrapy-LLM

LLM integration for scrapy as a middleware.

view - Documentation    

GitHub Actions

Installation

pip install scrapy-llm

Usage

# settings.py
DOWNLOADER_MIDDLEWARES = {
    'scrapy_llm.handler.LlmExtractorMiddleware'
    ...
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy_llm-0.1.5.tar.gz (7.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scrapy_llm-0.1.5-py3-none-any.whl (5.0 kB view details)

Uploaded Python 3

File details

Details for the file scrapy_llm-0.1.5.tar.gz.

File metadata

  • Download URL: scrapy_llm-0.1.5.tar.gz
  • Upload date:
  • Size: 7.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.0 CPython/3.12.4

File hashes

Hashes for scrapy_llm-0.1.5.tar.gz
Algorithm Hash digest
SHA256 6693e7f6b7c32529275ae75abc0d3aca7d7f61de78e6cdd2f1fcd4420887b206
MD5 b7d1fddd11291c632f820473b7d68f49
BLAKE2b-256 a0ed3ad4122d1a7c673c431c77d8c249d2cfb4b9b7cbc570a3ad0513e7a778db

See more details on using hashes here.

File details

Details for the file scrapy_llm-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: scrapy_llm-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 5.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.0 CPython/3.12.4

File hashes

Hashes for scrapy_llm-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 f05db36735a701e80ef214a860e861afc9903d01d9a4f1d6663e6e2222846aec
MD5 062e6d6a7db5090170e914ce48474378
BLAKE2b-256 501143eed8c3b188c397e3bc088dd44a56118f8175189329bd1741e67d6693a9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page