Skip to main content

WaterCrawl OpenAI Plugin

Project description

Watercrawl-OpenAI Plugin

version: 0.0.1 author: Watercrawl

PyPI version License: MIT

Description

This plugin allows you to use OpenAI's LLM to extract information from crawled content.

Installation

You can install this plugin using pip:

pip install watercrawl-openai

Usage

To use this plugin in your Watercrawl project, import it as follows:

In the WaterCrawl project environments add the following:

WATER_CRAWL_PLUGINS="watercrawl_openai.OpenAIPlugin,...rest_of_plugins"

Configuration

Make sure to set the following environment variables:

OPENAI_API_KEY="Your OpenAI API key"
EXTRACT_SYSTEM_PROMPT="Your system prompt"

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Links

GitHub: https://github.com/watercrawl/watercrawl-openai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

watercrawl_openai-0.1.1.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

watercrawl_openai-0.1.1-py3-none-any.whl (5.2 kB view details)

Uploaded Python 3

File details

Details for the file watercrawl_openai-0.1.1.tar.gz.

File metadata

  • Download URL: watercrawl_openai-0.1.1.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.12.9 Darwin/24.6.0

File hashes

Hashes for watercrawl_openai-0.1.1.tar.gz
Algorithm Hash digest
SHA256 a4a10160f70d76d519759aa69f75ca2c344716e2479edb6b6f937bec2296165a
MD5 190eeb427ced67aa36d59f3a3a5e6456
BLAKE2b-256 3cfca1546fc09c20c403de51e6b8d2e33551b5e3be1f05d90bfcad5adf8f7164

See more details on using hashes here.

File details

Details for the file watercrawl_openai-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: watercrawl_openai-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 5.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.12.9 Darwin/24.6.0

File hashes

Hashes for watercrawl_openai-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 44b339e51a310737c9980b94bab1400fa483f96e0e27ed23e02d3c23199de7f8
MD5 31ff9260353a793d65c222d0c7fa093e
BLAKE2b-256 8aac900775d9411b7e2a00a51967acf4c6128582c02afbcb0e4f3fa9e8713423

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page