Skip to main content

Watercrawl-OpenAI Plugin

version: 0.0.1 author: Watercrawl

PyPI version License: MIT

Description

This plugin allows you to use OpenAI's LLM to extract information from crawled content.

Installation

You can install this plugin using pip:

pip install watercrawl-openai

Usage

To use this plugin in your Watercrawl project, import it as follows:

In the WaterCrawl project environments add the following:

WATER_CRAWL_PLUGINS="watercrawl_openai.OpenAIPlugin,...rest_of_plugins"

Configuration

Make sure to set the following environment variables:

OPENAI_API_KEY="Your OpenAI API key"
EXTRACT_SYSTEM_PROMPT="Your system prompt"

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Links

GitHub: https://github.com/watercrawl/watercrawl-openai

Metadata

Release files for watercrawl-openai 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for watercrawl-openai 0.1.1
File Size Uploaded
watercrawl_openai-0.1.1.tar.gz 3.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for watercrawl-openai 0.1.1
File Interpreter ABI Platform
watercrawl_openai-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 9.1 kB

Release files / watercrawl_openai-0.1.1.tar.gz

Download URL watercrawl_openai-0.1.1.tar.gz
Size 3.9 kB
Tags Source
SHA-256 checksum
How to use checksums
a4a10160f70d76d519759aa69f75ca2c344716e2479edb6b6f937bec2296165a
BLAKE2b-256 checksum
How to use checksums
3cfca1546fc09c20c403de51e6b8d2e33551b5e3be1f05d90bfcad5adf8f7164
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.1.2 CPython/3.12.9 Darwin/24.6.0

Release files / watercrawl_openai-0.1.1-py3-none-any.whl

Download URL watercrawl_openai-0.1.1-py3-none-any.whl
Size 5.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
44b339e51a310737c9980b94bab1400fa483f96e0e27ed23e02d3c23199de7f8
BLAKE2b-256 checksum
How to use checksums
8aac900775d9411b7e2a00a51967acf4c6128582c02afbcb0e4f3fa9e8713423
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.1.2 CPython/3.12.9 Darwin/24.6.0

Release history Release notifications | RSS feed

This release

0.1.1 This release

2 release files

0.1.0

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page