Skip to main content

A simple package for scraping websites and generating responses using Google's Generative AI.

Project description

ai-scraper

A simple package for scraping websites and generating responses using Google's Generative AI.

Features

  • Scrapes a webpage using Selenium with headless Chrome.
  • Passes scraped HTML into a Generative AI model along with custom instructions.
  • Returns the AI-generated response.

Installation

You can install the package via pip (after publishing to PyPI):

bash pip install ai-scraper

Usage example

from ai_scraper import scrape

response_text = scrape( google_api_key="YOUR_GOOGLE_API_KEY", url="https://webscraper.io/test-sites/e-commerce/allinone", instructions="Return all products names, in JSON." ) print(response_text)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_gemini_scraper-0.1.1.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_gemini_scraper-0.1.1-py3-none-any.whl (4.0 kB view details)

Uploaded Python 3

File details

Details for the file ai_gemini_scraper-0.1.1.tar.gz.

File metadata

  • Download URL: ai_gemini_scraper-0.1.1.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ai_gemini_scraper-0.1.1.tar.gz
Algorithm Hash digest
SHA256 68cf626298ff901ac4cf4d8697c61f397f6e9ef8dde94e30a9604f1b6c808c63
MD5 ab6215b6beda4850c6b44237ed486947
BLAKE2b-256 7758ca34bbca55b4e7a1724b2c69aad704a13b3af89d5abc129cdb1ddaefb0ac

See more details on using hashes here.

File details

Details for the file ai_gemini_scraper-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for ai_gemini_scraper-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1e4621851784f1e03efdc4c335a0d6414cb3383290f9aad753d750469df3d774
MD5 957ca9361036003b5ad61baf10327dcf
BLAKE2b-256 95ae1712eb0550133af435c0d99aada48aa8d3d157a1e7d4ef67938d27d14cf1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page