Skip to main content

A Python module to process bulk data using Google's generative AI (Gemini).

Project description

GeminiDataProcessor

Overview

GeminiDataProcessor is a Python library that streamlines data processing through the use of Google's generative AI models (Gemini). It allows users to generate structured responses for tabular datasets using customizable prompts and schemas.

Features

  • Integration with Gemini AI: Process data through Google's generative AI models.
  • Asynchronous Processing: Supports efficient handling of large datasets using asyncio.
  • Flexible Schema: Define custom output schemas for structured JSON responses.
  • Error Handling: Robust error management for API and data parsing issues.
  • Progress Tracking: Real-time processing feedback with tqdm.

Installation

You can install the module using pip:

pip install gemini_data_processor
from gemini_batch_processor import GeminiBot

bot = GeminiBot(
    input_file="input_data.csv",
    prompt_template="Generate a summary for: {row[column name]}",
    key_names="summary,details",
    api_key="your_google_api_key",
    model="gemini-1.5-flash-002"
)
from gemini_batch_processor import GeminiBot
GeminiBot.model_list(api_key="your_api_key")

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gemini_batch_processor-1.0.0.tar.gz (2.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gemini_batch_processor-1.0.0-py3-none-any.whl (2.8 kB view details)

Uploaded Python 3

File details

Details for the file gemini_batch_processor-1.0.0.tar.gz.

File metadata

  • Download URL: gemini_batch_processor-1.0.0.tar.gz
  • Upload date:
  • Size: 2.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for gemini_batch_processor-1.0.0.tar.gz
Algorithm Hash digest
SHA256 aaf3cf9af5bb76ff800575269c218d4bf8a58ca190a470cb7813ed10db0d4756
MD5 99bd015722c1ea2a6e9bde95159a4597
BLAKE2b-256 6fce1cfa6a73bc54a832b5e3cf260d8cca52be31d4b9cf20f8855dc9180d9956

See more details on using hashes here.

File details

Details for the file gemini_batch_processor-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for gemini_batch_processor-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3a769ad70993795b391cca6fb03d60afd02173cf9c5e915cb1084980b51fbe3d
MD5 245a8ef8bbf971ec1276abd676120be5
BLAKE2b-256 88ba49153e111ea393d45f42039f551d08e327943c24510835d5f613f1c36332

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page