Skip to main content

Harvester SDK - The Complete AI Processing Platform with Agentic Coding Assistants. Unified interface for all AI processing paradigms with enterprise-grade reliability.

Project description

๐Ÿš€ Harvester SDK - Complete AI Processing Platform

"The unified interface for all AI providers with enterprise-grade reliability."

License: MIT Python 3.8+ Providers: 7+

๐ŸŒŸ What is Harvester SDK?

Harvester SDK is a comprehensive AI processing platform that provides a unified interface to all major AI providers. Whether you need text generation, image creation, batch processing, agentic coding, or real-time conversations, Harvester SDK handles the complexity so you can focus on building.

โšก Key Features

  • Multi-Provider Support - OpenAI, Anthropic, Google AI Studio, Vertex AI, XAI, DeepSeek
  • Agentic Coding Assistants - Grok Code Agent (fast) & Claude Code Agent (SDK-powered)
  • Enhanced Chat Experience - prompt_toolkit integration with multi-line paste, command history, and professional line editing
  • Dual Authentication - API keys (GenAI) and service accounts (Vertex AI)
  • Streaming & Turn-Based Chat - Real-time streaming or non-streaming conversations
  • Batch Processing - Cost-effective bulk operations with 50% savings
  • Template System - 30+ Jinja2 templates for AI-powered transformations
  • Image Generation - DALL-E, Imagen, GPT Image support
  • Enterprise Ready - Rate limiting, retries, error handling

๐Ÿš€ Quick Start

Installation

# Install the SDK
pip install harvester-sdk

# Install with all providers
pip install harvester-sdk[all]

# Install specific providers
pip install harvester-sdk[openai,anthropic,genai]

Basic Usage

# Main CLI conductor
harvester --help

# Turn-based conversation (non-streaming)
harvester message --model gemini-2.5-flash
harvester message --model sonnet-4-5 --system "You are a helpful assistant"

# Batch processing from CSV
harvester batch data.csv --model gpt-5 --template quick

# Process directory with templates
harvester process ./src --template refactor --model gemini-2.5-pro

# Generate images
harvester image "A beautiful sunset" --provider dalle3 --size 1024x1024

๐Ÿ”ง Provider Configuration

Google AI Studio (GenAI) - API Key Authentication

export GEMINI_API_KEY=your_api_key
harvester message --model gemini-2.5-flash

Google Vertex AI - Service Account Authentication

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service-account.json
harvester message --model vtx-gemini-2.5-flash

Other Providers

export OPENAI_API_KEY=your_openai_key
export ANTHROPIC_API_KEY=your_anthropic_key
export XAI_API_KEY=your_xai_key
export DEEPSEEK_API_KEY=your_deepseek_key

๐Ÿ“‹ Available Commands

Core Commands

  • harvester chat - Interactive streaming chat with enhanced UX (multi-line paste, history, line editing)
  • harvester message - Turn-based conversations (non-streaming)
  • harvester batch - Batch process CSV files
  • harvester process - Directory processing with templates
  • harvester image - Image generation (single or batch)
  • harvester search - AI-enhanced web search (Grok)

Agentic Commands

  • harvester agent-grok - Grok Code Agent - Fast / impressive agentic coding (grok-code-fast-1)
  • harvester agent-claude - Claude Code Agent - Prone to hallucinations, be careful Claude will delete the Claude Agent SDK

Utility Commands

  • harvester list-models - Show available models
  • harvester config --show - Display configuration
  • harvester templates - Manage batch processing templates
  • harvester status - Check batch job status

Chat Features

The harvester chat command provides a professional terminal experience:

  • โœ… Multi-line paste support - Natural paste behavior, no special modes
  • โœ… Command history - Use โ†‘/โ†“ arrows to recall previous messages
  • โœ… Line editing - Ctrl+A, Ctrl+E, Ctrl+K, and other readline shortcuts
  • โœ… Slash commands - /help, /model, /search, /export, and more
  • โœ… Export conversations - Save to JSON or Markdown

๐ŸŽฏ Model Selection Guide

Google AI Models

API Key (GenAI) Service Account (Vertex) Use Case
gemini-2.5-flash vtx-gemini-2.5-flash Fast, cost-effective
gemini-2.5-pro vtx-gemini-2.5-pro High-quality reasoning
gemini-2.5-flash-lite vtx-gemini-2.5-flash-lite low latency

Other Providers

  • OpenAI: gpt-5, gpt-5-mini, gpt-5-nano
  • Anthropic: claude-sonnet-4-5,claude-sonnet-4, claude-opus-4-1
  • XAI: grok-code-fast-1,grok-4-fast-reasoning,grok-4-fast,grok-4-0709, grok-3, grok-3-mini
  • DeepSeek: deepseek-chat, deepseek-reasoner

๐Ÿค– Agentic Coding Assistants

Harvester SDK includes two powerful agentic coding assistants that can autonomously handle complex multi-step coding tasks.

Grok Code Agent (agent-grok)

Powered by xAI's grok-code-fast-1 model - The fastest, most cost-effective agentic coding solution.

Features:

  • โšก 4x faster than claude-code agents
  • ๐Ÿ’ฐ 1/10th the cost of comparable solutions
  • ๐Ÿงฐ 11 tools: file operations, JSON tools, command execution, directory management
  • ๐Ÿ” 100 max iterations with loop detection on file reads
  • ๐ŸŽฏ Streaming reasoning traces - Read the Agents thoughts after
  • ๐Ÿ›ก๏ธ Safety first - Dangerous commands (rm -rf /, dd, fork bombs) automatically blocked
  • ๐Ÿš€ Ripgrep support - 10x faster code search when available

Example:

๐Ÿค– agent-grok "build programs from this list" --show-reasoning
๐ŸŽฏ Type: general

============================================================
๐Ÿ”„ Iteration 1/100
============================================================

๐Ÿ”ง Tool Calls (1)
  โ†’ read_file({'file_path': '/home/user/linux_c_programs/linux_c_program_taxonomy.md'})
    โœ“ # Comprehensive Taxonomy of C Programs for Linux
## ~300 Feasible Program Ideas by Category

---

##...

============================================================
๐Ÿ”„ Iteration 2/100
============================================================

๐Ÿ”ง Tool Calls (1)
  โ†’ list_files({'path': '/home/user/linux_c_programs'})
    โœ“ Success

============================================================
๐Ÿ”„ Iteration 3/100
============================================================

๐Ÿ”ง Tool Calls (1)
  โ†’ list_files({'path': '/home/user/linux_c_programs/libs'})
    โœ“ Success

============================================================
๐Ÿ”„ Iteration 4/100
============================================================

๐Ÿ”ง Tool Calls (1)
  โ†’ read_file({'file_path': '/home/user/linux_c_programs/libs/common.h'})
    โœ“ #ifndef COMMON_H
#define COMMON_H

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#inclu...

Claude Code Agent (agent-claude)

Built on Anthropic's official Claude Agent SDK - infrastructure from the team behind Claude Code CLI.

# Execute a coding task
harvester agent-claude "Implement a REST API endpoint with validation"

# Complex debugging
harvester agent-claude "Debug the memory leak in the worker pool"

Features:

  • ๐Ÿ—๏ธ Production-tested agent loop - Anthropic's own implementation
  • ๐ŸŽฏ Automatic context management - Built-in compaction and caching
  • ๐Ÿ”ง Professional tooling - Same tools as Claude Code CLI
  • ๐Ÿค MCP protocol support - External service integrations
  • โš™๏ธ Subagents - Parallel task execution (be careful, faceless Claude agents do not respect the project)

Example Output:

๐Ÿค– agent-claude
๐Ÿ“‹ Task: Implement REST API...
๐ŸŽฏ Type: feature
๐Ÿง  Model: claude-sonnet-4-5

๐Ÿ”ง Using tool: Write
โœ“ Created api/endpoints.py

๐Ÿ”ง Using tool: Bash
โœ“ Tests passed

๐Ÿ“Š Status: completed
๐Ÿ’ฐ Cost: $0.097

Agent Comparison

Feature Grok Agent Claude Agent
Speed โšกโšกโšกโšก Very Fast (3-5 iterations) โšกโšก Thorough (10-15 iterations)
Cost ๐Ÿ’ฐ ~$0.002/task ๐Ÿ’ฐ๐Ÿ’ฐ ~$0.10/task
Use Case Fast iteration, prototyping you like Claude
Quality โœ… Excellent DEPENDS
Tools 11 custom tools + safety Full Claude Code SDK
Verification Basic Comprehensive

When to use which:

  • Grok Agent: general use
  • Claude Agent: you like Claude

Examples

See practical examples in:

  • /example/agent-grok/ - Output from Grok Code Agent
  • /example/agent-claude/ - Output from Claude Code Agent
  • /example/batch-results... - Batch processing files

๐Ÿ’ผ Programming Interface

Python SDK Usage

from harvester_sdk import HarvesterSDK

# Initialize SDK
sdk = HarvesterSDK()

# Quick processing
result = await sdk.quick_process(
    prompt="Explain quantum computing",
    model="gemini-2.5-pro"
)

# Batch processing
results = await sdk.process_batch(
    requests=["What is AI?", "Explain ML", "Define neural networks"],
    model="claude-sonnet-4-20250514"
)

# Multi-provider council (get consensus)
consensus = await sdk.quick_council(
    prompt="What is consciousness?",
    models=["gemini-2.5-pro", "claude-sonnet-4-20250514", "gpt-4o"]
)

Provider Factory

from providers.provider_factory import ProviderFactory

# Create provider factory
factory = ProviderFactory()

# Get provider for specific model
provider = factory.get_provider("gemini-2.5-flash")  # -> GenAI provider
provider = factory.get_provider("vtx-gemini-2.5-flash")  # -> Vertex AI provider

# Generate completion
response = await provider.complete("Hello, world!", "gemini-2.5-flash")

๐Ÿ—๏ธ Architecture

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚                        HARVESTER SDK                              โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚                    Main CLI Conductor                             โ”‚
โ”‚                   (harvester command)                             โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚Message โ”‚ Batch  โ”‚Process โ”‚ Image  โ”‚ Search โ”‚ Grok   โ”‚  Claude    โ”‚
โ”‚(Chat)  โ”‚  CSV   โ”‚  Dir   โ”‚  Gen   โ”‚Enhancedโ”‚ Agent  โ”‚  Agent     โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚                     Provider Factory                              โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚ GenAI  โ”‚Vertex  โ”‚ OpenAI โ”‚Anthropicโ”‚  XAI   โ”‚     DeepSeek         โ”‚
โ”‚(APIKey)โ”‚(SA)    โ”‚        โ”‚         โ”‚ (Grok) โ”‚                      โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
         โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                    Agentic Tools Layer
         โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
         โ”‚  Grok Agent     โ”‚  Claude Agent      โ”‚
         โ”‚  (Custom Loop)  โ”‚  (Official SDK)    โ”‚
         โ”‚  - 9 tools      โ”‚  - Full SDK tools  โ”‚
         โ”‚  - Challenger   โ”‚  - previous champ  โ”‚
         โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

๐Ÿ”’ Authentication Methods

Clear Separation for Google Services

Google AI Studio (GenAI):

  • โœ… Simple API key: GEMINI_API_KEY
  • โœ… Models: gemini-2.5-flash, gemini-2.5-pro
  • โœ… Best for: Personal use, quick setup

Google Vertex AI:

  • โœ… Service account: GOOGLE_APPLICATION_CREDENTIALS
  • โœ… Models: vtx-gemini-2.5-flash, vtx-gemini-2.5-pro
  • โœ… Best for: Enterprise, GCP integration

๐ŸŒŸ Open Source & Free

All features are completely free and open source under the MIT License. No tiers, no paywalls, no restrictions.

  • โœ… Unlimited workers - Scale as much as you need
  • โœ… All providers - Full access to every AI provider
  • โœ… Advanced features - Structured output, function calling, multi-provider parallelism
  • โœ… Enterprise ready - Production-grade reliability built-in

๐Ÿ“– Examples

Turn-Based Conversation

# Start a conversation with Gemini
harvester message --model gemini-2.5-flash

# Chat with Claude
harvester message --model claude-sonnet-4

# System prompt example
harvester message --model grok-4-0709 --system "You are an expert programmer"

Batch Processing

# Process CSV with AI
harvester batch questions.csv --model gemini-2.5-pro --template analysis

# Directory transformation
harvester process ./legacy_code --template modernize.j2 --model claude-sonnet-4-5

Image Generation

# DALL-E 3
harvester image "A futuristic city" --provider dalle-3 --quality hd

# Imagen 4
harvester image "Abstract art" --provider vertex_image --model imagen-4

๐Ÿค Support & Contributing

  • Documentation: Full guides in /docs
  • Issues: Report bugs via GitHub issues
  • Enterprise: Contact info@quantumencoding.io
  • License: MIT - see LICENSE file

๐ŸŒŸ Why Harvester SDK?

  1. Unified Interface - One API for all providers
  2. Authentication Clarity - Clear separation of auth methods
  3. Production Ready - Error handling, retries, rate limiting
  4. Flexible Deployment - CLI tools + Python SDK
  5. Cost Optimization - Batch processing with 50% savings
  6. Multi-Modal - Text, images, and more
  7. Enterprise Grade - Open source, well-documented, production-ready

ยฉ 2025 QUANTUM ENCODING LTD
๐Ÿ“ง Contact: info@quantumencoding.io
๐ŸŒ Website: https://quantumencoding.io

The complete AI processing platform for modern applications.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

harvester_sdk-2.1.1.tar.gz (300.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

harvester_sdk-2.1.1-py3-none-any.whl (246.8 kB view details)

Uploaded Python 3

File details

Details for the file harvester_sdk-2.1.1.tar.gz.

File metadata

  • Download URL: harvester_sdk-2.1.1.tar.gz
  • Upload date:
  • Size: 300.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for harvester_sdk-2.1.1.tar.gz
Algorithm Hash digest
SHA256 4cfc13fefa0c76832da66c70bc8c4c80a3f42fe2d38124da635358ba00716057
MD5 194db063a778202e8cf40c02977ef74a
BLAKE2b-256 3fedebcf802edce6bc1775350a5cda304336d6f61b8dcdbb8012b85a3535b1c1

See more details on using hashes here.

File details

Details for the file harvester_sdk-2.1.1-py3-none-any.whl.

File metadata

  • Download URL: harvester_sdk-2.1.1-py3-none-any.whl
  • Upload date:
  • Size: 246.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for harvester_sdk-2.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b53413d7e9f708970be3d89c9178cf6c686d49e97ec3b6a8fb8ef9fe379d4359
MD5 f38d6b23cf1c5d6818d335e0006eae45
BLAKE2b-256 3c3e32cb95a53eb88fcb33b6383f12de593f85fad0af852df70dc8e8d8a7f8ac

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page