Harvester SDK - The Complete AI Processing Platform with Agentic Coding Assistants. Unified interface for all AI processing paradigms with enterprise-grade reliability.
Project description
๐ Harvester SDK - Complete AI Processing Platform
"The unified interface for all AI providers with enterprise-grade reliability."
๐ What is Harvester SDK?
Harvester SDK is a comprehensive AI processing platform that provides a unified interface to all major AI providers. Whether you need text generation, image creation, batch processing, or real-time conversations, Harvester SDK handles the complexity so you can focus on building.
โก Key Features
- Multi-Provider Support - OpenAI, Anthropic, Google AI Studio, Vertex AI, XAI, DeepSeek
- Agentic Coding Assistants - Grok Code Agent (fast) & Claude Code Agent (SDK-powered)
- Enhanced Chat Experience -
prompt_toolkitintegration with multi-line paste, command history, and professional line editing - Dual Authentication - API keys (GenAI) and service accounts (Vertex AI)
- Streaming & Turn-Based Chat - Real-time streaming or non-streaming conversations
- Batch Processing - Cost-effective bulk operations with 50% savings
- Template System - 30+ Jinja2 templates for AI-powered transformations
- Image Generation - DALL-E, Imagen, GPT Image support
- Enterprise Ready - Rate limiting, retries, error handling
๐ Quick Start
Installation
# Install the SDK
pip install harvester-sdk
# Install with all providers
pip install harvester-sdk[all]
# Install specific providers
pip install harvester-sdk[openai,anthropic,genai]
Basic Usage
# Main CLI conductor
harvester --help
# Turn-based conversation (non-streaming)
harvester message --model gemini-2.5-flash
harvester message --model claude-sonnet-4-20250514 --system "You are a helpful assistant"
# Batch processing from CSV
harvester batch data.csv --model gpt-4o --template quick
# Process directory with templates
harvester process ./src --template refactor --model gemini-2.5-pro
# Generate images
harvester image "A beautiful sunset" --provider dalle3 --size 1024x1024
๐ง Provider Configuration
Google AI Studio (GenAI) - API Key Authentication
export GEMINI_API_KEY=your_api_key
harvester message --model gemini-2.5-flash
Google Vertex AI - Service Account Authentication
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service-account.json
harvester message --model vtx-gemini-2.5-flash
Other Providers
export OPENAI_API_KEY=your_openai_key
export ANTHROPIC_API_KEY=your_anthropic_key
export XAI_API_KEY=your_xai_key
export DEEPSEEK_API_KEY=your_deepseek_key
๐ Available Commands
Core Commands
harvester chat- Interactive streaming chat with enhanced UX (multi-line paste, history, line editing)harvester message- Turn-based conversations (non-streaming)harvester batch- Batch process CSV filesharvester process- Directory processing with templatesharvester image- Image generation (single or batch)harvester search- AI-enhanced web search (Grok)
Agentic Commands
harvester agent-grok- Grok Code Agent - Fast agentic coding (grok-code-fast-1)harvester agent-claude- Claude Code Agent - Professional coding with Claude Agent SDK
Utility Commands
harvester list-models- Show available modelsharvester config --show- Display configurationharvester templates- Manage batch processing templatesharvester status- Check batch job status
Chat Features
The harvester chat command provides a professional terminal experience:
- โ Multi-line paste support - Natural paste behavior, no special modes
- โ Command history - Use โ/โ arrows to recall previous messages
- โ Line editing - Ctrl+A, Ctrl+E, Ctrl+K, and other readline shortcuts
- โ
Slash commands -
/help,/model,/search,/export, and more - โ Export conversations - Save to JSON or Markdown
๐ฏ Model Selection Guide
Google AI Models
| API Key (GenAI) | Service Account (Vertex) | Use Case |
|---|---|---|
gemini-2.5-flash |
vtx-gemini-2.5-flash |
Fast, cost-effective |
gemini-2.5-pro |
vtx-gemini-2.5-pro |
High-quality reasoning |
gemini-1.5-flash |
vtx-gemini-1.5-flash |
Legacy support |
Other Providers
- OpenAI:
gpt-4o,gpt-4o-mini - Anthropic:
claude-sonnet-4-20250514,claude-opus-4-1-20250805 - XAI:
grok-4-0709,grok-3,grok-3-mini - DeepSeek:
deepseek-chat,deepseek-reasoner
๐ค Agentic Coding Assistants
Harvester SDK includes two powerful agentic coding assistants that can autonomously handle complex multi-step coding tasks.
Grok Code Agent (agent-grok)
Powered by xAI's grok-code-fast-1 model - The fastest, most cost-effective agentic coding solution.
# Execute a coding task
harvester agent-grok "Create a Python script for data validation with proper error handling"
# Complex multi-step tasks
harvester agent-grok "Refactor the authentication module to use JWT tokens"
Features:
- โก 4x faster than traditional agents
- ๐ฐ 1/10th the cost of comparable solutions
- ๐งฐ 11 specialized tools: file operations, JSON tools (corruption-proof), command execution, directory management
- ๐ 100 max iterations with loop detection
- ๐ฏ Streaming reasoning traces - Watch the agent think in real-time
- ๐ Smart tool selection - JSON tools, text tools, edit tools automatically chosen
- ๐ก๏ธ Safety first - Dangerous commands (rm -rf /, dd, fork bombs) automatically blocked
- ๐ Ripgrep support - 10x faster code search when available
Example Output:
๐ค Grok Code Agent
๐ Task: Create a Python script...
๐ฏ Type: general
๐ Iteration 1/100
๐ง Tool: write_text_file
โ Created script.py
๐ Iteration 2/100
๐ง Tool: execute_command
โ Tests passed
๐ Status: completed (3 iterations)
Claude Code Agent (agent-claude)
Built on Anthropic's official Claude Agent SDK - Production-tested infrastructure from the team behind Claude Code CLI.
# Execute a coding task
harvester agent-claude "Implement a REST API endpoint with validation"
# Complex debugging
harvester agent-claude "Debug the memory leak in the worker pool"
Features:
- ๐๏ธ Production-tested agent loop - Anthropic's own implementation
- ๐ฏ Automatic context management - Built-in compaction and caching
- ๐ง Professional tooling - Same tools as Claude Code CLI
- ๐ค MCP protocol support - External service integrations
- โ๏ธ Subagents - Parallel task execution
- ๐ Comprehensive verification - Built-in quality checks
Example Output:
๐ค Claude Code Agent
๐ Task: Implement REST API...
๐ฏ Type: feature
๐ง Model: claude-sonnet-4-5
๐ง Using tool: Write
โ Created api/endpoints.py
๐ง Using tool: Bash
โ Tests passed
๐ Status: completed
๐ฐ Cost: $0.097
Agent Comparison
| Feature | Grok Agent | Claude Agent |
|---|---|---|
| Speed | โกโกโกโก Very Fast (3-5 iterations) | โกโก Thorough (10-15 iterations) |
| Cost | ๐ฐ ~$0.002/task | ๐ฐ๐ฐ ~$0.10/task |
| Use Case | Fast iteration, prototyping | Production code, critical systems |
| Quality | โ Excellent | โ โ Maximum thoroughness |
| Tools | 11 custom tools + safety | Full Claude Code SDK |
| Verification | Basic | Comprehensive |
When to use which:
- Grok Agent: Fast prototyping, routine tasks, cost-sensitive work
- Claude Agent: Production code, debugging, maximum quality requirements
Examples
See practical examples in:
/example/agent-grok/- Output from Grok Code Agent/example/agent-claude/- Output from Claude Code Agent
๐ผ Programming Interface
Python SDK Usage
from harvester_sdk import HarvesterSDK
# Initialize SDK
sdk = HarvesterSDK()
# Quick processing
result = await sdk.quick_process(
prompt="Explain quantum computing",
model="gemini-2.5-pro"
)
# Batch processing
results = await sdk.process_batch(
requests=["What is AI?", "Explain ML", "Define neural networks"],
model="claude-sonnet-4-20250514"
)
# Multi-provider council (get consensus)
consensus = await sdk.quick_council(
prompt="What is consciousness?",
models=["gemini-2.5-pro", "claude-sonnet-4-20250514", "gpt-4o"]
)
Provider Factory
from providers.provider_factory import ProviderFactory
# Create provider factory
factory = ProviderFactory()
# Get provider for specific model
provider = factory.get_provider("gemini-2.5-flash") # -> GenAI provider
provider = factory.get_provider("vtx-gemini-2.5-flash") # -> Vertex AI provider
# Generate completion
response = await provider.complete("Hello, world!", "gemini-2.5-flash")
๐๏ธ Architecture
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ HARVESTER SDK โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
โ Main CLI Conductor โ
โ (harvester command) โ
โโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโโโโโค
โMessage โ Batch โProcess โ Image โ Search โ Grok โ Claude โ
โ(Chat) โ CSV โ Dir โ Gen โEnhancedโ Agent โ Agent โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโค
โ Provider Factory โ
โโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโค
โ GenAI โVertex โ OpenAI โAnthropicโ XAI โ DeepSeek โ
โ(APIKey)โ(SA) โ โ โ (Grok) โ โ
โโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Agentic Tools Layer
โโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโ
โ Grok Agent โ Claude Agent โ
โ (Custom Loop) โ (Official SDK) โ
โ - 9 tools โ - Full SDK tools โ
โ - Fast/Cheap โ - Production-test โ
โโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโ
๐ Authentication Methods
Clear Separation for Google Services
Google AI Studio (GenAI):
- โ
Simple API key:
GEMINI_API_KEY - โ
Models:
gemini-2.5-flash,gemini-2.5-pro - โ Best for: Personal use, quick setup
Google Vertex AI:
- โ
Service account:
GOOGLE_APPLICATION_CREDENTIALS - โ
Models:
vtx-gemini-2.5-flash,vtx-gemini-2.5-pro - โ Best for: Enterprise, GCP integration
๐ Open Source & Free
All features are completely free and open source under the MIT License. No tiers, no paywalls, no restrictions.
- โ Unlimited workers - Scale as much as you need
- โ All providers - Full access to every AI provider
- โ Advanced features - Structured output, function calling, multi-provider parallelism
- โ Enterprise ready - Production-grade reliability built-in
๐ Examples
Turn-Based Conversation
# Start a conversation with Gemini
harvester message --model gemini-2.5-flash --save
# Chat with Claude
harvester message --model claude-sonnet-4-20250514 --temperature 0.3
# System prompt example
harvester message --model grok-4-0709 --system "You are an expert programmer"
Batch Processing
# Process CSV with AI
harvester batch questions.csv --model gemini-2.5-pro --template analysis
# Directory transformation
harvester process ./legacy_code --template modernize --model claude-sonnet-4-20250514
Image Generation
# DALL-E 3
harvester image "A futuristic city" --provider dalle3 --quality hd
# Imagen 4
harvester image "Abstract art" --provider vertex_image --model imagen-4
๐ค Support & Contributing
- Documentation: Full guides in
/docs - Issues: Report bugs via GitHub issues
- Enterprise: Contact info@quantumencoding.io
- License: MIT - see LICENSE file
๐ Why Harvester SDK?
- Unified Interface - One API for all providers
- Authentication Clarity - Clear separation of auth methods
- Production Ready - Error handling, retries, rate limiting
- Flexible Deployment - CLI tools + Python SDK
- Cost Optimization - Batch processing with 50% savings
- Multi-Modal - Text, images, and more
- Enterprise Grade - Open source, well-documented, production-ready
ยฉ 2025 QUANTUM ENCODING LTD
๐ง Contact: info@quantumencoding.io
๐ Website: https://quantumencoding.io
The complete AI processing platform for modern applications.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file harvester_sdk-2.1.0.tar.gz.
File metadata
- Download URL: harvester_sdk-2.1.0.tar.gz
- Upload date:
- Size: 300.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3bdf33ec310ef7db50d6cc276dcbb7e3517e2ecd10041bddf0452537884fa345
|
|
| MD5 |
e7db2f6c6a2876040c920077feeddf03
|
|
| BLAKE2b-256 |
ef17a5893ab944a097e7052703ae86f6584507d2a27135ee571f9135dca6737b
|
File details
Details for the file harvester_sdk-2.1.0-py3-none-any.whl.
File metadata
- Download URL: harvester_sdk-2.1.0-py3-none-any.whl
- Upload date:
- Size: 246.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b71831aede75b0f0167f389d6b5592e0a511d671f8c06c6a70300f48a7734a02
|
|
| MD5 |
eba0d7dfb713e9dbb043af85c83d1ad7
|
|
| BLAKE2b-256 |
895d35fec502d095afdf367a35cbbc4835d41987d4545d22c0f0681a6abfce74
|