kamiwaza 0.3.3.0

Python client library for the Kamiwaza AI Platform

Kamiwaza Python SDK

Python client library and CLI for interacting with the Kamiwaza AI Platform. This SDK provides a type-safe interface to all Kamiwaza API endpoints with built-in authentication, error handling, and resource management.

Installation

pip install kamiwaza-client

Python SDK Usage

from kamiwaza_client import KamiwazaClient

# Initialize the client for local development
client = KamiwazaClient("http://localhost:7777/api/")

Examples

The /examples directory contains Jupyter notebooks demonstrating various use cases:

1. Model Download and Deployment - A comprehensive guide to searching, downloading, deploying, and using models with the Kamiwaza SDK
2. Quick Model Deployment - Streamlined approach to download and deploy models using a single function
3. Model Evaluation - How to evaluate and benchmark multiple language models for performance comparison using the streamlined download_and_deploy_model function
4. Structured Output - Using Kamiwaza's OpenAI-compatible interface to generate structured outputs with specific JSON schemas

More examples coming soon!

Service Overview

Service	Description	Documentation
client.models	Model management	Models Service
client.serving	Model deployment	Serving Service
client.vectordb	Vector database	VectorDB Service
client.catalog	Data management	Catalog Service
client.embedding	Text processing	Embedding Service
client.retrieval	Search	Retrieval Service
client.ingestion	Data pipeline	Ingestion Service
client.cluster	Infrastructure	Cluster Service
client.lab	Lab environments	Lab Service
client.auth	Security	Auth Service
client.activity	Monitoring	Activity Service
client.openai	OpenAI API compatible	OpenAI Service

---

Quick Start - CLI

The easiest way to get started is using the CLI:

# First time setup
kamiwaza config set-url http://localhost:7777/api

# Download, deploy, and chat with a model in one command
$ kamiwaza run qwen2.5-7b-instruct
🚀 Deploying Qwen2.5-7B-Instruct-GGUF...
✨ Deployment ready!

🤖 Chat session started (Ctrl+C to exit)

User: What is a funny way to explain GenAI?

Assistant: GenAI is like a magic wand that can create amazing things. It can write code, draw pictures, and even figure out your taxes.

For more CLI commands and examples, see the CLI Documentation.

The Kamiwaza SDK is actively being developed with new features, examples, and documentation being added regularly. Stay tuned for updates including additional example notebooks, enhanced documentation, and expanded functionality across all services.