javelin-sdk 0.2.40

Python client for Javelin

Javelin: an Enterprise-Scale, Fast LLM Gateway/Edge

This is the Python client package for Javelin.

For more information about Javelin, see https://getjavelin.com

Javelin Documentation: https://docs.getjavelin.io

Development

For local development, Please change version = "RELEASE_VERSION" with any semantic version example : version = "v0.1.10" in pyproject.toml

Make sure that the file pyproject.toml reverted before commit back to main

Installation

  pip install javelin-sdk

Quick Start Guide

Development Setup

Setting up Virtual Environment

Windows

# Create virtual environment
python -m venv venv

# Activate virtual environment
venv\Scripts\activate

# Install dependencies
pip install poetry
poetry install

macOS/Linux

# Create virtual environment
python -m venv venv

# Activate virtual environment
source venv/bin/activate

# Install dependencies
pip install poetry
poetry install

Building and Installing the SDK

# Uninstall any existing version
pip uninstall javelin-sdk -y

# Build the package
poetry build

# Install the newly built package
pip install dist/javelin_sdk-<version>-py3-none-any.whl

Universal Endpoints

Javelin provides universal endpoints that allow you to use a consistent interface across different LLM providers. Here are the main patterns:

Azure OpenAI

• Basic Azure OpenAI integration
• Universal endpoint implementation
• OpenAI-compatible interface

Bedrock

• Basic Bedrock integration
• Universal endpoint implementation
• OpenAI-compatible interface

Gemini

• Basic Gemini integration
• Universal endpoint implementation
• OpenAI-compatible interface

Agent Examples

• CrewAI integration
• LangGraph integration

Basic Examples

• Asynchronous example
• Synchronous example
• Drop-in replacement example

Advanced Examples

• Document processing
• RAG implementation

Additional Integration Patterns

For more detailed examples and integration patterns, check out:

• Azure OpenAI Integration
• AWS Bedrock Integration
• Supported Language Models