Python client for Javelin
Project description
Javelin: an Enterprise-Scale, Fast LLM Gateway
This is the Python client package for Javelin.
For more information about Javelin, see https://getjavelin.io
Javelin Documentation: https://docs.getjavelin.io
Installation
pip install javelin_sdk
Quick Start
from javelin_sdk import (
JavelinClient,
Route,
NetworkError,
RouteNotFoundError,
UnauthorizedError,
)
# create a route object
query_data = {
"model": "gpt-3.5-turbo",
"messages": [
{"role": "system", "content": "You are a helpful assistant that translates English to French."},
{"role": "user", "content": "AI has the power to transform humanity and make the world a better place"},
],
"temperature": 0.8,
}
# query the llm
try:
response = client.query_route("test_route_1", query_data)
except RouteNotFoundError as e:
print("Route Not Found")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
javelin_sdk-0.2.4.tar.gz
(10.4 kB
view hashes)
Built Distribution
Close
Hashes for javelin_sdk-0.2.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3511a2e644c07db756a80a9ec7588730e3d47d35ee81f3726a7e85f581110dbf |
|
MD5 | 456aee88429b4719c31df2bf761150d3 |
|
BLAKE2b-256 | ba66f2161e878e6b09a67062f996813bff5d1c9b70b26213447355fabbe3eb95 |