Python client for Javelin
Project description
Javelin: an Enterprise-Scale, Fast LLM Gateway
This is the Python client package for Javelin.
For more information about Javelin, see https://getjavelin.io
Javelin Documentation: https://docs.getjavelin.io
Installation
pip install javelin_sdk
Quick Start
from javelin_sdk import (
JavelinClient,
Route,
NetworkError,
RouteNotFoundError,
UnauthorizedError,
)
# create a route object
query_data = {
"model": "gpt-3.5-turbo",
"messages": [
{"role": "system", "content": "You are a helpful assistant that translates English to French."},
{"role": "user", "content": "AI has the power to transform humanity and make the world a better place"},
],
"temperature": 0.8,
}
# query the llm
try:
response = client.query_route("test_route_1", query_data)
except RouteNotFoundError as e:
print("Route Not Found")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
javelin_sdk-0.2.0.tar.gz
(9.8 kB
view hashes)
Built Distribution
Close
Hashes for javelin_sdk-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2986f2410dccfcf2c119373a4b3d99440b07e1f911f6ec017ce0c056d0669d7d |
|
MD5 | 6a9d4f60ec8972688a4fb88fa1679b19 |
|
BLAKE2b-256 | 780c9a3399b6af96db195f885609fea233f8fa8177c5f615b38d5bb7c0c91c57 |