Python client for Javelin
Project description
Javelin: an Enterprise-Scale, Fast LLM Gateway
This is the Python client package for Javelin.
For more information about Javelin, see https://getjavelin.io
Javelin Documentation: https://docs.getjavelin.io
Installation
pip install javelin_sdk
Quick Start
from javelin_sdk import (
JavelinClient,
Route,
NetworkError,
RouteNotFoundError,
UnauthorizedError,
)
# create a route object
query_data = {
"model": "gpt-3.5-turbo",
"messages": [
{"role": "system", "content": "You are a helpful assistant that translates English to French."},
{"role": "user", "content": "AI has the power to transform humanity and make the world a better place"},
],
"temperature": 0.8,
}
# query the llm
try:
response = client.query_route("test_route_1", query_data)
except RouteNotFoundError as e:
print("Route Not Found")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
javelin_sdk-0.2.2.tar.gz
(9.9 kB
view hashes)
Built Distribution
Close
Hashes for javelin_sdk-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b53a9b717194373278c73d352e40fcc9b5c7896c95272608fbbb654da3610a7f |
|
MD5 | 3310cfe579d37f007e885ff83549841a |
|
BLAKE2b-256 | 6c5ee0855c3985afcfdcd8cc6654e6d3f0db975054f1dc85f3f39a53ecd1fd4a |