Keywords AI SDK allows you to interact with the Keywords AI API smoothly
Project description
Keywords AI SDK
Keywords AI Python SDK allows you to easily interact with the Keywords AI API.
Get started
Get started with Keywords AI in minutes
Installation
Users
Poetry
poetry add keywordsai
Pip
pip install keywordsai
Developers and Contributers
You can install the current directory as a python package via this command
poetry install
or
pip install . -e
Environment Variables
touch .env
Inside the .env file, you can configure the constants througout the library
DEBUG # Default is "False", set to "True" to enable debug mode for more verbose output
KEYWORDSAI_BASE_URL # Default is "https://api.keywordsai.co/api"
KEYWORDSAI_API_KEY # Your Keywords AI API Key
Change values during runtime (not recommended)
import keywordsai.keywordsai_config as config
config.KEYWORDSAI_BASE_URL = "some_url"
Usage
Proxy
With Keywords AI as a proxy, observability comes out of box.
from openai import OpenAI
import os
client = OpenAI(
api_key=os.getenv("KEYWORDSAI_API_KEY"),
base_url=os.getenv("KEYWORDSAI_BASE_URL")
)
# Use the client to make requests as you would with the OpenAI SDK
Wrapper (Beta)
Wrap around the OpenAI completion function to automatically log the request and response
Synchronous:
from keywordsai import KeywordsAI
from openai import OpenAI
client = OpenAI()
def test_generation():
kai = KeywordsAI()
try:
wrapped_creation = kai.logging_wrapper(client.chat.completions.create)
response = wrapped_creation(
model=test_model,
messages=test_messages,
stream=False,
extra_body={"mock_response": test_mock_response},
)
assert isinstance(response, ChatCompletion)
except Exception as e:
assert False, e
if __name__ == "__main__":
generator = test_generation()
Asynchronous:
import sys
sys.path.append(".")
from keywordsai.core import KeywordsAI, AsyncGenerator
from openai import AsyncOpenAI
from openai.types.chat.chat_completion import ChatCompletion
client = AsyncOpenAI()
async def test_stream_generation():
kai = KeywordsAI()
try:
wrapped_creation = kai.async_logging_wrapper(client.chat.completions.create)
# wrapped_creation = oai_client.chat.completions.create
response = await wrapped_creation(
model=test_model,
messages=test_messages,
stream=True,
)
assert isinstance(response, AsyncGenerator)
return response
except Exception as e:
print(e)
async def test_generation():
kai = KeywordsAI()
try:
wrapped_creation = kai.async_logging_wrapper(client.chat.completions.create, keywordsai_params={
"customer_identifier": "sdk_customer",
})
response = await wrapped_creation(
model=test_model,
messages=test_messages,
stream=False,
)
assert isinstance(response, ChatCompletion)
return response
except Exception as e:
assert False, e
import asyncio
async def run_stream():
response = await test_stream_generation()
async for chunk in response:
content = chunk.choices[0].delta.content
if content:
print(content, end="")
pass
if __name__ == "__main__":
# non streaming
asyncio.run(test_generation())
# streaming
asyncio.run(run_stream())
KeywordsAI.flush()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
keywordsai_sdk-0.2.14.tar.gz
(76.7 kB
view hashes)
Built Distribution
Close
Hashes for keywordsai_sdk-0.2.14-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca51a2db49a0cb653fd2064ef3b22b48bd07a1c2796daddf073df0716b4a9a1d |
|
MD5 | 055c33d7fa5dc39496712daf697440a5 |
|
BLAKE2b-256 | 7267eea49601cf6f2f1c9ba5e6e39ffc55403599b2ad932f2bce82b7666569f7 |