LLM Development Kit for common APIs
Project description
Streamline LLM Interactions in Python
Installation
pip install llmdk
Basic Usage
Client
from llmdk import Llmdk, Providers
# You can also set OPENAI_API_KEY
client = Llmdk(
provider=Providers.OPENAI,
model_name='gpt-4o-mini',
# api_key='***',
)
Generate
Prompt
output = client.generate(
'Who are you?',
# system='Write in Portuguese.',
)
List of messages
output = client.generate(
messages=[
# {'role': 'system', 'content': 'Write in Portuguese.'},
{'role': 'user', 'content': 'Who are you?'},
],
)
Stream
Prompt
for chunk in client.stream(
'Who are you?',
# system='Write in Portuguese.',
):
print(chunk, end='', flush=True)
List of messages
for chunk in client.stream([
# {'role': 'system', 'content': 'Write in Portuguese.'},
{'role': 'user', 'content': 'Who are you?'},
]):
print(chunk, end='', flush=True)
Supported Providers
Anthropic
from llmdk import Llmdk, Providers
# You can also set ANTHROPIC_API_KEY
client = Llmdk(
provider=Providers.ANTHROPIC,
model_name='claude-3-5-sonnet-20240620',
# api_key='***',
)
Groq
from llmdk import Llmdk, Providers
# You can also set GROQ_API_KEY
client = Llmdk(
provider=Providers.GROQ,
model_name='llama-3.1-70b-versatile',
# api_key='***',
)
HuggingFace
from llmdk import Llmdk, Providers
# You can also set HF_TOKEN
client = Llmdk(
provider=Providers.HUGGINGFACE,
model_name='meta-llama/Meta-Llama-3.1-70B-Instruct',
# api_key='***',
)
Ollama
from llmdk import Llmdk, Providers
client = Llmdk(
provider=Providers.OLLAMA,
model_name='llama3.2:1b',
# base_url='http://localhost:11434',
)
OpenAI
from llmdk import Llmdk, Providers
# You can also set OPENAI_API_KEY
client = Llmdk(
provider=Providers.OPENAI,
model_name='gpt-4o-mini',
# api_key='***',
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
llmdk-1.2410.3-py3-none-any.whl
(32.6 kB
view details)
File details
Details for the file llmdk-1.2410.3-py3-none-any.whl
.
File metadata
- Download URL: llmdk-1.2410.3-py3-none-any.whl
- Upload date:
- Size: 32.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4c47601dc140b7b4aa46bed977d73436ecd59f1abb556f867dca969df09c7744 |
|
MD5 | 3fef78b347ab5b17bd4764d4aecbed72 |
|
BLAKE2b-256 | b7aef2b1a7c28cfc03169dc59ad400d0053f04bfb737b8ecda94840a591210be |