Package for calling llm clients asynchronously
Project description
LLM Client
Internal package for making multi-threaded calls to LLMs.
Supported Models
Cohere Command, Cohere Embed, OpenAI Models, Titan Embed, Mixtral
Install
pip install thinkcol_llm_client
Usage:
Normal Usage
from thinkcol_llm_client import OpenAIClient, AnthropicClient
texts = ["Hello", "Text 1", "ThinkCol"]
client = OpenAIClient()
client.embed(texts)
questions = ["How do I implement best practices in data science projects" for _ in range(500)]
client.invoke(questions)
anthropic_client = AnthropicClient()
anthropic_client.invoke(questions)
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for thinkcol_llm_client-0.1.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5387c5f71785595766db4f93183278f251a42bb2ec1b46435a4722333179fd3d |
|
| MD5 | a98192360ef5892466d3f68fc8a13b20 |
|
| BLAKE2b-256 | fa0843431e309785052d44d0dbe9a9ec5b444c0e0ef5b2bf0e2b3a00a97bf7b2 |
Close
Hashes for thinkcol_llm_client-0.1.2-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 561ce3e57e83df5e62bc28d9e1b40437dcd586737da43bd2b06c248adf5609b4 |
|
| MD5 | 9b0d8ad190dbba14274c4a264074e4e6 |
|
| BLAKE2b-256 | bd4795bd0b37b6f98017c9f9dac8819881a0ef2ea39b772da9cf70386edb6901 |
