SFN_LLM_Client
This is an enhanced and improved version with latest llm provider chat completion feature The sfn_llm_client now includes:
- Updated to the latest version of OpenAI.
- Integrated Cortex LLM provider support.
- Latest improvements and updates to the codebase for better performance and compatibility.
Features
- Supports multiple LLM providers, including OpenAI and Cortex.
- Easily extensible to include new LLM providers by implementing base client classes.
- Well-documented and tested.
Adding a New LLM Client
To add a new LLM client, follow these steps:
-
Implement
BaseLLMClientorBaseLLMAPIClient:
If you're adding a new LLM provider, you'll need to implement either theBaseLLMClientorBaseLLMAPIClientinterfaces. -
Register in
LLMAPIClientFactory:
If you're adding a client based onBaseLLMAPIClient, don't forget to register it in theLLMAPIClientFactoryso that it's available for use.
Adding Dependencies
If your LLM client requires additional dependencies, you can add them to the pyproject.toml file under the appropriate section.
Contributing
Contributions are welcome! If you'd like to help improve this SDK, please check out the todos or open an issue or pull request.
Credits
the core forked functionality taken from llm-client-sdk created by uripeled2.
Contact:
For any queries or issues, please contact the maintainer at: rajesh@stepfunction.ai
Release files for sfn-llm-client 0.3.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sfn_llm_client-0.3.9.tar.gz | 31.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sfn_llm_client-0.3.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 72.6 kB
Release files / sfn_llm_client-0.3.9.tar.gz
| Download URL | sfn_llm_client-0.3.9.tar.gz |
|---|---|
| Size | 31.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8a89f72c131edd9a6d9b878c387c410ea6df926220560a11e1a5380db86a0800
|
|
BLAKE2b-256 checksum How to use checksums |
cfda1c9067b61e0f9b01298dc21359e2e6827b3a7d59eb605e36219057860ee0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.18
|
Release files / sfn_llm_client-0.3.9-py3-none-any.whl
| Download URL | sfn_llm_client-0.3.9-py3-none-any.whl |
|---|---|
| Size | 41.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9d185d1a2052722dae08dc3b902ff7ecb2c55af4b7232ecfca9b1ec66f081e94
|
|
BLAKE2b-256 checksum How to use checksums |
8bf27514139a515ac53aab1e93d085297fd4d29f1559030f9cad39082bc8bea3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.18
|