Skip to main content

SFN_LLM_Client

This is an enhanced and improved version with latest llm provider chat completion feature The sfn_llm_client now includes:

  • Updated to the latest version of OpenAI.
  • Integrated Cortex LLM provider support.
  • Latest improvements and updates to the codebase for better performance and compatibility.

Features

  • Supports multiple LLM providers, including OpenAI and Cortex.
  • Easily extensible to include new LLM providers by implementing base client classes.
  • Well-documented and tested.

Adding a New LLM Client

To add a new LLM client, follow these steps:

  1. Implement BaseLLMClient or BaseLLMAPIClient:
    If you're adding a new LLM provider, you'll need to implement either the BaseLLMClient or BaseLLMAPIClient interfaces.

  2. Register in LLMAPIClientFactory:
    If you're adding a client based on BaseLLMAPIClient, don't forget to register it in the LLMAPIClientFactory so that it's available for use.

Adding Dependencies

If your LLM client requires additional dependencies, you can add them to the pyproject.toml file under the appropriate section.

Contributing

Contributions are welcome! If you'd like to help improve this SDK, please check out the todos or open an issue or pull request.

Credits

the core forked functionality taken from llm-client-sdk created by uripeled2.

Contact:

For any queries or issues, please contact the maintainer at: rajesh@stepfunction.ai

Release files for sfn-llm-client 0.3.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sfn-llm-client 0.3.9
File Size Uploaded
sfn_llm_client-0.3.9.tar.gz 31.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for sfn-llm-client 0.3.9
File Interpreter ABI Platform
sfn_llm_client-0.3.9-py3-none-any.whl Python 3 none any Details

Total release size: 72.6 kB

Release files / sfn_llm_client-0.3.9.tar.gz

Download URL sfn_llm_client-0.3.9.tar.gz
Size 31.0 kB
Tags Source
SHA-256 checksum
How to use checksums
8a89f72c131edd9a6d9b878c387c410ea6df926220560a11e1a5380db86a0800
BLAKE2b-256 checksum
How to use checksums
cfda1c9067b61e0f9b01298dc21359e2e6827b3a7d59eb605e36219057860ee0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.18

Release files / sfn_llm_client-0.3.9-py3-none-any.whl

Download URL sfn_llm_client-0.3.9-py3-none-any.whl
Size 41.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9d185d1a2052722dae08dc3b902ff7ecb2c55af4b7232ecfca9b1ec66f081e94
BLAKE2b-256 checksum
How to use checksums
8bf27514139a515ac53aab1e93d085297fd4d29f1559030f9cad39082bc8bea3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.18

Release history Release notifications | RSS feed

This release

0.3.9 This release

2 release files

0.3.8

2 release files

0.3.7

2 release files

0.3.6

2 release files

0.3.5

2 release files

0.3.4

2 release files

0.3.3

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

0.0.9

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page