Skip to main content

SDK for using LLM

Project description

SFN_LLM_Client

This is an enhanced and improved version with latest llm provider chat completion feature The sfn_llm_client now includes:

  • Updated to the latest version of OpenAI.
  • Integrated Cortex LLM provider support.
  • Latest improvements and updates to the codebase for better performance and compatibility.

Features

  • Supports multiple LLM providers, including OpenAI and Cortex.
  • Easily extensible to include new LLM providers by implementing base client classes.
  • Well-documented and tested.

Adding a New LLM Client

To add a new LLM client, follow these steps:

  1. Implement BaseLLMClient or BaseLLMAPIClient:
    If you're adding a new LLM provider, you'll need to implement either the BaseLLMClient or BaseLLMAPIClient interfaces.

  2. Register in LLMAPIClientFactory:
    If you're adding a client based on BaseLLMAPIClient, don't forget to register it in the LLMAPIClientFactory so that it's available for use.

Adding Dependencies

If your LLM client requires additional dependencies, you can add them to the pyproject.toml file under the appropriate section.

Contributing

Contributions are welcome! If you'd like to help improve this SDK, please check out the todos or open an issue or pull request.

Credits

the core forked functionality taken from llm-client-sdk created by uripeled2.

Contact:

For any queries or issues, please contact the maintainer at: rajesh@stepfunction.ai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sfn_llm_client-0.3.7.tar.gz (30.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sfn_llm_client-0.3.7-py3-none-any.whl (41.4 kB view details)

Uploaded Python 3

File details

Details for the file sfn_llm_client-0.3.7.tar.gz.

File metadata

  • Download URL: sfn_llm_client-0.3.7.tar.gz
  • Upload date:
  • Size: 30.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for sfn_llm_client-0.3.7.tar.gz
Algorithm Hash digest
SHA256 b664a2fae99aa9f178b25c1e1d73851373d886cbd9952b8f3c861e27781c3bc1
MD5 a1b3c74b8067efbe40991021ad3ccf74
BLAKE2b-256 4b8889cf48d9b118ef54c01d18fead9a2c465ec47ee176f5dc6a57f7a06ab4a7

See more details on using hashes here.

File details

Details for the file sfn_llm_client-0.3.7-py3-none-any.whl.

File metadata

  • Download URL: sfn_llm_client-0.3.7-py3-none-any.whl
  • Upload date:
  • Size: 41.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for sfn_llm_client-0.3.7-py3-none-any.whl
Algorithm Hash digest
SHA256 1953543949cde484cc9fba4861eff6b34e1dbf60f296698afaae5e9132406a22
MD5 15db50beb68deee99963897a44d8971e
BLAKE2b-256 cd30507d07a6e6e191c1365dc194dea78b3390139b0eff7d4eecdedb693a61f3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page