Skip to main content

llama-index llms sambanova integration

Project description

LlamaIndex LLM Integration: SambaNova LLM

SambaNovaLLM is a custom LLM (Language Model) interface that allows you to interact with AI models hosted on SambaNova's offerings - SambaNova Cloud and SambaStudio

Key Features:

  • Integration with SambaNova-hosted AI models
  • Integration two SambaNova offerings - SambaNova Cloud and SambaStudio
  • Support for completion based interactions
  • Streaming support for completion responses
  • Seamless integration with the LlamaIndex ecosystem

Installation

pip install llama-index-llms-sambanova

Usage

SambaNovaCloud(
    sambanova_url="SambaNova cloud endpoint URL",
    sambanova_api_key="set with your SambaNova cloud API key",
    model="model name",
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_index_llms_sambanovacloud-0.3.1.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file llama_index_llms_sambanovacloud-0.3.1.tar.gz.

File metadata

  • Download URL: llama_index_llms_sambanovacloud-0.3.1.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.10.12 Linux/5.10.102.1-microsoft-standard-WSL2

File hashes

Hashes for llama_index_llms_sambanovacloud-0.3.1.tar.gz
Algorithm Hash digest
SHA256 3c15cd5ad68352d5a52c98f73015d83959b2ef206f833ef7e7eca8b632f94602
MD5 d6a3fe74f329e8c7b8f21e386234852f
BLAKE2b-256 50786701a2dbae78fef842b1b9a39d5ebd692d9d38043dbc2cdcb6de73750170

See more details on using hashes here.

File details

Details for the file llama_index_llms_sambanovacloud-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for llama_index_llms_sambanovacloud-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 adfdb0276ece77b0ef200edef8c3a87db346dc56e797c682d2652d2167b5232c
MD5 ae0077d3194580f1d7c51b6e158639a0
BLAKE2b-256 03f6e20abc04e1a6409b7cd584d28342e97eb8362898ab5062a99fc5afbaf5e5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page