Skip to main content

LlamaIndex LLM Integration: SambaNova LLM

SambaNova Systems LLMs are custom LLMs (Language Models) interfaces that allow you to interact with AI models hosted on SambaNova's offerings - SambaNova Cloud and SambaStudio

Key Features:

  • Integration with SambaNova-hosted AI models
  • Integration two SambaNova offerings - SambaNova Cloud and SambaStudio
  • Support for completion based interactions
  • Streaming support for completion responses
  • Seamless integration with the LlamaIndex ecosystem

Installation

pip install llama-index-llms-sambanovasystems

Usage

from llama_index.llms.sambanovasystems import SambaNovaCloud

SambaNovaCloud(
    sambanova_url="SambaNova cloud endpoint URL",
    sambanova_api_key="set with your SambaNova cloud API key",
    model="model name",
    context_window=100000,
)

Usage

from llama_index.llms.sambanovasystems import SambaStudio

SambaStudio(
    sambastudio_url="SambaStudio endpoint URL",
    sambastudio_api_key="set with your SambaStudio endppoint API key",
    model="model name",
    context_window=100000,
)

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_index_llms_sambanovasystems-0.7.0.tar.gz (11.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file llama_index_llms_sambanovasystems-0.7.0.tar.gz.

File metadata

  • Download URL: llama_index_llms_sambanovasystems-0.7.0.tar.gz
  • Upload date:
  • Size: 11.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for llama_index_llms_sambanovasystems-0.7.0.tar.gz
Algorithm Hash digest
SHA256 3c8e1598c9f73b9b6bba0a160891072378655dd56f1548fb1f51f8d2881a5b23
MD5 4ecefb882e28af89f4a7bc7b38552d43
BLAKE2b-256 f54e2b7ac71026a885ed65ebc43432927dbf92c8b9d20d740b949a01c4d9e43d

See more details on using hashes here.

File details

Details for the file llama_index_llms_sambanovasystems-0.7.0-py3-none-any.whl.

File metadata

  • Download URL: llama_index_llms_sambanovasystems-0.7.0-py3-none-any.whl
  • Upload date:
  • Size: 11.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for llama_index_llms_sambanovasystems-0.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8c2478169f546a7454abfb83d0b8bfd685399d40545c9699a30cc1e9462a4275
MD5 ac650fcd561afd2ef328aab408ce7d64
BLAKE2b-256 c6b25724c38e1f5188ee38b53f1df29cb6b51200cebb270b5c64805df16b94f2

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.7.0 This release

2 files

0.6.0

2 files

0.5.1

2 files

0.5.0

2 files

0.4.3

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page