llama-index-llms-cortex 0.1.0

llama-index llms cortex integration

LlamaIndex Llms Integration: Cortex

Overview

Integrate with Snowflake Cortex API.

Installation

pip install llama-index-llms-cortex

Example

import os
from llama_index.llms.cortex import Cortex


llm = Cortex(
    model="llama3.2-1b",
    user=os.environ["YOUR_SF_USER"],
    account=os.environ["YOUR_SF_ACCOUNT"],
    private_key_file=os.environ["PATH_TO_SF_PRIVATE_KEY"],
)

completion_response = llm.complete(
    "write me a haiku about a snowflake", temperature=0.0
)
print(completion_response)