llama-index llms OCI GenAI integration
Project description
LlamaIndex Llms Integration: Oracle Cloud Infrastructure (OCI) Generative AI
Oracle Cloud Infrastructure (OCI) Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases, and which are available through a single API. Using the OCI Generative AI service you can access ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.
Installation
pip install llama-index-llms-oci-genai
You will also need to install the OCI sdk
pip install -U oci
Usage
from llama_index.llms.oci_genai import OCIGenAI
llm = OCIGenAI(
model="MY_MODEL",
service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com",
compartment_id="MY_OCID",
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_llms_oci_genai-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8861a738ac9c86e04e900ca6001bba97cd0f2e93ec20b30bb6acd831575f7d1f |
|
MD5 | ff8ff86c6844e3478ac7f5291c30146b |
|
BLAKE2b-256 | af31c17792a0de796e8a9b199b810cc3bbed53c1c694f95c7ef305c32b800102 |
Close
Hashes for llama_index_llms_oci_genai-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac6ff7f2fcf83ee45d4c02b50c0cf2cdee36f614fe840b5fdfe9297708166a82 |
|
MD5 | 2233fc2d7c7b9c7fcf94f4fbdd63d49e |
|
BLAKE2b-256 | 75854f55fbd41430624514f7169421995b725d2ed79adc2b8dcb8becdfe8ab8f |