llama-index llms OCI GenAI integration
Project description
LlamaIndex Llms Integration: Oracle Cloud Infrastructure (OCI) Generative AI
Oracle Cloud Infrastructure (OCI) Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases, and which are available through a single API. Using the OCI Generative AI service you can access ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.
Installation
pip install llama-index-llms-oci-genai
You will also need to install the OCI sdk
pip install -U oci
Usage
from llama_index.llms.oci_genai import OCIGenAI
llm = OCIGenAI(
model="MY_MODEL",
service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com",
compartment_id="MY_OCID",
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_llms_oci_genai-0.1.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f1d681683c234c80041df9d8fc7acec4b251b00b8efd8196cd5077393cc6c92 |
|
MD5 | c703cc6b65d3119cec5689b9b8fd44f2 |
|
BLAKE2b-256 | 50f2d62153790cb29a43c5d106db2ac9f114d29719eabd8ea4b40cb68d66469a |
Close
Hashes for llama_index_llms_oci_genai-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5fd2956439bad394420b4aede0d45f4ffd7fa3fbd4c514c67bdfab4bd300df41 |
|
MD5 | 4a7220e3067f6154d08a270a0f23699b |
|
BLAKE2b-256 | 47ebbffd3b3310e6e8eddc16f0418dbe9d9c90fb2ae6d141d9d9a29d4b1fc291 |