Skip to main content

llama-index llms OCI GenAI integration

Project description

LlamaIndex Llms Integration: Oracle Cloud Infrastructure (OCI) Generative AI

Oracle Cloud Infrastructure (OCI) Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases, and which are available through a single API. Using the OCI Generative AI service you can access ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.

Installation

pip install llama-index-llms-oci-genai

You will also need to install the OCI sdk

pip install -U oci

Usage

from llama_index.llms.oci_genai import OCIGenAI

llm = OCIGenAI(
    model="MY_MODEL",
    service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com",
    compartment_id="MY_OCID",
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_index_llms_oci_genai-0.5.2.tar.gz (12.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llama_index_llms_oci_genai-0.5.2-py3-none-any.whl (12.9 kB view details)

Uploaded Python 3

File details

Details for the file llama_index_llms_oci_genai-0.5.2.tar.gz.

File metadata

File hashes

Hashes for llama_index_llms_oci_genai-0.5.2.tar.gz
Algorithm Hash digest
SHA256 2b43361976752ca91df759d07b22b98ea0cfca13267ca739f8b72cf98ab15d86
MD5 f6bc206387f3cad834bd389a78957f1f
BLAKE2b-256 918feb27b3b452b259de8e3cbfda3ce5821588e894bcaba2be11aafe954d8f92

See more details on using hashes here.

File details

Details for the file llama_index_llms_oci_genai-0.5.2-py3-none-any.whl.

File metadata

File hashes

Hashes for llama_index_llms_oci_genai-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3dfb84c8ec062275a27a3c440f347330b6d42a471a76cc8dd9d42da7a186ade3
MD5 f2b0d86e157e08a36643ff1cf5acf41e
BLAKE2b-256 d3ffd9a159bedfcb103b59848ed87736f437f2ea5884e6c009d30733439aea2a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page