llama-index llms OCI GenAI integration
Project description
LlamaIndex Llms Integration: Oracle Cloud Infrastructure (OCI) Generative AI
Oracle Cloud Infrastructure (OCI) Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases, and which are available through a single API. Using the OCI Generative AI service you can access ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.
Installation
pip install llama-index-llms-oci-genai
You will also need to install the OCI sdk
pip install -U oci
Usage
from llama_index.llms.oci_genai import OCIGenAI
llm = OCIGenAI(
model="MY_MODEL",
service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com",
compartment_id="MY_OCID",
)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llama_index_llms_oci_genai-0.2.0.tar.gz.
File metadata
- Download URL: llama_index_llms_oci_genai-0.2.0.tar.gz
- Upload date:
- Size: 7.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.10.13 Darwin/23.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3ded8d73cfc6fe7f693406bfca620c5f311f855d03d41c38ae32c29ed668e2aa
|
|
| MD5 |
7ef23a7f05c24f2610c52817c60a1aad
|
|
| BLAKE2b-256 |
21609c00a7c9e7b0e0c33ec627cc440d1047e3ea63855a0adc51157d8e2acf1e
|
File details
Details for the file llama_index_llms_oci_genai-0.2.0-py3-none-any.whl.
File metadata
- Download URL: llama_index_llms_oci_genai-0.2.0-py3-none-any.whl
- Upload date:
- Size: 7.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.10.13 Darwin/23.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
86c93a1cce0f33ec4de006e76209bf9f8345b23ba681b52607ded95d71864d67
|
|
| MD5 |
4f16f773e3a8f70ebb7fcb025bd88001
|
|
| BLAKE2b-256 |
ed19957b146685a2da0c7fe23e7dcb2411252b1af0f1cc50211624372d189bb5
|
