llama-index llms octoai integration
Project description
LlamaIndex Llms Integration: OctoAI
Using the OctoAI LLMs Integration is a simple as:
from llama_index.llms.octoai import OctoAI
octoai = OctoAI(token=OCTOAI_API_KEY)
response = octoai.complete("Paul Graham is ")
print(response)
Calling chat
with a list of messages
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(
role="system",
content="Below is an instruction that describes a task. Write a response that appropriately completes the request.",
),
ChatMessage(role="user", content="Write a blog about Seattle"),
]
response = octoai.chat(messages)
print(response)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_llms_octoai-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ab721d1d12e497952406e118f44e76e03269a3f73cab93a6225f89677abb28f6 |
|
MD5 | b5da032c77ca055f43702fe7bfbe2b6e |
|
BLAKE2b-256 | a110efa693e777d0145021d440a04840b3137f17d148fc135cb74a0b8730b04b |
Close
Hashes for llama_index_llms_octoai-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 503c8bba8da34b1b89ed9d6c2259207a1578ec8feb5e0473c9fa89f941538507 |
|
MD5 | 57d50dcddf93bfcba90c3f19d3b50d89 |
|
BLAKE2b-256 | 5001788a10cacb44a0d7e6001c4f7e5777e4259cb7beae4b5a8d99ec9396e1f4 |