langchain chroma package for ally
Project description
Ally AI
How to use
Config File
llm:
api_key: '<private-key>'
api_version: "<api-version>"
endpoint: "<endpoint>"
model: "<model-name>"
deployment_name: '<deployment-name>'
temperature: 0.7
streaming: true
embeddings:
api_key: '<private-key>'
api_version: "<api-version>"
endpoint: "<endpoint>"
model: "<model-name>"
deployment_name: '<deployment-name>'
Create LLM
Use Default Settings in LLM
from ally_ai.llamaindex import LLM
llm = LLM()
response = llm.invoke('What is an ally?')
print(response)
Use Custom Settings in LLM
my_llm:
api_key: '<private-key>'
api_version: "<api-version>"
from ally_ai.llamaindex import LLM, Settings
settings = Settings(section='my_llm')
llm = LLM(settings=settings)
print(llm.settings.path)
print(llm.settings.section)
Override Settings in LLM
from ally_ai.llamaindex import LLM, Settings
settings = Settings(section='my_llm', api_key='<new-api-key>')
llm = LLM(settings=settings)
response = llm.invoke('What is an ally?')
print(response)
How to Create Embeddings
from ally_ai.llamaindex import Embeddings
embeddings = Embeddings()
response = embeddings.embed_query('What is an ally?')
print(response)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ally_ai_chroma-0.0.1.tar.gz
(3.5 kB
view hashes)
Built Distribution
Close
Hashes for ally_ai_chroma-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3f5e776955fede1f3ec893b4cf77ce21d62f011b93c81b57554da86fe76eddb0 |
|
MD5 | 8860557f5ad9385ef73b27e7258b9ce1 |
|
BLAKE2b-256 | 2fa0c46344a9836def944fb8b5506b812c7355f6019cb2bd2a3aab162d87c6e0 |