An integration package connecting Google VertexAI and LangChain
Project description
langchain-google-vertexai
This package contains the LangChain integrations for Google Cloud generative models.
Installation
pip install -U langchain-google-vertexai
Chat Models
ChatVertexAI
class exposes models such as gemini-pro
and chat-bison
.
To use, you should have Google Cloud project with APIs enabled, and configured credentials. Initialize the model as:
from langchain_google_vertexai import ChatVertexAI
llm = ChatVertexAI(model_name="gemini-pro")
llm.invoke("Sing a ballad of LangChain.")
You can use other models, e.g. chat-bison
:
from langchain_google_vertexai import ChatVertexAI
llm = ChatVertexAI(model_name="chat-bison", temperature=0.3)
llm.invoke("Sing a ballad of LangChain.")
Multimodal inputs
Gemini vision model supports image inputs when providing a single chat message. Example:
from langchain_core.messages import HumanMessage
from langchain_google_vertexai import ChatVertexAI
llm = ChatVertexAI(model_name="gemini-pro-vision")
# example
message = HumanMessage(
content=[
{
"type": "text",
"text": "What's in this image?",
}, # You can optionally provide text parts
{"type": "image_url", "image_url": {"url": "https://picsum.photos/seed/picsum/200/300"}},
]
)
llm.invoke([message])
The value of image_url
can be any of the following:
- A public image URL
- An accessible gcs file (e.g., "gcs://path/to/file.png")
- A local file path
- A base64 encoded image (e.g.,
data:image/png;base64,abcd124
)
Embeddings
You can use Google Cloud's embeddings models as:
from langchain_google_vertexai import VertexAIEmbeddings
embeddings = VertexAIEmbeddings()
embeddings.embed_query("hello, world!")
LLMs
You can use Google Cloud's generative AI models as Langchain LLMs:
from langchain_core.prompts import PromptTemplate
from langchain_google_vertexai import ChatVertexAI
template = """Question: {question}
Answer: Let's think step by step."""
prompt = PromptTemplate.from_template(template)
llm = ChatVertexAI(model_name="gemini-pro")
chain = prompt | llm
question = "Who was the president of the USA in 1994?"
print(chain.invoke({"question": question}))
You can use Gemini and Palm models, including code-generations ones:
from langchain_google_vertexai import VertexAI
llm = VertexAI(model_name="code-bison", max_output_tokens=1000, temperature=0.3)
question = "Write a python function that checks if a string is a valid email address"
output = llm(question)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for langchain_google_vertexai-1.0.8.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | db5b28aca9ae2cd0a775d97ec25374f9efac05e0ad336cb1cd5ca665e47b3fc3 |
|
MD5 | 43c5d28ef0ca32e76ddec68c8d8ac418 |
|
BLAKE2b-256 | d9932b68bf7f1ba98c246290d0ce0a246920cb58d5e2bdbbb27a5b1235607654 |
Hashes for langchain_google_vertexai-1.0.8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e35fb910604bfb05704f191bf17998e7f841a92f21677a0219c4f3a97de945c3 |
|
MD5 | 9e286f58f5062e38ce28403523e4577e |
|
BLAKE2b-256 | 6f460f8ee841b21a3c45a3d9a743d196a0e33663e798210de3c8bdb233bf61e0 |