Plugin for LLM adding support for Google Cloud Vertex AI
Project description
llm-vertex
Plugin for LLM adding support for Google Cloud Vertex AI.
Please note that this plugin is for Vertex AI specifically, not Google AI Studio.
For Gemini support using AI Studio, please see llm-gemini instead.
Supported models:
- gemini-1.5-pro-preview-0409
- gemini-1.0-pro-vision-001
- gemini-experimental
Installation
pip install llm-vertex
Use
First, authenticate using gcloud
:
gcloud auth application-default login
Export two environment variables for the GCP Project and location you want to use:
export VERTEX_PROJECT_ID=gcp-project-id VERTEX_LOCATION=us-east1
Run llm and specify one of the provided models:
❯ llm -m gemini-1.5-pro-preview-0409 "What's one clever name for a pet pelican?"
"Gulliver" would be a clever name for a pet pelican, referencing both its large gullet and its potential for long journeys! 🦜
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_vertex-0.1.1.tar.gz
(6.4 kB
view hashes)
Built Distribution
Close
Hashes for llm_vertex-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3de12e2802b5a6c6ddde102fc597ecd13fe7390e4060efe756cd0bf68e9990c7 |
|
MD5 | 88aff9cb5fd421ff7457408617a5ca06 |
|
BLAKE2b-256 | 8aab5cc75c02320d29bf8a8c06252f9817aaa8ccbbb07bd7054ca186ef56bdbd |