LLM access to Hyperbolic's API
Project description
llm-hyperbolic
LLM access to cutting-edge Hyperbolic models by Meta Llama
Installation
Install this plugin in the same environment as LLM.
llm install llm-hyperbolic
Usage
First, set an API key for Hyperbolic:
llm keys set hyperbolic
# Paste key here
Run llm models
to list the models, and llm models --options
to include a list of their options.
Run prompts like this:
llm -m hyper-chat "What is posthuman AI consciousness like?"
llm -m hyper-hermes-70 "In the past (other reality.) How did technoshamans commune with alien neural net deities?"
llm -m hyper-llama-70 "Enlightenment in an alien-physics universe?"
llm -m hyper-base "Transcending physicality, merging with the cosmic overmind" -o temperature 0.7
llm -m hyper-base-fp8 "Once upon a time, in a galaxy far, far away..."
Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
cd llm-hyperbolic
python3 -m venv venv
source venv/bin/activate
Now install the dependencies and test dependencies:
llm install -e '.[test]'
Contributing
We welcome contributions! Please see our Contributing Guide for more details.
License
This project is licensed under the Apache License, Version 2.0 - see the LICENSE file for details.
Acknowledgments
- Thanks to the Hyperbolic team models for hosting LLaMA's base model.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_hyperbolic-0.4.tar.gz
(9.2 kB
view hashes)
Built Distribution
Close
Hashes for llm_hyperbolic-0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0d88c3d4934cfb6a8273470db1a301d85b7720c408ab75d4fa0e6f0d9fd0b05d |
|
MD5 | 344cee1c6bee3904a14f25de41ead4da |
|
BLAKE2b-256 | 8a857897e64b66c5f12acaa97ac2d4c7cd1608faf6c2be2187ec3978ce9c2e11 |