Queuing, storage, metering, rate limiting for AI
Project description
Meteron AI
Installation:
pip install meteron
Usage:
import json
from meteron import Cluster
# Create your cluster that has one or more servers.
# In this example we will use https://lightning.ai/muse
cluster = Cluster(cluster='lightning-muse',
servers=[{
'url': 'https://ulhcn-01gd3c9epmk5xj2y9a9jrrvgt8.litng-ai-03.litng.ai/api/predict'
}])
cluster.initialize()
# Send the request to the cluster
result = cluster.image_gen(data=json.dumps({'prompt': 'spaceships above alien planet'}))
# Do whatever you want with the result
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
meteron-0.1.2.tar.gz
(7.3 kB
view hashes)