5 projects
simpleinference
A stable and easy-to-use inference library with a focus on a sync-to-async API
infinity-emb
Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of sentence-transformer models and frameworks.
hf-hub-ctranslate2
Connecting Transfromers on HuggingfaceHub with Ctranslate2.
gradientai
Gradient AI API
rlskyjo
Multi-Agent Reinforcement Learning Environment for the card game SkyJo, compatible with PettingZoo and RLLIB