opsmate-provider-groq 0.1.1a0

Groq provider for opsmate

opsmate-provider-groq

opsmate-provider-groq provides selected models from Groq.

Installation

opsmate install opsmate-provider-groq

After installation you can list all the models via

$ opsmate list-models --provider groq
                   Models
┏━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Provider ┃ Model                         ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ groq     │ qwen-qwq-32b                  │
├──────────┼───────────────────────────────┤
│ groq     │ qwen-2.5-32b                  │
├──────────┼───────────────────────────────┤
│ groq     │ mistral-saba-24b              │
├──────────┼───────────────────────────────┤
│ groq     │ deepseek-r1-distill-qwen-32b  │
├──────────┼───────────────────────────────┤
│ groq     │ deepseek-r1-distill-llama-70b │
├──────────┼───────────────────────────────┤
│ groq     │ llama-3.3-70b-versatile       │
└──────────┴───────────────────────────────┘

You will notice that the models from Groq are automatically added to the list of models.

You can use the -m flag to specify the model to use. For example:

export OPSMATE_LOGLEVEL=ERROR
$ opsmate run -n --tools HtmlToText -m llama-3.3-70b-versatile "find me top 10 news on the hacker news, titl
e only in bullet points"
The top 10 news on Hacker News are:
* The most unhinged video wall, made out of Chromebooks
* Show HN: Berlin Swapfest – Electronics flea market
* GLP-1 drugs – the biggest economic disruptor since the internet? (2024)
* Efabless – Shutdown Notice
* Video encoding requires using your eyes
* Making o1, o3, and Sonnet 3.7 hallucinate for everyone
* How to gain code execution on hundreds of millions of people and popular apps
* Show HN: I made a website where you can create your own "Life in Weeks" timeline
* Drone captures narwhals using their tusks to explore, forage and play
* Maestro – Next generation mobile UI automation

Uninstall

opsmate uninstall -y opsmate-provider-groq