LlamaIndex Llms Integration: Groq
Welcome to Groq! 🚀 At Groq, we've developed the world's first Language Processing Unit™, or LPU. The Groq LPU has a deterministic, single core streaming architecture that sets the standard for GenAI inference speed with predictable and repeatable performance for any given workload.
Beyond the architecture, our software is designed to empower developers like you with the tools you need to create innovative, powerful AI applications. With Groq as your engine, you can:
- Achieve uncompromised low latency and performance for real-time AI and HPC inferences 🔥
- Know the exact performance and compute time for any given workload 🔮
- Take advantage of our cutting-edge technology to stay ahead of the competition 💪
Want more Groq? Check out our website for more resources and join our Discord community to connect with our developers!
Develop
To create a development environment, install poetry then run:
poetry install --with dev
Testing
To test the integration, first enter the poetry venv:
poetry shell
Then tests can be run with make
make test
Integration tests
Integration tests will be skipped unless an API key is provided. API keys can be created ath the groq console. Once created, store the API key in an environment variable and run tests
export GROQ_API_KEY=<your key here>
make test
Linting and Formatting
Linting and code formatting can be executed with make.
make format
make lint
1 maintainer
Release files for llama-index-llms-groq 0.6.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llama_index_llms_groq-0.6.1.tar.gz | 4.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llama_index_llms_groq-0.6.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 7.9 kB
Release files / llama_index_llms_groq-0.6.1.tar.gz
| Download URL | llama_index_llms_groq-0.6.1.tar.gz |
|---|---|
| Size | 4.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
da7590a5caa1582c8bd35f585deab0876a8bf130e864f56abc698f0d4ba55d65
|
|
BLAKE2b-256 checksum How to use checksums |
7b079c4b1fe013c74e9812d8fb67f0f11c98a26f7dfae71cfd8f21f5ad2fa59c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / llama_index_llms_groq-0.6.1-py3-none-any.whl
| Download URL | llama_index_llms_groq-0.6.1-py3-none-any.whl |
|---|---|
| Size | 3.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f2a62e2e25e045dc524349a1b55c213b7696de7f082f15acbd953dab1805d17f
|
|
BLAKE2b-256 checksum How to use checksums |
476ab1f9222d59c97a963e9c8d467154decbf8ef81ea1f434cdc4512f2b77a3b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
