An integration between the Ollama LLM framework and Haystack
Project description
ollama-haystack
Table of Contents
Installation
pip install ollama-haystack
License
ollama-haystack
is distributed under the terms of the Apache-2.0 license.
Testing
To run tests first start a Docker container running Ollama and pull a model for integration testing It's recommended to use the smallest model possible for testing purposes - see https://ollama.ai/library for a list that Ollama supportd
docker run -d -p 11434:11434 --name ollama ollama/ollama:latest
docker exec ollama ollama pull <your model here>
Then run tests:
hatch run test
The default model used here is orca-mini
for generation and nomic-embed-text
for embeddings
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ollama_haystack-1.0.1.tar.gz
(16.8 kB
view details)
Built Distribution
File details
Details for the file ollama_haystack-1.0.1.tar.gz
.
File metadata
- Download URL: ollama_haystack-1.0.1.tar.gz
- Upload date:
- Size: 16.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.27.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 700b54aa93fdabb43b3959481164f28e664a86266ae3054c91e9a71025471c6a |
|
MD5 | 09275f4618e82a9f1bec793b54f9ea7a |
|
BLAKE2b-256 | 9027b4227cac53db7f2924dc1e060ea2f22123fdd046ae0b59e94869d1bb57a6 |
File details
Details for the file ollama_haystack-1.0.1-py3-none-any.whl
.
File metadata
- Download URL: ollama_haystack-1.0.1-py3-none-any.whl
- Upload date:
- Size: 14.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.27.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 285429879421b3b5c1cfb20cc5325bc5148fc78a5b0f71aed69054221d277438 |
|
MD5 | 50470657400b2d6359b944b121a0b96c |
|
BLAKE2b-256 | b7be6a40bb6d84d566890523eb942dc62d50661e24596aca9095c2f8fd533654 |