Skip to main content

Run multiple Ollama servers in parallel for concurrent LLM inference

Project description

polyollama

Run multiple Ollama servers in parallel to maximize LLM inference throughput on a single machine.

Installation

pip install polyollama

Requires Ollama on your PATH.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

polyollama-0.1.0.tar.gz (118.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

polyollama-0.1.0-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file polyollama-0.1.0.tar.gz.

File metadata

  • Download URL: polyollama-0.1.0.tar.gz
  • Upload date:
  • Size: 118.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.11

File hashes

Hashes for polyollama-0.1.0.tar.gz
Algorithm Hash digest
SHA256 27aef17d51f4f04328e70a80bc7be0994b2eb73298dfc22e99fe094bfbeee3c3
MD5 ba1d5aa6f8e55dedfd03239dbcde2397
BLAKE2b-256 3a94a476fef42155b4c052d1e17e87b5f27c942b6f8917fe5ffb78aef4e06cbb

See more details on using hashes here.

File details

Details for the file polyollama-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: polyollama-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 8.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.11

File hashes

Hashes for polyollama-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a1b0a128423cae7823bda7243950c6855a34e961cf9312bbddea955c77c9c66a
MD5 02169ab0094138688083952b47e83a7e
BLAKE2b-256 14b6281f93fe99a6067ac0ac37fb14808c3d72b3e70d4d4e84f18b5af4242c3d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page