dgxarley 0.0.2

No project description provided

dgxarley

Tooling for the DGX Arley K3s inference cluster — integration tests, streaming utilities, and CLI entry points for SGLang, Ollama, and OpenWebUI services.

What's included

CLI tools

Command	Description
sglang-raw	Interactive SSE stream viewer with dual-panel Rich display (interpreted output + raw JSON chunks)
sglang-test	Direct SGLang client with sequential and parallel load testing (live Rich TUI)
openwebui-test	OpenWebUI / LLM client with preset management and streaming
ollama-test	Ollama API health, model, embedding, and chat completions tests

Libraries

Module	Description
dgxarley.integration.repetition_detector	Offline n-gram, sentence, and loop repetition analysis for completed LLM outputs
dgxarley.integration.streaming_repetition_guard	Real-time repetition detection for token streams with configurable thresholds

Installation

pip install dgxarley

Quick start

from dgxarley.integration.repetition_detector import detect_repetition

report = detect_repetition(llm_output)
print(report.summary())
# [LOW] score=0.12 — N-Gram 'this is a test' x2

from dgxarley.integration.streaming_repetition_guard import RepetitionGuard

guard = RepetitionGuard()
for chunk in llm_stream:
    token = chunk.choices[0].delta.content or ""
    result = guard.feed(token)
    if result.should_stop:
        print(f"STOP: {result.reason}")
        break

Requirements

• Python >= 3.14

Source & documentation

Full documentation, network architecture, and Ansible playbooks: GitHub

License

LGPL where applicable — see LICENSE.md for details.