nlweb-pilabs-models 0.6.0

Pi Labs model providers for NLWeb

NLWeb Pi Labs Models

Pi Labs LLM scoring provider for NLWeb.

Overview

This package provides integration with Pi Labs scoring API for relevance scoring in NLWeb queries.

Features

• PiLabsProvider: LLM provider that uses Pi Labs scoring API
• PiLabsClient: HTTP client for Pi Labs API
• Async scoring with httpx and HTTP/2 support
• Thread-safe client initialization

Installation

pip install -e packages/providers/pilabs/models

Usage

Configure in your config.yaml:

llm:
  scoring:
    llm_type: pilabs
    endpoint: "http://localhost:8001/invocations"
    import_path: "nlweb_pilabs_models.llm"
    class_name: "PiLabsProvider"

Requirements

• Python >= 3.11
• httpx with HTTP/2 support
• nlweb_core

API

The Pi Labs provider expects:

• request.query: The user query
• item.description: The item to score
• site.itemType: The type of item

Returns:

• score: Relevance score (0-100)
• description: Item description