Skip to main content

Network interfaces and server for NLWeb - HTTP, MCP, and A2A protocol adapters

Project description

NLWeb Network

Network interfaces and server for NLWeb - provides HTTP, MCP, and A2A protocol adapters.

Overview

nlweb-network provides transport layer adapters that convert protocol-specific requests into a common format for NLWeb handlers, and convert NLWeb outputs back into the appropriate protocol format.

Architecture

┌──────────────────────────────────────────────┐
│           Protocol Adapters                   │
│  (HTTP SSE, HTTP JSON, MCP SSE, MCP HTTP)    │
└──────────────────┬───────────────────────────┘
                   │
                   ↓
         ┌─────────────────┐
         │  NLWeb Handlers │
         │  (Core Package) │
         └─────────────────┘

Supported Protocols

HTTP Interfaces

HTTP with Server-Sent Events (Default)

  • Endpoint: /ask (GET/POST)
  • Parameter: streaming=true (default)
  • Use case: Real-time streaming of results as they're generated
curl "http://localhost:8080/ask?query=best+pasta+recipe"

HTTP with JSON Response

  • Endpoint: /ask (GET/POST)
  • Parameter: streaming=false
  • Use case: Get complete results in single JSON response
curl "http://localhost:8080/ask?query=best+pasta+recipe&streaming=false"

MCP (Model Context Protocol) Interfaces

MCP over HTTP (StreamableHTTP)

  • Endpoint: /mcp (POST)
  • Format: JSON-RPC 2.0
  • Use case: Standard MCP integration for tools/agents
# Test with MCP Inspector
npx @modelcontextprotocol/inspector http://localhost:8080/mcp

MCP over Server-Sent Events

  • Endpoint: /mcp-sse (GET/POST)
  • Format: JSON-RPC 2.0 over SSE
  • Use case: Streaming MCP responses in real-time

A2A (Agent-to-Agent) Interfaces

(Coming soon)

Installation

# Install from PyPI (when published)
pip install nlweb-network

# Or install from source
pip install -e packages/network

Usage

Starting the Server

from nlweb_network.server import main

# Start server with default configuration
main()

Or use the command-line entry point:

nlweb-server

Using Interface Adapters

You can use the interface adapters directly in your own applications:

from aiohttp import web
from nlweb_network.interfaces import HTTPJSONInterface, HTTPSSEInterface
from nlweb_core.NLWebVectorDBRankingHandler import NLWebVectorDBRankingHandler

# For non-streaming JSON responses
async def my_handler(request):
    interface = HTTPJSONInterface()
    return await interface.handle_request(request, NLWebVectorDBRankingHandler)

# For streaming SSE responses
async def my_streaming_handler(request):
    interface = HTTPSSEInterface()
    return await interface.handle_request(request, NLWebVectorDBRankingHandler)

Interface Adapters

All interface adapters inherit from BaseInterface and implement:

  • parse_request() - Extract query parameters from protocol-specific request
  • send_response() - Send data in protocol-specific format
  • finalize_response() - Close/finalize the response stream
  • handle_request() - Complete request/response cycle

Available Interfaces

Interface Class Protocol Streaming
HTTP JSON HTTPJSONInterface HTTP No
HTTP SSE HTTPSSEInterface HTTP + SSE Yes
MCP StreamableHTTP MCPStreamableInterface JSON-RPC 2.0 No
MCP SSE MCPSSEInterface JSON-RPC 2.0 + SSE Yes

Configuration

The server uses configuration from nlweb-core:

# config.yaml
server:
  host: localhost
  port: 8080
  enable_cors: true

Endpoints

/ask - HTTP Query Endpoint

GET/POST - Natural language query with NLWeb RAG pipeline

Parameters:

  • query (required) - Natural language query
  • site (optional) - Filter by site (default: "all")
  • num_results (optional) - Number of results (default: 50)
  • streaming (optional) - Enable SSE streaming (default: true)

Examples:

# Streaming (SSE)
curl "http://localhost:8080/ask?query=spicy+snacks&site=seriouseats"

# Non-streaming (JSON)
curl "http://localhost:8080/ask?query=spicy+snacks&streaming=false"

# POST with JSON body
curl -X POST http://localhost:8080/ask \
     -H 'Content-Type: application/json' \
     -d '{"query": "spicy snacks", "streaming": false}'

/mcp - MCP Protocol Endpoint

POST - JSON-RPC 2.0 requests for MCP protocol

Methods:

  • initialize - Protocol handshake
  • tools/list - List available tools
  • tools/call - Execute tool (routes to NLWeb handlers)

Example:

curl -X POST http://localhost:8080/mcp \
     -H 'Content-Type: application/json' \
     -d '{
       "jsonrpc": "2.0",
       "id": 1,
       "method": "tools/call",
       "params": {
         "name": "ask",
         "arguments": {"query": "best pasta recipe"}
       }
     }'

/mcp-sse - MCP with SSE Streaming

GET/POST - MCP protocol with Server-Sent Events

Same as /mcp but streams results via SSE for tools/call.

/health - Health Check

GET - Simple health check

curl http://localhost:8080/health
# {"status": "ok"}

Dependencies

  • nlweb-core>=0.5.0 - Core NLWeb handlers and business logic
  • aiohttp>=3.8.0 - Async HTTP server
  • aiohttp-cors>=0.7.0 - CORS support

Development

# Install in editable mode with dev dependencies
pip install -e "packages/network[dev]"

# Run tests
pytest packages/network/tests

License

MIT License - Copyright (c) 2025 Microsoft Corporation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nlweb_network-0.5.1.tar.gz (15.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nlweb_network-0.5.1-py3-none-any.whl (20.6 kB view details)

Uploaded Python 3

File details

Details for the file nlweb_network-0.5.1.tar.gz.

File metadata

  • Download URL: nlweb_network-0.5.1.tar.gz
  • Upload date:
  • Size: 15.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for nlweb_network-0.5.1.tar.gz
Algorithm Hash digest
SHA256 5fe7fb1c33674d0b28cf902a009eefe0e236b264d22aaa21f60285db66f6a4a9
MD5 eab0d2a3c1e8da4fdab535f32a3962ac
BLAKE2b-256 c856d1e4936b38b729eb9b7bda13e1c733cf95dc7784beac1375c5e8da82a9f3

See more details on using hashes here.

File details

Details for the file nlweb_network-0.5.1-py3-none-any.whl.

File metadata

  • Download URL: nlweb_network-0.5.1-py3-none-any.whl
  • Upload date:
  • Size: 20.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for nlweb_network-0.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 74aab91c3c5c89e0228abfba08eba0bfe78e83042b222e8e88bb9bae8cbbc4fb
MD5 be94abfce9281c096fef0580c54d0968
BLAKE2b-256 52813924c6dd3e1386d21fc29a91735b9c3e548ec0c31d5e2431e29ee4c754f8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page