Skip to main content

Azure vector database provider for NLWeb - Azure AI Search client

Project description

nlweb-azure-vectordb

Azure AI Search provider for NLWeb.

Overview

This is a blueprint package demonstrating how to create individual provider packages for NLWeb. It contains only the Azure AI Search retrieval provider.

Third-party developers can use this as a template for creating their own provider packages (e.g., nlweb-pinecone, nlweb-weaviate, etc.).

Installation

pip install nlweb-core nlweb-azure-vectordb

For LLM and embedding, you'll also need a model provider:

pip install nlweb-azure-models

Or use the bundle packages:

pip install nlweb-core nlweb-retrieval nlweb-models

Configuration

Create config.yaml:

retrieval:
  provider: azure_ai_search
  import_path: nlweb_azure_vectordb.azure_search_client
  class_name: AzureSearchClient
  api_endpoint_env: AZURE_SEARCH_ENDPOINT
  auth_method: azure_ad  # or api_key
  index_name: my-search-index

Authentication Methods

API Key Authentication

retrieval:
  provider: azure_ai_search
  import_path: nlweb_azure_vectordb.azure_search_client
  class_name: AzureSearchClient
  api_endpoint_env: AZURE_SEARCH_ENDPOINT
  api_key_env: AZURE_SEARCH_KEY
  auth_method: api_key
  index_name: my-index

Set environment variables:

export AZURE_SEARCH_ENDPOINT=https://your-service.search.windows.net
export AZURE_SEARCH_KEY=your_key_here

Managed Identity (Azure AD) Authentication

retrieval:
  provider: azure_ai_search
  import_path: nlweb_azure_vectordb.azure_search_client
  class_name: AzureSearchClient
  api_endpoint_env: AZURE_SEARCH_ENDPOINT
  auth_method: azure_ad
  index_name: my-index

Set environment variable:

export AZURE_SEARCH_ENDPOINT=https://your-service.search.windows.net

Usage

import nlweb_core

# Initialize
nlweb_core.init(config_path="./config.yaml")

# Search
from nlweb_core import retriever

results = await retriever.search(
    query="example query",
    site="example.com",
    num_results=10
)

Features

  • Vector similarity search with Azure AI Search
  • Hybrid search (vector + keyword)
  • Managed identity (Azure AD) authentication support
  • API key authentication support
  • Configurable index names
  • Compatible with NLWeb Protocol v0.5

Creating Your Own Provider Package

Use this package as a template:

  1. Create package structure:

    nlweb-yourprovider/
    ├── pyproject.toml
    ├── README.md
    └── nlweb_yourprovider/
        ├── __init__.py
        └── your_client.py
    
  2. Implement VectorDBClientInterface:

    from nlweb_core.retriever import VectorDBClientInterface
    
    class YourClient(VectorDBClientInterface):
        async def search(self, query, site, num_results, **kwargs):
            # Your implementation
            pass
    
  3. Declare dependencies in pyproject.toml:

    dependencies = [
        "nlweb-core>=0.5.0",
        "your-provider-sdk>=1.0.0",
    ]
    
  4. Publish to PyPI:

    python -m build
    twine upload dist/*
    

License

MIT License - Copyright (c) 2025 Microsoft Corporation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nlweb_azure_vectordb-0.0.0.tar.gz (8.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nlweb_azure_vectordb-0.0.0-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file nlweb_azure_vectordb-0.0.0.tar.gz.

File metadata

  • Download URL: nlweb_azure_vectordb-0.0.0.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for nlweb_azure_vectordb-0.0.0.tar.gz
Algorithm Hash digest
SHA256 f377d99534f4083b3b96b950d9e2cc86aa243a5c06bebc57576349025b8f4c22
MD5 28f5de6fc47478c4f52adcbe44ef676f
BLAKE2b-256 66434000a7bbac0611470c7be4b91a03284c516aaa9a4e168447d8efe7f04c84

See more details on using hashes here.

File details

Details for the file nlweb_azure_vectordb-0.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for nlweb_azure_vectordb-0.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 46fd745da8b888b72bbc340375a87ad7c437d2cff4d09908ed28862d08cde538
MD5 1bc2084447f3722eaf214ba91a6e3188
BLAKE2b-256 050bbdce5b680aeed417fb3b806f9181fa23bee8a6fa2bd294b6e0a501547b90

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page