Skip to main content

Modern async Python framework for AI APIs with native Model Context Protocol (MCP) support

Project description

nzrApi Framework

🤖 Modern Async Python Framework for AI APIs with Native MCP Support

PyPI version Python Support License: MIT Build Status Coverage

Documentation | Examples | n8n Integration | Contributing


✨ What is nzrApi?

nzrApi is a powerful, production-ready Python framework specifically designed for building AI-powered APIs. It combines the best of modern web frameworks with specialized features for AI model integration, making it the perfect choice for developers who want to build scalable AI services with minimal complexity.

🎯 Key Features

  • 🤖 Native AI Model Integration - First-class support for multiple AI providers and custom models
  • 🔄 Model Context Protocol (MCP) - Built-in MCP implementation for seamless n8n integration
  • High Performance - Async/await throughout with ASGI compliance
  • 📊 Context Management - Persistent conversation contexts with automatic cleanup
  • 🛡️ Production Ready - Rate limiting, authentication, monitoring, and error handling
  • 🗄️ Database Integration - SQLAlchemy async with automatic migrations
  • 🎨 DRF-Inspired Serializers - Familiar, powerful data validation and transformation
  • 🚀 Auto-Generation - CLI tools for rapid project scaffolding
  • 🐳 Cloud Native - Docker support with production configurations

🚀 Quick Start

Installation

pip install nzrapi

Create Your First AI API

# Create a new project
nzrapi new my-ai-api

# Navigate to project
cd my-ai-api

# Run the development server
nzrapi run --reload

Your AI API is now running at http://localhost:8000! 🎉

Hello World Example

from nzrapi import NzrApiApp, Router

app = NzrApiApp(title="My AI API")
router = Router()

@router.post("/chat")
async def chat(request):
    data = await request.json()
    
    # Use built-in AI model
    model = request.app.ai_registry.get_model("default")
    result = await model.predict({"message": data["message"]})
    
    return {"response": result["response"]}

app.include_router(router)

if __name__ == "__main__":
    import uvicorn
    uvicorn.run(app, host="0.0.0.0", port=8000)

🤖 AI Model Integration

nzrApi makes it incredibly easy to work with AI models:

from nzrapi.ai.models import AIModel

class MyCustomModel(AIModel):
    async def load_model(self):
        # Load your model (PyTorch, HuggingFace, OpenAI, etc.)
        self.model = load_my_model()
        self.is_loaded = True
    
    async def predict(self, payload, context=None):
        # Make predictions with optional context
        result = self.model.generate(payload["prompt"])
        return {"response": result}

# Register and use
app.ai_registry.register_model_class("custom", MyCustomModel)
await app.ai_registry.add_model("my_model", "custom", config={...})

Supported AI Providers

  • OpenAI (GPT-3.5, GPT-4, etc.)
  • Anthropic (Claude models)
  • HuggingFace (Transformers, Inference API)
  • Custom Models (PyTorch, TensorFlow, etc.)
  • Mock Models (for development and testing)

🔄 Model Context Protocol (MCP)

nzrApi implements the Model Context Protocol for stateful AI interactions:

# MCP-compliant endpoint
@router.post("/mcp/{model_name}/predict")
async def mcp_predict(request, model_name: str):
    # Automatic context management
    mcp_request = MCPRequest(**(await request.json()))
    
    # Retrieve conversation context
    context = await get_context(mcp_request.context_id)
    
    # Make prediction with context
    model = request.app.ai_registry.get_model(model_name)
    result = await model.predict(mcp_request.payload, context)
    
    # Return MCP-compliant response
    return MCPResponse(
        request_id=mcp_request.request_id,
        context_id=mcp_request.context_id,
        result=result
    )

🎨 Powerful Serializers

nzrApi provides robust data validation:

from nzrapi.serializers import BaseSerializer, CharField, IntegerField

class ChatRequestSerializer(BaseSerializer):
    message = CharField(max_length=1000)
    user_id = CharField(required=False)
    temperature = FloatField(min_value=0.0, max_value=2.0, default=0.7)
    
    def validate(self, data):
        # Custom validation logic
        return data

# Use in endpoints
@router.post("/chat")
async def chat(request):
    data = await request.json()
    serializer = ChatRequestSerializer(data=data)
    
    if serializer.is_valid():
        validated_data = serializer.validated_data
        # Process with confidence...
    else:
        return JSONResponse(serializer.errors, status_code=422)

🗄️ Database Integration

Built-in async database support with SQLAlchemy:

from nzrapi.db import Base
from sqlalchemy import Column, Integer, String, DateTime

class ConversationHistory(Base):
    __tablename__ = "conversations"
    
    id = Column(Integer, primary_key=True)
    user_id = Column(String(255), index=True)
    message = Column(Text)
    response = Column(Text)
    created_at = Column(DateTime, default=datetime.utcnow)

# Use in endpoints
@router.post("/chat")
async def chat(request):
    async with request.app.get_db_session() as session:
        # Save conversation
        conversation = ConversationHistory(
            user_id=user_id,
            message=message,
            response=response
        )
        session.add(conversation)
        await session.commit()

🛡️ Production Features

Rate Limiting

from nzrapi.middleware import RateLimitMiddleware

app.add_middleware(
    RateLimitMiddleware,
    calls_per_minute=60,
    calls_per_hour=1000
)

Authentication

from nzrapi.middleware import AuthenticationMiddleware

app.add_middleware(
    AuthenticationMiddleware,
    secret_key="your-secret-key"
)

CORS for n8n

from starlette.middleware.cors import CORSMiddleware

app.add_middleware(
    CORSMiddleware,
    allow_origins=["https://app.n8n.cloud"],
    allow_credentials=True,
    allow_methods=["*"],
    allow_headers=["*"]
)

🔧 CLI Tools

nzrApi includes powerful CLI tools for development:

# Create new project
nzrapi new my-project --template mcp-server

# Run development server  
nzrapi run --reload --port 8000

# Database migrations
nzrapi migrate -m "Add user table"
nzrapi migrate --upgrade

# Model management
nzrapi models --list
nzrapi models --add openai_gpt4 --type openai

# Project info
nzrapi info

🌐 n8n Integration

Perfect for n8n workflows with built-in MCP support:

{
  "nodes": [{
    "name": "AI Chat",
    "type": "n8n-nodes-base.httpRequest",
    "parameters": {
      "url": "http://your-api.com/api/v1/mcp/gpt4/predict",
      "method": "POST",
      "body": {
        "context_id": "{{ $json.session_id }}",
        "payload": {
          "message": "{{ $json.user_input }}"
        }
      }
    }
  }]
}

📊 Monitoring & Observability

Built-in monitoring capabilities:

# Health checks
GET /health
GET /api/v1/models/{name}/health

# Metrics
GET /metrics
GET /api/v1/stats

# Usage analytics
GET /api/v1/usage/models
GET /api/v1/conversations/{context_id}

🐳 Docker Deployment

Production-ready containers:

FROM python:3.11-slim
COPY requirements.txt .
RUN pip install -r requirements.txt
COPY . .
EXPOSE 8000
CMD ["uvicorn", "main:app", "--host", "0.0.0.0", "--port", "8000"]
# Build and run
docker build -t my-ai-api .
docker run -p 8000:8000 my-ai-api

# Or use docker-compose
docker-compose up -d

📚 Examples

Check out our comprehensive examples:

📖 Documentation

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

# Development setup
git clone https://github.com/nzrapi/nzrapi.git
cd nzrapi
pip install -e ".[dev]"

# Run tests
pytest

# Run linting
black .
isort .
flake8

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

  • Built on the excellent FastAPI and Starlette foundations
  • Designed for seamless n8n integration
  • Community-driven development

🔗 Links


Built with ❤️ for the AI community

nzrApi Framework - Making AI APIs Simple and Powerful

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nzrapi-0.2.0.tar.gz (88.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nzrapi-0.2.0-py3-none-any.whl (51.2 kB view details)

Uploaded Python 3

File details

Details for the file nzrapi-0.2.0.tar.gz.

File metadata

  • Download URL: nzrapi-0.2.0.tar.gz
  • Upload date:
  • Size: 88.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for nzrapi-0.2.0.tar.gz
Algorithm Hash digest
SHA256 8a089838b5d477b91f06477686817365a0b0c707e2f70977deff8c504b377939
MD5 77c8da03a56826397db5705c334e1627
BLAKE2b-256 6b7105d63c8e678ca81395737143bfbf143583fbcea146cc09fe43f76584da70

See more details on using hashes here.

File details

Details for the file nzrapi-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: nzrapi-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 51.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for nzrapi-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5eaa99d28e475f3d82f7bd26ab2d614debc43bde9be29bf74e25f73f3bff6fed
MD5 b78fbe144f98cde8334a9f8062bf336f
BLAKE2b-256 ad2fb59225fa9628587a615e5eb2277991f2470c0328f26b74100eb0c977bc2e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page