Skip to main content

Core utilities and models for FireFeed microservices

Project description

FireFeed Core

Core utilities and models for FireFeed microservices architecture.

FireFeed Core is a shared library that provides common components for all FireFeed microservices, ensuring consistency, security, and reliability across the distributed system.

๐Ÿš€ Features

  • API Client: Robust HTTP client with authentication, retry policies, circuit breaker, and rate limiting
  • JWT Authentication: Service-to-service authentication with token management
  • Exception Handling: Comprehensive exception hierarchy for consistent error handling
  • Configuration: Pydantic-based configuration management
  • Interfaces: Abstract interfaces for service contracts
  • Utilities: Common utility functions and helpers

๐Ÿ“ฆ Installation

pip install firefeed-core

๐Ÿ”ง Quick Start

Basic API Client Usage

import asyncio
from firefeed_core import APIClient

async def main():
    # Initialize API client
    async with APIClient(
        base_url="http://firefeed-api:8000",
        token="your-jwt-token",
        service_id="firefeed-rss-parser"
    ) as client:
        
        # Make authenticated requests
        feeds = await client.get("/api/v1/internal/rss/feeds")
        print(f"Found {len(feeds)} feeds")
        
        # Create new RSS item
        new_item = await client.post("/api/v1/internal/rss/items", {
            "title": "Test Article",
            "content": "This is a test article",
            "feed_id": 123
        })

asyncio.run(main())

JWT Token Management

from firefeed_core import ServiceTokenManager

# Generate token for service
token_manager = ServiceTokenManager(
    secret_key="your-secret-key",
    issuer="firefeed-api"
)

token = token_manager.generate_service_token(
    service_id="firefeed-rss-parser",
    audience="firefeed-api",
    scopes=["rss:read", "rss:write"]
)

# Verify token
payload = token_manager.verify_token(token)
print(f"Token for service: {payload.sub}")

Exception Handling

from firefeed_core import APIException, NotFoundException

try:
    result = await client.get("/api/v1/internal/rss/feeds/999")
except NotFoundException as e:
    print(f"Feed not found: {e.message}")
except APIException as e:
    print(f"API error: {e.message}")

๐Ÿ” Authentication

FireFeed Core uses JWT tokens for service-to-service authentication. Each service needs:

  1. Service Token: JWT token with appropriate scopes
  2. Service ID: Unique identifier for the service
  3. Secret Key: Shared secret for token verification

Environment Configuration

Each service should have its own .env file:

# firefeed-rss-parser/.env
FIREFEED_API_URL=http://firefeed-api:8000
FIREFEED_API_TOKEN=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9...
FIREFEED_RSS_PARSER_SERVICE_ID=rss-parser

# firefeed-telegram-bot/.env
FIREFEED_API_URL=http://firefeed-api:8000
FIREFEED_API_TOKEN=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9...
FIREFEED_TELEGRAM_BOT_SERVICE_ID=telegram-bot

Token Scopes

Services can be granted specific scopes for different operations:

  • rss:read - Read RSS data
  • rss:write - Create/modify RSS data
  • users:read - Read user data
  • users:write - Modify user data
  • categories:read - Read categories
  • categories:write - Modify categories

๐Ÿ› ๏ธ Advanced Features

Circuit Breaker

Automatically prevents requests to failing services:

from firefeed_core import APIClient

client = APIClient(
    base_url="http://service:8000",
    token="token",
    service_id="my-service",
    circuit_breaker_failure_threshold=5,
    circuit_breaker_timeout=60
)

Retry Policies

Configurable retry with exponential backoff:

client = APIClient(
    base_url="http://service:8000",
    token="token",
    service_id="my-service",
    max_retries=3
)

Rate Limiting

Prevents API abuse:

client = APIClient(
    base_url="http://service:8000",
    token="token",
    service_id="my-service",
    rate_limit_requests=100,
    rate_limit_window=60
)

๐Ÿ“Š Monitoring

Each API client provides comprehensive statistics:

stats = client.get_stats()
print(f"Circuit breaker state: {stats['circuit_breaker']['state']}")
print(f"Rate limit usage: {stats['rate_limiter']['current_requests']}")

๐Ÿ—๏ธ Architecture

FireFeed Core follows these principles:

  1. API-First: All services communicate via HTTP APIs only
  2. Zero Direct Database Access: Services never access databases directly
  3. Token-Based Security: All inter-service communication is authenticated
  4. Fault Tolerance: Circuit breakers, retries, and rate limiting
  5. Consistent Error Handling: Standardized exception hierarchy

Service Communication Flow

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    JWT Token    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  firefeed-rss-parserโ”‚ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ†’ โ”‚   firefeed-api      โ”‚
โ”‚  (Dumb Service)     โ”‚                 โ”‚  (Smart Service)    โ”‚
โ”‚                     โ”‚ โ†โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ โ”‚                     โ”‚
โ”‚  - RSS Processing   โ”‚    HTTP API     โ”‚  - Database Access  โ”‚
โ”‚  - No DB Access     โ”‚                 โ”‚  - Business Logic   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜                 โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

๐Ÿงช Testing

# Install test dependencies
pip install -e ".[test]"

# Run tests
pytest

# Run with coverage
pytest --cov=firefeed_core

๐Ÿ“ Contributing

  1. Fork the repository
  2. Create a feature branch
  3. Make your changes
  4. Add tests
  5. Submit a pull request

๐Ÿ“„ License

MIT License - see LICENSE file for details.

๐Ÿ”— Related Projects


Note: This is a core library intended for use within the FireFeed microservices ecosystem.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

firefeed_core-1.0.5.tar.gz (110.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

firefeed_core-1.0.5-py3-none-any.whl (137.6 kB view details)

Uploaded Python 3

File details

Details for the file firefeed_core-1.0.5.tar.gz.

File metadata

  • Download URL: firefeed_core-1.0.5.tar.gz
  • Upload date:
  • Size: 110.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for firefeed_core-1.0.5.tar.gz
Algorithm Hash digest
SHA256 c2749b563544d21cc91f5bd64212b92d9537a09f3fbaea8a9e4919ef0f5598c7
MD5 34fc82623a6204e24fc9e0ce80901ca6
BLAKE2b-256 3fd28d97f04954a69e6541e485879afac57c0cbf58512f86723022bb54fa0377

See more details on using hashes here.

Provenance

The following attestation bundles were made for firefeed_core-1.0.5.tar.gz:

Publisher: release.yml on firefeed-net/firefeed-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file firefeed_core-1.0.5-py3-none-any.whl.

File metadata

  • Download URL: firefeed_core-1.0.5-py3-none-any.whl
  • Upload date:
  • Size: 137.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for firefeed_core-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 2afd9626dd3109d09ca04d122fce0b6a3b110582949b505f9f3dec082fde53d1
MD5 c328f6f20675413015fb3206ce097988
BLAKE2b-256 50faabb12e3cc1c3d9b2272f691a53e810e75e4aa517c2a856b6aa23f45e40d8

See more details on using hashes here.

Provenance

The following attestation bundles were made for firefeed_core-1.0.5-py3-none-any.whl:

Publisher: release.yml on firefeed-net/firefeed-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page