Skip to main content

AppSentinels CLI - Modular API Security Management Tool with Plugin Architecture

Project description

AppSentinels CLI (as-cli)

A modular, extensible command-line interface for AppSentinels API security management. Built with a lightweight core and powerful plugin architecture, this CLI provides essential functionality out-of-the-box while allowing users to install only the features they need through external plugins.

๐ŸŒŸ Architecture Overview

๐ŸŽฏ Lightweight Core

The AppSentinels CLI follows a core + plugins architecture:

  • Essential Commands Only: Authentication, profiles, plugin management, and configuration
  • Minimal Dependencies: Lean installation with just the basics
  • Fast Startup: Quick command execution without loading unused features
  • Stable Foundation: Core functionality that rarely changes

๐Ÿ”Œ Plugin Ecosystem

Extended functionality through installable plugins:

  • Production-Ready Plugins: Fully-featured external plugins (data ingest, monitoring, etc.)
  • Community Extensible: Framework for third-party and community plugins
  • Independent Updates: Plugins can be updated without changing core CLI
  • Optional Installation: Install only the features you need

๐ŸŒŸ Key Features

Core CLI Features

  • ๐Ÿ” OAuth 2.1 Authentication: Secure authentication with PKCE support
  • ๐Ÿข Profile Management: Multi-environment configuration with file-based storage
  • ๐Ÿ”Œ Plugin Management: Discover, install, and manage CLI extensions
  • ๐Ÿ”ง Auto-Configuration: Automatic setup of required files and directories
  • โš™๏ธ Flexible Configuration: Environment variables, config files, and CLI options
  • ๐Ÿ“ค Multiple Output Formats: Table, JSON, YAML, and raw output
  • ๐Ÿ’ฌ Interactive Mode: REPL-style interface for interactive usage

Available Plugins

  • ๐Ÿ‘‹ Hello World Plugin: Example plugin for development reference (included)
  • ๐Ÿ“Š Data Ingest Plugin: ClickHouse integration (available separately via GitHub)
  • ๐Ÿ”ฎ Future Plugins: Monitoring, alerting, reporting, and more

๐Ÿš€ Quick Start

Core CLI Installation

Install the lightweight core CLI with essential commands:

From Source

git clone https://github.com/appsentinels/as-cli.git
cd as-cli
pip install -e .

Global Installation (When Available)

pip install appsentinels-cli

What You Get Out-of-the-Box

The core CLI provides essential functionality:

# Available core commands after installation
as-cli auth login                    # OAuth authentication
as-cli profile list                  # Multi-environment profiles  
as-cli profile create prod          # Environment management
as-cli plugin list                  # Plugin discovery
as-cli init --show-only             # Configuration management

Automatic Configuration

Installation automatically creates the complete configuration structure in ~/.as-cli/:

~/.as-cli/
โ”œโ”€โ”€ config.yaml              # Main configuration file
โ”œโ”€โ”€ .env.template            # Environment variables template
โ”œโ”€โ”€ README.md                # Configuration documentation
โ””โ”€โ”€ profiles/                # Profile-specific configurations
    โ”œโ”€โ”€ default.yaml         # Default profile
    โ””โ”€โ”€ [profile-name].yaml  # Additional profiles

Initialization Features:

  1. ๐Ÿ—๏ธ Creates ~/.as-cli/ directory structure automatically
  2. ๐Ÿ“‹ Generates default profile with sensible defaults
  3. ๐Ÿ“ Creates environment variables template
  4. ๐Ÿ“– Provides comprehensive configuration documentation
  5. ๐Ÿ’ก Shows helpful getting started instructions

Manual Configuration Management

If you need to manually manage the configuration:

# Preview configuration structure
as-cli init --show-only

# Initialize or repair configuration
as-cli init

# Force complete re-initialization
as-cli init --force

# Check current configuration status
as-cli profile current

First-Time Setup

  1. Configure Environment Variables (Optional):

    cd ~/.as-cli
    cp .env.template .env
    # Edit .env with your specific values
    
  2. Authenticate:

    as-cli auth login
    
  3. Create Environment-Specific Profiles:

    as-cli profile create production --description "Production environment"
    as-cli profile create staging --description "Staging environment"
    
  4. Install Plugins (Choose what you need):

    # Install example hello plugin (for development reference)
    cd external/as-cli-hello && pip install -e .
    
    # Install external plugins as needed (e.g., data ingest plugin)
    # Follow individual plugin installation instructions
    
    # Verify installed plugins
    as-cli plugin list
    

Basic Usage Examples

# List available profiles
as-cli profile list

# Switch to production profile
as-cli profile switch production

# List available plugins
as-cli plugin list

# Get help
as-cli --help

Plugin Usage Examples

# Use hello plugin (example/development)
as-cli hello --name "World" --language es

# Use external plugins (install separately)
# Example: after installing data ingest plugin from its repository
# as-cli ingest records --file data.parquet --table-name api_logs
# as-cli ingest view --table-name api_logs --limit 10

๐Ÿ—๏ธ Modular Architecture

Philosophy

The AppSentinels CLI embraces a modular design philosophy:

  • ๐ŸŽฏ Core Focus: Essential functionality that every user needs
  • ๐Ÿ“ฆ Plugin Extensions: Advanced features available as separate packages
  • ๐Ÿš€ Performance: Fast startup by loading only required components
  • ๐Ÿ”ง Maintenance: Independent versioning and updates for core vs plugins

Core vs Plugins

Core CLI Commands

Commands that are always available after installing appsentinels-cli:

as-cli auth login              # OAuth 2.1 authentication
as-cli profile list            # Environment profile management  
as-cli profile create prod     # Create production profile
as-cli profile switch staging  # Switch between environments
as-cli plugin list            # Discover available plugins
as-cli plugin info ingest     # Get plugin information
as-cli init                   # Configuration management
as-cli --interactive          # Interactive mode

Plugin Commands

Commands that become available after installing specific plugins:

# After: pip install as-cli-ingest
as-cli ingest config --show                    # Database configuration
as-cli ingest records --file data.parquet      # Data import
as-cli ingest view --table-name logs          # Query data

# After: pip install as-cli-hello
as-cli hello --name "World"                   # Example plugin

# Future plugins
as-cli monitor status                         # Monitoring plugin
as-cli alert create --severity high          # Alerting plugin
as-cli report generate --type security       # Reporting plugin

Plugin Benefits

For Users:

  • ๐ŸŽฏ Install Only What You Need: Avoid bloating your environment
  • ๐Ÿš€ Faster Performance: Core CLI starts instantly
  • ๐Ÿ”ง Independent Updates: Update plugins without affecting core
  • ๐Ÿ’พ Reduced Dependencies: Minimal requirements for core functionality

For Developers:

  • ๐Ÿ”„ Independent Development: Plugins can evolve separately
  • ๐Ÿ“ฆ Easier Distribution: Publish plugins independently to PyPI
  • ๐Ÿงช Testing Isolation: Test plugin functionality in isolation
  • ๐Ÿค Community Contributions: Framework for third-party plugins

๐Ÿข Profile Management System

Overview

Profiles enable you to manage multiple environments (development, staging, production) with completely separate configurations stored as individual files in ~/.as-cli/profiles/.

Profile Architecture

~/.as-cli/
โ”œโ”€โ”€ config.yaml              # Current active profile only
โ””โ”€โ”€ profiles/                 # Individual profile files
    โ”œโ”€โ”€ default.yaml          # Default development profile
    โ”œโ”€โ”€ production.yaml       # Production environment
    โ”œโ”€โ”€ staging.yaml          # Staging environment
    โ””โ”€โ”€ custom-env.yaml       # Custom environments

Profile Commands

# Profile Management
as-cli profile list                    # List all profiles
as-cli profile list --detailed         # Detailed profile information
as-cli profile current                 # Show current active profile
as-cli profile show [profile-name]     # Show profile configuration

# Profile Switching
as-cli profile switch production       # Switch to production profile
as-cli profile switch staging --save   # Switch and persist change

# Profile Creation
as-cli profile create dev --description "Development environment"
as-cli profile create prod --copy-from staging --description "Production"
as-cli profile copy staging my-staging --description "My staging setup"

# Profile Deletion
as-cli profile delete old-env
as-cli profile delete test-env --save  # Delete and save changes

# Use specific profile for commands
as-cli --profile production ingest config --show
as-cli --profile staging ingest records --file data.parquet

Profile Configuration Structure

Each profile contains comprehensive environment-specific settings:

# profiles/production.yaml
name: production
description: Production environment
api:
  base_url: https://api.appsentinels.com
  timeout: 60
  max_retries: 5
  retry_delay: 2
auth:
  client_id: prod-client-id
  auth_url: https://auth.appsentinels.com
  token_url: https://auth.appsentinels.com/oauth/token
  redirect_uri: http://localhost:8080/callback
  scope: api:read api:write
database:
  db_type: clickhouse
  host: prod-cluster.internal
  port: 9000
  database: production_logs
  user: prod_user
  use_docker: false
  connection_timeout: 60
output:
  default_format: table
  max_width: 120
  truncate_long_values: true
  show_headers: true
  color_output: true
ingest:
  schema_file: prod-schema.json
  default_batch_size: 10000
  log_file: prod-ingestion.log
  overwrite_log: false
  enable_ip_extraction: true
  enable_telemetry: true
  continue_on_error: false
  supported_formats: [parquet, json, csv]

Multi-Environment Workflow

# Development workflow
as-cli profile create dev --description "Local development"
as-cli --profile dev ingest config --host localhost --port 9000
as-cli --profile dev ingest records --file test-data.parquet

# Staging validation
as-cli profile create staging --copy-from dev --description "Staging environment"
as-cli --profile staging ingest config --host staging-db.internal
as-cli --profile staging ingest records --file staging-data.parquet

# Production deployment
as-cli profile create prod --copy-from staging --description "Production environment"
as-cli --profile prod ingest config --host prod-cluster.internal --port 9000
as-cli --profile prod ingest records --file production-data.parquet

๐Ÿ”Œ Plugin Ecosystem

Overview

The AppSentinels CLI features a comprehensive plugin ecosystem that transforms the CLI from a monolithic tool into a modular platform. Plugins are distributed as standard Python packages and provide seamless integration with the core CLI.

Plugin Management

# List available plugins
as-cli plugin list                     # All discoverable plugins
as-cli plugin list --installed-only    # Only installed plugins

# Get plugin information
as-cli plugin info hello               # Detailed plugin information

# Load/unload plugins (runtime control)
as-cli plugin load hello              # Load plugin for current session
as-cli plugin unload hello            # Unload plugin from current session

Available Plugins

๐Ÿ“Š Data Ingest Plugin (External)

A comprehensive data ingestion solution for ClickHouse databases, available as a separate plugin.

Repository: github.com/vinay4appsentinels/as-cli-ingest (Private)

Features: ClickHouse integration, Parquet/JSON/CSV support, batch processing, telemetry tracking, and full profile system integration.

Refer to the Ingest Plugin Repository for installation and usage instructions.

๐Ÿ‘‹ Hello World Plugin (Development Example)

A simple plugin demonstrating CLI extension patterns.

Installation:

cd external/as-cli-hello
pip install -e .

Features:

  • โœ… Multi-language greetings
  • โœ… Command-line argument handling
  • โœ… Plugin lifecycle demonstration
  • โœ… Best practices example

Usage:

as-cli hello --name "World"                    # Basic greeting
as-cli hello --name "CLI" --language es --caps # Spanish, uppercase
as-cli hello --name "Plugin" --repeat 3        # Repeat greeting

Documentation: Hello Plugin README

๐Ÿ”ฎ Future Plugins

The plugin architecture supports unlimited extensibility:

  • ๐Ÿ“Š Monitoring Plugin: Real-time system monitoring and alerting
  • ๐Ÿ“ˆ Analytics Plugin: Security analytics and reporting
  • ๐Ÿ”” Notification Plugin: Multi-channel alert delivery
  • โ˜๏ธ Cloud Integration: AWS, GCP, Azure-specific tools
  • ๐Ÿ”’ Security Scanner: Vulnerability scanning and assessment
  • ๐Ÿ“‹ Compliance Plugin: Regulatory compliance reporting

Community Contributions Welcome!

Creating Custom Plugins

1. Plugin Structure

my-plugin/
โ”œโ”€โ”€ setup.py                          # Entry points configuration
โ”œโ”€โ”€ my_plugin/
โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”œโ”€โ”€ plugin.py                     # Plugin implementation
โ”‚   โ””โ”€โ”€ handler.py                    # Command handler
โ””โ”€โ”€ README.md

2. Plugin Implementation

my_plugin/plugin.py:

from as_cli.core.plugin_interface import BasePlugin, PluginMetadata
from .handler import MyHandler

class MyPlugin(BasePlugin):
    @property
    def metadata(self):
        return PluginMetadata(
            name="my-plugin",
            version="1.0.0",
            description="My custom plugin for AppSentinels CLI",
            author="Your Name",
            provides_commands=["my-command"]
        )
    
    def get_command_handlers(self):
        return {"my-command": MyHandler}
    
    def on_load(self):
        print("My plugin loaded!")
    
    def on_unload(self):
        print("My plugin unloaded!")

my_plugin/handler.py:

from as_cli.core.base_handler import BaseCommandHandler

class MyHandler(BaseCommandHandler):
    @property
    def command_name(self):
        return "my-command"
    
    @property
    def command_description(self):
        return "My custom command with profile awareness"
    
    def add_subcommands(self, parser):
        parser.add_argument("--option", help="Custom option")
        parser.add_argument("--env-specific", help="Environment-specific setting")
    
    async def handle_command(self, args):
        # Access current profile
        current_profile = self.config.current_profile
        
        return self.format_success_response(
            {
                "option": args.option,
                "profile": current_profile,
                "api_url": self.config.api.base_url
            },
            f"Command executed with profile '{current_profile}'"
        )

3. Entry Points Configuration

setup.py:

from setuptools import setup, find_packages

setup(
    name="my-cli-plugin",
    version="1.0.0",
    packages=find_packages(),
    entry_points={
        "as_cli.plugins": [
            "my-plugin = my_plugin.plugin:MyPlugin"
        ]
    },
    install_requires=["appsentinels-cli>=1.0.0"]
)

4. Installation and Usage

# Install your plugin
pip install -e .

# Verify plugin is discovered
as-cli plugin list

# Use your plugin with different profiles
as-cli my-command --option test
as-cli --profile production my-command --option prod-value

Plugin Development Best Practices

  • Profile Awareness: Always consider current profile settings
  • Error Handling: Implement comprehensive error handling
  • Documentation: Include detailed help and examples
  • Testing: Test with multiple profiles and environments
  • Versioning: Use semantic versioning
  • Dependencies: Minimize external dependencies

โš™๏ธ Configuration System

Configuration Hierarchy

The configuration system follows a clear hierarchy (highest priority first):

  1. Command-line arguments: --profile production
  2. Environment variables: AS_DB_PASSWORD=secret
  3. Profile configuration files: ~/.as-cli/profiles/[name].yaml
  4. Default values: Built-in sensible defaults

Environment Variables

Create ~/.as-cli/.env from the template:

# Copy template and edit
cd ~/.as-cli
cp .env.template .env

Available Environment Variables:

# API Configuration
AS_API_BASE_URL=https://api.appsentinels.com
AS_API_TIMEOUT=30
AS_API_MAX_RETRIES=3

# OAuth Configuration
AS_CLIENT_ID=your-client-id
AS_CLIENT_SECRET=your-client-secret
AS_AUTH_URL=https://auth.appsentinels.com
AS_TOKEN_URL=https://auth.appsentinels.com/oauth/token

# Database Configuration
AS_DB_URL=clickhouse://user:password@localhost:9000/database
AS_DB_USER=default
AS_DB_PASSWORD=your-database-password
AS_DB_HOST=localhost
AS_DB_PORT=9000

# Plugin Configuration (example for external plugins)
AS_PLUGIN_CONFIG_PATH=/path/to/plugin/config
AS_ENABLE_TELEMETRY=true

# Output Configuration
AS_OUTPUT_FORMAT=table
AS_OUTPUT_COLOR=true
AS_OUTPUT_MAX_WIDTH=120

# Global Settings
AS_VERBOSE=false
AS_DEBUG=false

Configuration Migration

The CLI automatically handles configuration migration:

  • Legacy single-file configs: Automatically migrated to separate profile files
  • Version updates: Seamless migration between configuration versions
  • Backup creation: Original configurations are preserved during migration

๐Ÿ–ฅ๏ธ Interactive Mode

# Enter interactive mode
as-cli --interactive

Interactive Session Example:

as-cli> profile list
as-cli> profile switch production
as-cli> ingest config --show
as-cli> plugin list
as-cli> hello --name "Interactive Mode"
as-cli> help
as-cli> exit

๐Ÿ“ค Output Formats

Table Format (Default)

as-cli profile list
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚ Name        โ”‚ Current โ”‚ Description             โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚ default     โ”‚ โœ“       โ”‚ Default configuration   โ”‚
โ”‚ production  โ”‚         โ”‚ Production environment  โ”‚
โ”‚ staging     โ”‚         โ”‚ Staging environment     โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

JSON Format

as-cli profile list --output-format json
{
  "success": true,
  "data": {
    "profiles": [
      {
        "Name": "default",
        "Current": "โœ“",
        "Description": "Default configuration"
      }
    ]
  }
}

YAML Format

as-cli profile list --output-format yaml
success: true
data:
  profiles:
    - Name: default
      Current: "โœ“"
      Description: Default configuration

๐Ÿ—๏ธ Architecture

Project Structure

as-cli/
โ”œโ”€โ”€ appsentinels-cli.py              # Main entry point
โ”œโ”€โ”€ setup.py                         # Installation configuration
โ”œโ”€โ”€ requirements.txt                 # Python dependencies
โ”œโ”€โ”€ src/                             # Source code
โ”‚   โ”œโ”€โ”€ config.py                    # Configuration management with profiles
โ”‚   โ”œโ”€โ”€ post_install.py              # Post-installation setup
โ”‚   โ”œโ”€โ”€ core/                        # Core infrastructure
โ”‚   โ”‚   โ”œโ”€โ”€ base_handler.py          # Base command handler
โ”‚   โ”‚   โ”œโ”€โ”€ cli_processor.py         # CLI processing and routing
โ”‚   โ”‚   โ”œโ”€โ”€ auth_context.py          # Authentication context
โ”‚   โ”‚   โ”œโ”€โ”€ plugin_manager.py        # Plugin discovery and lifecycle
โ”‚   โ”‚   โ””โ”€โ”€ plugin_interface.py      # Plugin base classes and validation
โ”‚   โ””โ”€โ”€ commands/                    # Core command handlers
โ”‚       โ”œโ”€โ”€ auth_handler.py          # Authentication commands
โ”‚       โ”œโ”€โ”€ profile_handler.py       # Profile management commands
โ”‚       โ”œโ”€โ”€ plugin_handler.py        # Plugin management commands
โ”‚       โ””โ”€โ”€ init_handler.py          # Configuration initialization
โ”œโ”€โ”€ external/                        # External plugins directory
โ”‚   โ”œโ”€โ”€ as-cli-hello/                # Example hello world plugin (included)
โ”‚   โ””โ”€โ”€ README.md                    # Plugin development guide
โ”œโ”€โ”€ examples/                        # Configuration examples
โ”‚   โ”œโ”€โ”€ profiles-config.yaml         # Multi-environment setup example
โ”‚   โ””โ”€โ”€ README-profiles.md           # Profile configuration guide
โ”œโ”€โ”€ docs/                            # Additional documentation
โ””โ”€โ”€ tests/                           # Test files

System Architecture

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚   CLI Entry     โ”‚โ”€โ”€โ”€โ–ถโ”‚  Profile System  โ”‚โ”€โ”€โ”€โ–ถโ”‚  Configuration  โ”‚
โ”‚   Point         โ”‚    โ”‚                  โ”‚    โ”‚   Management    โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
         โ”‚                       โ”‚                       โ”‚
         โ–ผ                       โ–ผ                       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚ Plugin System   โ”‚    โ”‚ Command Routing  โ”‚    โ”‚ Auto Initialize โ”‚
โ”‚ Discovery       โ”‚    โ”‚                  โ”‚    โ”‚                 โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
         โ”‚                       โ”‚                       โ”‚
         โ–ผ                       โ–ผ                       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  Command        โ”‚    โ”‚  Data Ingest     โ”‚    โ”‚  Authentication โ”‚
โ”‚  Handlers       โ”‚    โ”‚  System          โ”‚    โ”‚  & API Access   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Plugin Architecture

Plugin Discovery โ†’ Plugin Validation โ†’ Plugin Loading โ†’ Command Registration
      โ†“                     โ†“                 โ†“                   โ†“
Entry Points    โ†’    BasePlugin    โ†’    Lifecycle    โ†’    CLI Integration
                     Validation         Hooks

Profile System Flow

Installation โ†’ Auto Initialize โ†’ Profile Loading โ†’ Profile Switching โ†’ Command Execution
      โ†“              โ†“               โ†“                โ†“                     โ†“
Setup Files โ†’ Create Defaults โ†’ Load Active โ†’ Switch Context โ†’ Profile-Aware Commands

๐Ÿงช Development

Setting up Development Environment

Core CLI Development

# Clone and setup core CLI
git clone https://github.com/appsentinels/as-cli.git
cd as-cli

# Create virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install core CLI in development mode
pip install -e .[dev]

# Verify core functionality
as-cli --help
as-cli profile list
as-cli plugin list        # Should show no plugins initially

Plugin Development Setup

# Install example plugin for development (editable mode)
cd external/as-cli-hello && pip install -e . && cd ../..

# Install ingest plugin (private repository)
git clone https://github.com/vinay4appsentinels/as-cli-ingest.git
cd as-cli-ingest && pip install -e . && cd ../..

# Verify plugin installation
as-cli plugin list        # Should show installed plugins
as-cli hello --help       # Test hello plugin
as-cli ingest --help      # Test ingest plugin

๐Ÿ› ๏ธ Development Mode Workflow

Development mode allows rapid iteration on plugin functionality:

# 1. Install plugin in editable mode (one time)
cd external/my-plugin
pip install -e .

# 2. Make code changes
vim my_plugin/handler.py

# 3. Test immediately (no reinstall needed)
as-cli my-command --help
as-cli my-command --test-option

# 4. Test with profiles
as-cli --profile dev my-command
as-cli --profile prod my-command

# 5. Debug plugin
as-cli plugin info my-plugin
as-cli plugin load my-plugin

Key Benefits:

  • ๐Ÿ”„ Instant Updates: Changes are immediately available
  • ๐Ÿšซ No Reinstall: Skip reinstallation after modifications
  • ๐Ÿ” Full Debugging: Use logging and Python debugger
  • ๐Ÿข Profile Testing: Test with different environments

Creating New Plugins

# Use existing plugin as template
cp -r external/as-cli-hello external/my-plugin
cd external/my-plugin

# Update plugin configuration
# 1. Edit setup.py: Change name and entry points
# 2. Edit plugin.py: Update metadata (name, commands)  
# 3. Edit handler.py: Implement command logic

# Install in development mode
pip install -e .

# Start developing with live testing
as-cli plugin list                # Verify discovery
as-cli my-command --help         # Test immediately

Testing with Multiple Profiles

# Create test environments
as-cli profile create test-dev --description "Test development"
as-cli profile create test-prod --description "Test production"

# Test profile switching
as-cli --profile test-dev ingest config --host localhost
as-cli --profile test-prod ingest config --host prod-server

# Verify isolation
as-cli profile show test-dev
as-cli profile show test-prod

Running Tests

# Install test dependencies
pip install -e .[dev]

# Run tests
pytest tests/

# Run with coverage
pytest --cov=src tests/

# Run specific test
pytest tests/test_profiles.py -v

Code Quality

# Code formatting
black src/
black external/

# Linting
flake8 src/
flake8 external/

# Type checking
mypy src/

๐Ÿ“š Examples

Complete Multi-Environment Setup

Step 1: Core CLI Setup

# Install and authenticate
pip install appsentinels-cli
as-cli auth login

# Set up environment profiles
as-cli profile create dev --description "Development environment"
as-cli profile create staging --description "Staging environment"  
as-cli profile create prod --description "Production environment"

# Verify core setup
as-cli profile list

Step 2: Install Required Plugins

# Install data ingest plugin for database operations
cd external/as-cli-ingest && pip install -e .

# Verify plugin availability
as-cli plugin list
as-cli plugin info ingest

Step 3: Configure Each Environment

# Development environment
as-cli --profile dev ingest config --host localhost --port 9000 --database dev_logs --save

# Staging environment
as-cli --profile staging ingest config --host staging-db.internal --database staging_logs --save

# Production environment
as-cli --profile prod ingest config --host prod-cluster.internal --database prod_logs --use-docker false --save

Step 4: Environment-Specific Workflows

# Development workflow
as-cli --profile dev ingest records --file dev-data.parquet --table-name test_logs

# Staging validation
as-cli --profile staging ingest records --file staging-data.parquet --table-name api_logs
as-cli --profile staging ingest view --table-name api_logs --limit 5

# Production deployment
as-cli --profile prod ingest records --file production-data.parquet --table-name api_logs --telemetry

Plugin Development Workflow

# 1. Create monitoring plugin
mkdir external/as-cli-monitoring
cd external/as-cli-monitoring

# 2. Implement plugin (see plugin development section)
# 3. Install and test
pip install -e .
as-cli plugin list
as-cli monitoring --help

# 4. Test with different profiles
as-cli --profile dev monitoring status
as-cli --profile prod monitoring alerts --severity high

Advanced Data Ingest Pipeline

# 1. Configure production database
as-cli --profile prod ingest config --db-url clickhouse://user:pass@prod-cluster:9000/logs

# 2. Generate schema from sample data
as-cli --profile prod ingest records --file sample.parquet --generate-schema prod-schema.json

# 3. Create table with schema
as-cli --profile prod ingest records --file sample.parquet --table-name api_logs --create-table --schema-file prod-schema.json

# 4. Bulk import with monitoring
as-cli --profile prod ingest records --dir /data/logs --table-name api_logs --batch-size 10000 --telemetry

# 5. Verify and query data
as-cli --profile prod ingest view --table-name api_logs --limit 10
as-cli --profile prod ingest view --table-name api_logs --where "status_code >= 400" --order-by "timestamp DESC"

๐Ÿค Contributing

Plugin Contributions

  1. Develop your plugin following the plugin development guidelines
  2. Test thoroughly with multiple profiles and environments
  3. Include comprehensive documentation and examples
  4. Submit as separate repository with proper entry points
  5. Add to community plugin registry

Core Contributions

  1. Fork the repository
  2. Create feature branch: git checkout -b feature/amazing-feature
  3. Test with multiple profiles: Ensure profile compatibility
  4. Update documentation: Include profile-aware examples
  5. Commit changes: git commit -m 'Add amazing feature'
  6. Push to branch: git push origin feature/amazing-feature
  7. Open Pull Request

Development Guidelines

  • Profile Awareness: All features should work with multiple profiles
  • Backward Compatibility: Maintain compatibility with existing configurations
  • Auto-Initialization: Features should work with automatic setup
  • Documentation: Update both README and inline documentation
  • Testing: Include tests for both single and multi-profile scenarios

๐Ÿ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.

๐Ÿ“ž Support

๐Ÿ“‹ Changelog

v2.2.0 (Current) - Modular Architecture Release

๐Ÿ—๏ธ Complete Architectural Overhaul

  • Lightweight Core CLI: Essential commands only (auth, profile, plugin, init)
  • Plugin-Based Extensions: Advanced features moved to external plugins
  • Modular Installation: Install only the features you need
  • Performance Optimization: Faster startup with reduced dependencies

๐Ÿ”ง Auto-Configuration System

  • Automatic initialization on first run or installation
  • Template file generation (.env.template, README.md)
  • Manual initialization command (as-cli init)
  • Configuration repair and validation
  • Smart first-run detection with helpful guidance

๐Ÿข Enhanced Profile Management

  • File-based profile storage in ~/.as-cli/profiles/
  • Automatic legacy migration from single-file configs
  • Profile isolation with individual configuration files
  • Enhanced profile commands with detailed information
  • Backup and restore capabilities

๐Ÿ“ฆ Production-Ready Plugin Ecosystem

  • as-cli-ingest: Comprehensive data ingest plugin with ClickHouse integration
    • Database configuration and connection management
    • Parquet, JSON, CSV file import with telemetry
    • Schema generation and table creation
    • Data viewing and querying capabilities
  • as-cli-hello: Development example plugin with best practices
  • Plugin marketplace framework: Ready for community contributions
  • Independent versioning: Plugins can be updated separately from core

๐Ÿ”Œ Advanced Plugin System

  • Enhanced plugin discovery via Python entry points
  • Lifecycle management with load/unload commands
  • Plugin metadata and validation system
  • Profile integration: Plugins fully compatible with multi-environment profiles
  • Error isolation: Plugin failures don't affect core CLI functionality

v2.0.0 (Previous)

๐Ÿ”Œ Plugin System

  • Dynamic plugin loading via entry points
  • Plugin management commands (plugin list, plugin info, etc.)
  • Example hello world plugin with multilingual support
  • Plugin validation and lifecycle management
  • Community-extensible architecture

๐Ÿข Profile Management

  • Multi-environment configuration profiles
  • Profile switching with --profile parameter
  • Profile management commands (profile create, profile switch, etc.)
  • Backward compatibility with existing configurations
  • Environment-specific settings isolation

๐Ÿ“Š External Plugin System

  • Modular plugin architecture with external data ingest capabilities
  • Plugin lifecycle management and discovery
  • Independent plugin development and distribution
  • Community-extensible framework for third-party plugins

v1.0.0 (Initial)

  • OAuth 2.1 authentication with PKCE
  • Basic API management commands
  • Data ingest commands with ClickHouse support
  • Interactive mode
  • Multiple output formats
  • Basic configuration system

๐ŸŽฏ Roadmap

Immediate (v2.3)

  • ๐Ÿช Plugin Marketplace: PyPI-based plugin discovery and installation
  • ๐Ÿ“Š Monitoring Plugin: Real-time system monitoring and alerting capabilities
  • ๐Ÿ”’ Security Scanner Plugin: Vulnerability assessment and security analysis
  • ๐Ÿ“ˆ Analytics Plugin: Security analytics and reporting dashboard

Short-term (v2.4-2.5)

  • โ˜๏ธ Cloud Integration Plugins: AWS, GCP, Azure-specific tooling
  • ๐Ÿ”” Notification Plugin: Multi-channel alert delivery (Slack, email, webhooks)
  • ๐Ÿ“‹ Compliance Plugin: Regulatory compliance reporting and automation
  • ๐ŸŽ›๏ธ Web UI Plugin: Optional web-based management interface

Medium-term (v3.0)

  • ๐Ÿข Enterprise Plugin Suite: Role-based access control, audit logging, team management
  • ๐Ÿ”„ Configuration Sync: Profile synchronization across machines and teams
  • ๐Ÿง  AI-Powered Insights: Intelligent recommendations and automated responses
  • ๐Ÿ“ฑ Mobile Plugin: Mobile-friendly monitoring and management

Long-term Vision

  • ๐ŸŒ Plugin Ecosystem Marketplace: Community-driven plugin repository
  • ๐Ÿ”’ Enhanced Security Framework: Plugin sandboxing and permission system
  • ๐Ÿš€ Performance Engine: Advanced caching and optimization framework
  • ๐Ÿค– Automation Platform: Full workflow automation and orchestration

Community Goals

  • ๐Ÿ‘ฅ Open Source Plugins: Encourage community plugin development
  • ๐Ÿ“š Plugin Development Kit: Comprehensive SDK and documentation
  • ๐ŸŽ“ Educational Resources: Tutorials, workshops, and certification programs
  • ๐Ÿค Partnership Program: Integration with security and DevOps tool vendors

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

appsentinels_cli-2.2.3.tar.gz (63.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

appsentinels_cli-2.2.3-py3-none-any.whl (35.1 kB view details)

Uploaded Python 3

File details

Details for the file appsentinels_cli-2.2.3.tar.gz.

File metadata

  • Download URL: appsentinels_cli-2.2.3.tar.gz
  • Upload date:
  • Size: 63.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.10.12

File hashes

Hashes for appsentinels_cli-2.2.3.tar.gz
Algorithm Hash digest
SHA256 1321137c79700a4b388078ff68d5c4cbbc1025ffcf1e326d407adc26122a37b1
MD5 9e12815d10d9753939d90fe4ef3a13d4
BLAKE2b-256 6c7efca4120612262e266508111d565daa9c363785837b13f5b18762d5a385ea

See more details on using hashes here.

File details

Details for the file appsentinels_cli-2.2.3-py3-none-any.whl.

File metadata

File hashes

Hashes for appsentinels_cli-2.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 cb8dac0a21477710750e4d40f0e134573c385331cdc759664f4ea58fb429f5b9
MD5 61038d0030f13f7981d981330c206ba7
BLAKE2b-256 8c864c9306f24070c4fabc54de87e732bd3d2aaec07bae708c82c481863b2b12

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page