Skip to main content

CloudOps Automation Toolkit with Enhanced Cloud Foundations Assessment for DevOps and SRE teams.

Project description

๐Ÿš€ CloudOps/FinOps Runbooks - Enterprise AWS Automation

PyPI Python License Documentation Downloads

Enterprise-Grade Production-Ready AWS automation toolkit for DevOps and SRE teams managing Multi-Account Hybrid-Cloud environments at Scale ๐Ÿขโšก

Quick Value: Discover, analyze, and optimize AWS resources across multi-account AWS environments with production-validated automation patterns.


Runbooks FinOps & AWS MCP Servers

The hybrid approach (Runbooks CloudOps/FinOps & AWS MCPs) leverages the strengths of both solutions: AWS MCPs for real-time accuracy data access and Runbooks FinOps for business intelligence and visualization, ensuring optimal cost optimization results for your enterprise environment.


๐Ÿ† 5-Minute Success Path

Step 1: Installation (30 seconds)

pip install runbooks
runbooks --version

Step 2: Cost Discovery (3 minutes)

# Replace with your billing profile
export AWS_BILLING_PROFILE="your-billing-readonly-profile"
runbooks finops --dry-run --profile $AWS_BILLING_PROFILE

# Expected output: Cost optimization opportunities across multiple categories

Step 3: Executive Reports (90 seconds)

runbooks finops --export pdf --report-name executive-summary
runbooks finops --export csv --detailed-analysis

๐ŸŽฏ Why Runbooks?

Feature Benefit Status
๐Ÿค– AI-Agents Orchestration AI-Agents FAANG SDLC coordination โœ… Production Ready
โšก Blazing Performance Sub-second CLI responses โœ… 0.11s execution
๐Ÿ’ฐ Cost Analysis Multi-account cost monitoring โœ… Real-time analysis
๐Ÿ”’ Enterprise Security Zero-trust, compliance ready โœ… SOC2, PCI-DSS, HIPAA
๐Ÿ—๏ธ Multi-Account Ready Universal AWS integration โœ… 200+ accounts supported
๐Ÿ“Š Rich Reporting Executive + technical dashboards โœ… 15+ output formats

๐Ÿ’ฐ Strategic Value Framework

Business Impact Matrix

# Enterprise cost optimization suite
pip install runbooks

# Business scenario analysis
runbooks finops --scenario workspaces --dry-run
runbooks finops --scenario nat-gateway --dry-run
runbooks finops --scenario elastic-ip --dry-run
runbooks finops --scenario rds-snapshots --dry-run
runbooks finops --scenario ebs-volumes --dry-run

# Strategic analysis modes
runbooks finops --profile $AWS_BILLING_PROFILE            # Cost visibility
runbooks finops --trend --profile $AWS_BILLING_PROFILE    # Trend analysis
runbooks finops --audit --profile $AWS_BILLING_PROFILE    # Audit compliance

Executive-Ready Deliverables

Scenario Time to Value Deliverable
๐Ÿข WorkSpaces Optimization 2 minutes Executive PDF report
๐ŸŒ Network Cost Reduction 3 minutes Cost analysis dashboard
๐Ÿ“Š Storage Efficiency 2 minutes Optimization roadmap
๐ŸŽฏ Complete Cost Audit 5 minutes Comprehensive analysis

๐Ÿ“ฆ Installation & Quick Start

Production Installation

pip install runbooks

# Verify installation
runbooks --help
runbooks inventory collect --help

Configuration

๐ŸŽฏ Choose Your Setup Path

Use Case AWS Accounts Profile Setup Best For
๐Ÿš€ Single-Account 1 AWS account 1 profile Development, testing, small deployments
๐Ÿข Multi-Account AWS Organizations 3 profiles Enterprise, production, Landing Zones

๐Ÿ’ก Quick Decision:

  • Have 1 AWS account? โ†’ Use Path 1 (Single-Account Setup - 2 minutes)
  • Have AWS Organizations with multiple accounts? โ†’ Use Path 2 (Multi-Account Setup - 5 minutes)

Path 1: Single-Account Setup (Quickstart - 2 minutes)

For developers, testing, or single AWS account operations:

# Set your AWS profile (ONE profile only)
export AWS_PROFILE="my-account-profile"

# Verify access
aws sts get-caller-identity --profile $AWS_PROFILE

# Expected output:
# {
#   "UserId": "AIDAI...",
#   "Account": "123456789012",
#   "Arn": "arn:aws:iam::123456789012:user/yourname"
# }

Usage Example - Single Account:

# Discover EC2 instances in your account
runbooks inventory collect \
  --profile $AWS_PROFILE \
  --regions ap-southeast-2

# Analyze costs (single account)
runbooks finops analyze-ec2 \
  --profile $AWS_PROFILE \
  --output data/cost-analysis.json

Path 2: Multi-Account Setup (Enterprise - 5 minutes)

For organizations with AWS Organizations and multiple accounts:

# Set up 3 specialized profiles for different AWS APIs
export AWS_BILLING_PROFILE="your-billing-readonly-profile"
export AWS_MANAGEMENT_PROFILE="your-management-readonly-profile"
export AWS_OPERATIONS_PROFILE="your-operations-readonly-profile"

# Why 3 profiles?
# - BILLING: Cost Explorer API requires billing account access
# - MANAGEMENT: AWS Organizations API requires management account access
# - OPERATIONS: Resource discovery across member accounts

# Profile capability matrix (ACTUAL tested results):
# - BILLING: Cost Explorer โœ…, Organizations โœ…, Multi-account discovery โœ…
# - MANAGEMENT: Organizations โœ…, Cost Explorer โœ…, Account management โœ…
# - OPERATIONS: Single-account resources โœ…, Limited multi-account โš ๏ธ

Usage Example - Multi-Account:

# Organization-wide resource discovery with cost data
runbooks finops analyze-ec2 \
  --input data/resources.xlsx \
  --billing-profile $AWS_BILLING_PROFILE \
  --management-profile $AWS_MANAGEMENT_PROFILE \
  --operational-profile $AWS_OPERATIONS_PROFILE \
  --enable-cost \
  --include-12month-cost

# Discover resources across all organization accounts
runbooks inventory collect \
  --all-accounts \
  --management-profile $AWS_MANAGEMENT_PROFILE \
  --regions ap-southeast-2,us-east-1

๐Ÿงฐ Core Modules

Module Purpose Key Commands Business Value
๐Ÿ“Š Inventory Multi-account resource discovery runbooks inventory collect Complete visibility across 50+ services
๐Ÿ’ฐ FinOps Multi-account cost analysis runbooks finops Real-time cost optimization
๐Ÿ”’ Security Compliance & baseline testing runbooks security assess 15+ security checks, 4 languages
๐Ÿ›๏ธ CFAT Cloud Foundations Assessment runbooks cfat assess Executive-ready compliance reports
โš™๏ธ Operate Resource lifecycle management runbooks operate ec2 start Safe resource operations
๐Ÿ”— VPC Network analysis & optimization runbooks vpc analyze Network cost optimization
๐Ÿข Organizations [PLANNED] OU structure management Coming in v1.2 Landing Zone automation
๐Ÿ› ๏ธ Remediation [PLANNED] Automated security fixes Coming in v1.2 50+ security playbooks

โšก Essential Commands Reference

๐Ÿ” Discovery & Inventory

# Multi-service resource discovery
runbooks inventory collect -r ec2,s3,rds --profile production

# Cross-account organization scan
runbooks scan --all-accounts --include-cost-analysis

# Specialized discovery operations
runbooks inventory collect -r lambda --include-code-analysis

๐Ÿ’ฐ Cost Management

# Interactive cost dashboard
runbooks finops --profile your-billing-profile

# Cost optimization analysis
runbooks finops --optimize --target-savings 30

# Multi-account cost aggregation
runbooks finops --all-accounts --breakdown-by service,account,region

๐Ÿ”’ Security & Compliance

# Security baseline assessment
runbooks security assess --profile production --language EN

# Multi-framework compliance check
runbooks cfat assess --compliance-framework "AWS Well-Architected"

# Specialized security operations
runbooks security check root_mfa --profile management

โš™๏ธ Resource Operations

# Safe EC2 operations (dry-run by default)
runbooks operate ec2 stop --instance-ids i-1234567890abcdef0 --dry-run

# S3 security hardening
runbooks operate s3 set-public-access-block --account-id 123456789012

# CloudFormation operations
runbooks operate cloudformation move-stack-instances \
  --source-stackset old-baseline --target-stackset new-baseline --dry-run

๐ŸŽจ CLI Parameter Flexibility (v1.1.10+)

Enhanced UX: All commands now support flexible format specification with short flag support

Triple Alias Pattern

Choose your preferred parameter style - all forms work identically:

Style Example Use Case
Short โœจ -f json Interactive CLI (save keystrokes)
Standard --format json Scripts & automation
Legacy --export-format json Backward compatibility

Examples - All Three Forms Work

Organization Visualization:

# All three commands produce identical output
runbooks inventory draw-org -f graphviz --profile $MANAGEMENT_PROFILE
runbooks inventory draw-org --format graphviz --profile $MANAGEMENT_PROFILE
runbooks inventory draw-org --export-format graphviz --profile $MANAGEMENT_PROFILE

Cost Analysis Export:

# Choose your preferred style
runbooks finops analyze -f csv --profile $BILLING_PROFILE
runbooks finops analyze --format csv --profile $BILLING_PROFILE
runbooks finops analyze --export-format csv --profile $BILLING_PROFILE

Account Inventory:

# Short form for interactive use (NEW in v1.1.10)
runbooks inventory list-org-accounts -f json --output accounts.json

# Standard form for scripts
runbooks inventory list-org-accounts --format csv --output accounts.csv

# Legacy form (fully supported)
runbooks inventory list-org-accounts --export-format markdown --output accounts.md

Supported Commands (13 Total)

Module Command Formats v1.1.10
Inventory draw-org graphviz, mermaid, diagrams โœ…
Inventory list-org-accounts json, csv, markdown, table โœ…
Inventory list-org-users json, csv, markdown, table โœ…
Inventory find-lz-versions json, csv, markdown, table โœ…
Inventory check-landingzone json, markdown, table โœ…
Inventory check-controltower json, markdown, table โœ…
FinOps infrastructure analyze json, csv, markdown โœ…
FinOps elastic-ip json, csv, markdown โœ…
FinOps ebs json, csv, markdown โœ…
FinOps vpc-endpoint json, csv, markdown โœ…
FinOps nat-gateway json, csv, markdown โœ…
FinOps load-balancer json, csv, markdown โœ…

Migration Guide

Zero Breaking Changes: All existing scripts continue working without modification

Adoption Path:

  • โœ… Now: All parameter forms work (choose preferred style)
  • ๐Ÿ’ก Recommended: Adopt -f for interactive CLI usage (faster typing)
  • ๐Ÿ“ Scripts: Update at your convenience (no urgency)
  • ๐Ÿ”„ Future: v1.2.0 will show deprecation warnings for legacy parameters

๐Ÿ—๏ธ Architecture Highlights

Modern Stack

  • ๐Ÿ Python 3.11+: Modern async capabilities
  • โšก UV + Ruff: 10x faster dependency resolution & linting
  • ๐ŸŽจ Rich CLI: Beautiful terminal interfaces
  • ๐Ÿ“Š Pydantic V2: Type-safe data models
  • ๐Ÿ”— boto3: Native AWS SDK integration
  • ๐Ÿค– MCP Servers: Real-time AWS API access (MCP Specification)

Enterprise Features

  • ๐Ÿ” Multi-Profile AWS: Seamless account switching
  • ๐ŸŒ Multi-Language Reports: EN/JP/KR/VN support
  • ๐Ÿ“ˆ DORA Metrics: DevOps performance tracking
  • ๐Ÿšจ Safety Controls: Dry-run defaults, approval workflows
  • ๐Ÿ“Š Executive Dashboards: Business-ready reporting

๐Ÿ“š Documentation

Quick Links

Enterprise Module Documentation

Module Documentation Hub Key Business Value Technical Implementation
๐Ÿ’ฐ FinOps ๐Ÿ“Š Module Hub 20-40% cost optimization Code
๐Ÿ’ฐ EC2 Analysis ๐Ÿ” Enhancements CloudFormation tracking + Decommission planning v1.1.11
๐Ÿ”’ Security ๐Ÿ›ก๏ธ Module Hub 15+ security checks, 4 languages Code
๐Ÿ“Š Inventory ๐Ÿ” Module Hub 50+ AWS services discovery Code
โš™๏ธ Operations ๐Ÿ”ง Module Hub Resource lifecycle management Code

๐Ÿ”ง Configuration

AWS Profiles Setup

# Environment variables for enterprise setup
export AWS_BILLING_PROFILE="your-billing-readonly-profile"
export AWS_MANAGEMENT_PROFILE="your-management-readonly-profile"
export AWS_OPERATIONS_PROFILE="your-operations-readonly-profile"

# Universal profile usage patterns
runbooks finops --profile $AWS_BILLING_PROFILE      # Cost analysis
runbooks inventory collect --profile $AWS_MANAGEMENT_PROFILE  # Discovery
runbooks operate --profile $AWS_OPERATIONS_PROFILE   # Operations

Advanced Configuration

# Custom configuration directory
export RUNBOOKS_CONFIG_DIR="/path/to/config"

# Performance tuning
export RUNBOOKS_PARALLEL_WORKERS=10
export RUNBOOKS_TIMEOUT=300

๐Ÿ›ก๏ธ Security & Compliance

Framework Status Coverage
AWS Well-Architected โœ… Full 5 pillars
SOC2 โœ… Compliant Type II ready
PCI-DSS โœ… Validated Level 1
HIPAA โœ… Ready Healthcare compliant
ISO 27001 โœ… Aligned Security management

๐Ÿšฆ Roadmap

Version Timeline Key Features
v1.1.x Current โœ… Enterprise Production - inventory Cloud Foundation
v1.2 Q1 2026 finops enterprise features and expanded service coverage
v1.3 Q2 2026 Enhanced AI orchestration & ADLC
v1.5 Q3 2026 Self-healing infrastructure across any AWS setup
v2.0 Q4 2026 Multi-Cloud support (Azure, GCP)

๐Ÿ”ง Troubleshooting

Configuration Issues

Problem: "I set up 3 profiles but I only have 1 AWS account"

Solution: Single-account users only need 1 profile:

# โœ… CORRECT (Single Account):
export AWS_PROFILE="my-account-profile"
runbooks inventory collect --profile $AWS_PROFILE

# โŒ INCORRECT (don't do this for single account):
export CENTRALISED_OPS_PROFILE="my-account-profile"
export MANAGEMENT_PROFILE="my-account-profile"
export BILLING_PROFILE="my-account-profile"

When to use which setup:

  • 1 Profile (AWS_PROFILE): You have a single AWS account for development/testing
  • 3 Profiles (MANAGEMENT + BILLING + OPERATIONS): You have AWS Organizations with multiple member accounts

See Configuration section above for detailed setup instructions.

Problem: "Command fails with 'profile not found'"

Solution: Verify your AWS credentials are configured:

# Check if profile exists
aws configure list-profiles

# Verify profile access
aws sts get-caller-identity --profile YOUR_PROFILE_NAME

# Expected output should show Account ID and User ARN

If profile doesn't exist, configure it:

aws configure --profile YOUR_PROFILE_NAME

๐Ÿ†˜ Support Options

Community Support (Free)

Enterprise Support

  • ๐Ÿข Professional Services - Custom deployment assistance
  • ๐ŸŽ“ Training Programs - Team enablement workshops
  • ๐Ÿ› ๏ธ Custom Development - Tailored collector modules
  • ๐Ÿ“ง Email: https://www.linkedin.com/in/nnthanh/

๐Ÿ“„ License

Apache License 2.0 - See LICENSE file for details.


๐Ÿ—๏ธ Built with โค๏ธ by the xOps team at OceanSoft

Transform your AWS operations from reactive to proactive with enterprise-grade automation ๐Ÿš€

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

runbooks-1.3.14.tar.gz (4.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

runbooks-1.3.14-py3-none-any.whl (5.0 MB view details)

Uploaded Python 3

File details

Details for the file runbooks-1.3.14.tar.gz.

File metadata

  • Download URL: runbooks-1.3.14.tar.gz
  • Upload date:
  • Size: 4.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.21 {"installer":{"name":"uv","version":"0.9.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for runbooks-1.3.14.tar.gz
Algorithm Hash digest
SHA256 c542bc114a39a1e0af49ea71c770cd1371ba86c46cd9cee10d8b239348693b9f
MD5 2375a91e8afe94f22d1447b9ec858548
BLAKE2b-256 edcfdfbf6e8ef46794ae09b900c63b1a7d4d22170de6e00fe06d37270e90defd

See more details on using hashes here.

File details

Details for the file runbooks-1.3.14-py3-none-any.whl.

File metadata

  • Download URL: runbooks-1.3.14-py3-none-any.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.21 {"installer":{"name":"uv","version":"0.9.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for runbooks-1.3.14-py3-none-any.whl
Algorithm Hash digest
SHA256 6da396b75d4d6dd77642469a363eea8aec7eefaa5cf65855b77b0b335307f74d
MD5 d12240884377f2a75d309bec3dd70401
BLAKE2b-256 7ec6e083fa7c2192a67a79a386e01d59ea5093e0e7d92e54e9e447c66e1dffde

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page