Skip to main content

Manic tools for manipulating sets of tagged resources in AWS.

Project description

Tagmania

CI Status

PyPI Code style: black pre-commit GitHub Actions Conventional Commits semantic-release License


📚 Project Resources

📖 Current Documentation 🧪 Test report for last release

Overview

Tagmania provides command-line tools for managing AWS EC2 clusters through tag-based operations. It offers utilities for starting, stopping, and creating snapshots of clusters identified by their "Cluster" tag.

Key Requirements:

  • EC2 instances must have "Cluster" tag to identify cluster membership
  • Instance "Name" tags are used for targeted operations
  • AWS CLI profile configuration required for authentication

Installation

Quick Install

pip install tagmania

Version Management

For production environments, always pin to a specific version:

pip install tagmania==2.4.0

See Version Management for detailed guidance on version pinning and stability.

AWS Cost Warning

⚠️ Important: This tool operates on AWS infrastructure and can incur costs:

  • EBS snapshot storage charges apply for all created snapshots
  • Data transfer costs may apply when creating/restoring snapshots
  • Test infrastructure in template.yaml will create billable EC2 instances
  • Always clean up test resources after use to avoid ongoing charges

For testing, consider using AWS Free Tier eligible instance types and remember to delete snapshots when no longer needed.

Available Commands

  • cluster-start - Start all instances in a cluster
  • cluster-stop - Stop all instances in a cluster
  • cluster-snap - Create, restore, delete, and list snapshots

Quick Start

Starting and Stopping Clusters

# Start all instances in a cluster
cluster-start production-cluster

# Stop all instances in a cluster
cluster-stop production-cluster

# Use specific AWS profile
cluster-start --profile myprofile production-cluster

Creating Snapshots

# Create a snapshot backup of entire cluster
cluster-snap --backup production-cluster

# Create a named snapshot
cluster-snap --backup --name daily-backup production-cluster

Restoring from Snapshots

# Restore entire cluster from default snapshot
cluster-snap --restore production-cluster

# Restore from named snapshot
cluster-snap --restore --name daily-backup production-cluster

Advanced Features

Targeted Restore

Restore specific instances within a cluster using regex pattern matching against instance "Name" tags:

# Restore only web servers
cluster-snap --restore --target ".*-web-.*" production-cluster

# Restore specific instance
cluster-snap --restore --target "server-01" --name daily-backup production-cluster

Common Targeting Patterns:

  • ".*-web-.*" - All instances with "web" in the name
  • "server-[0-9]+" - Instances named server-1, server-2, etc.
  • "prod-api-.*" - All production API servers
  • "backup-db" - Specific instance named "backup-db"

Snapshot Management

# List all snapshots for a cluster
cluster-snap --list production-cluster

# List specific labeled snapshots
cluster-snap --list --name daily-backup production-cluster

# Delete specific snapshot set
cluster-snap --delete --name daily-backup production-cluster

# Delete all snapshots for cluster
cluster-snap --delete production-cluster

How It Works

Backup Process

  1. Stops all cluster instances
  2. Creates EBS snapshots of all attached volumes
  3. Tags snapshots with cluster and label information
  4. Instances remain stopped after backup (use cluster-start to restart)

Restore Process

  1. Stops all cluster instances (or targeted instances)
  2. Detaches and deletes current EBS volumes
  3. Creates new volumes from snapshots
  4. Attaches new volumes to instances
  5. Instances remain stopped after restore (use cluster-start to restart)

Targeted Restore Process

  1. Validates regex pattern
  2. Filters instances by Name tag matching pattern
  3. Displays matched instances for confirmation
  4. Performs restore only on matched instances
  5. Other instances in cluster remain unchanged

Safety Features

  • Confirmation Required: All destructive operations require "yes" confirmation
  • Cluster Isolation: Operations only affect instances with matching "Cluster" tag
  • Automation Tracking: Uses "SNAPSHOT_MANAGER" key to track managed resources
  • Regex Validation: Targeted operations validate regex patterns before execution
  • Item Limits: Maximum 150 items processed per operation for performance protection

Version Management and Stability

To ensure consistent and stable deployments, it is critical to pin Tagmania to specific versions rather than using floating version numbers.

Recommended Installation Methods

pip with version pinning:

pip install tagmania==2.4.0

Poetry (recommended for projects):

[tool.poetry.dependencies]
tagmania = "2.4.0"

Requirements.txt:

tagmania==2.4.0

Version Selection Strategy

Production Environments:

  • Always use exact version pinning (e.g., ==2.4.0)
  • Test new versions in development/staging before production deployment
  • Document version upgrade procedures and rollback plans
  • Monitor release notes for breaking changes

Development Environments:

  • Use compatible version ranges for feature development (e.g., ~=2.4.0)
  • Pin to exact versions when reproducing production issues
  • Update regularly to stay current with security patches

Checking Installed Version

pip show tagmania

Or within Python:

import tagmania
print(tagmania.__version__)

Upgrade Planning

# Create backup of current environment
pip freeze > requirements-backup.txt

# Upgrade to specific version
pip install tagmania==2.5.0

# Test functionality
cluster-snap --list test-cluster

# If issues occur, rollback
pip install tagmania==2.4.0

Contributing

We welcome contributions! Tagmania uses a fork-based development model to ensure code quality and maintain project integrity.

Please see our Contributing Guide for detailed instructions on:

  • Setting up your development environment
  • Creating and maintaining your fork
  • Submitting pull requests
  • Following our coding standards and commit conventions

Troubleshooting

  • No instances found: Verify "Cluster" tag exists and matches exactly
  • Invalid regex: Test regex patterns before using with targeted operations
  • Permission errors: Ensure AWS profile has EC2 and EBS permissions
  • Timeout issues: Large volumes may take time to snapshot/restore
  • Python compatibility: Requires Python 3.9 or higher

Support

License

This project is licensed under the terms specified in the LICENSE file.

Sponsor

If you find this project useful, please consider sponsoring its development.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tagmania-2.4.4.tar.gz (24.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tagmania-2.4.4-py3-none-any.whl (28.0 kB view details)

Uploaded Python 3

File details

Details for the file tagmania-2.4.4.tar.gz.

File metadata

  • Download URL: tagmania-2.4.4.tar.gz
  • Upload date:
  • Size: 24.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for tagmania-2.4.4.tar.gz
Algorithm Hash digest
SHA256 5eb6ec1ae9dcb2b46fc7a1bb36f0bd8f710a540ace510cd598e65afae5539bde
MD5 44bdb4bf56db9599826c809a5e6583c3
BLAKE2b-256 a1d03ca3aefc954a88288e895f5152abfafe12389b219db85e5c7c0557035edc

See more details on using hashes here.

Provenance

The following attestation bundles were made for tagmania-2.4.4.tar.gz:

Publisher: pipeline.yaml on svange/tagmania

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tagmania-2.4.4-py3-none-any.whl.

File metadata

  • Download URL: tagmania-2.4.4-py3-none-any.whl
  • Upload date:
  • Size: 28.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for tagmania-2.4.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4c9c4b0edb1a55cce4bcc2f489ad12dab375ce8816216ab572ad40f070e90601
MD5 cdbf95c10dd64e066c45dc49d96ce646
BLAKE2b-256 ce2ac32536fc690e9cdff9696485965d0abc7b6aba1754b1b8b108a74adacecd

See more details on using hashes here.

Provenance

The following attestation bundles were made for tagmania-2.4.4-py3-none-any.whl:

Publisher: pipeline.yaml on svange/tagmania

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page