aws-glue-availability

AWS Glue provides disaster / recovery through Glue ETL retry mechanism testing for the successful connector starting with the first referenced working to the last incrementally until it finds a successful connection. To ensure a certain level of high availability (all be it not in the strictest of senses) multiple connectors need to be associated across different Availability Zones.

This tool is to aid in viewing the placement of Glue Jobs through their associated Connectors Subnet information, to provide a visual aid in understanding the distribution of Glue jobs across the VPCs / Subnets within your platform.

Running

This tool is currently containing a Python interface.

#install library from PyPi
pip install awsglueavailability

#run application
#ensure AWS Credentials are setup
python -m awsglueavailability

Permissions

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "AwsIamMapper",
      "Action": [
        "glue:ListJobs",
        "glue:GetConnection",
        "vpc:DescribeSubnets"
      ],
      "Effect": "Allow",
      "Resource": "*"
    }
  ]
}

Example Output

An output is generated

References

• Glue Failover behaviour
• Diagrams library