gluettalax 1.0.0

Glue ETL without constipation

GLUEttalax

Glue ETL without constipation

usage: gluettalax <command> [parameters]

Commands:
 add_partition <db> <table> [--partition1=value...]
        Create a new Glue partition.
        Example: add_partition datalake usage --year=2019 --month=09

 del_partition <db> <table> [--partition1=value...]
        Delete a Glue partition.
        Example: del_partition datalake usage --year=2019 --month=09

 help [command]
        Display information about commands.

 list_crawlers [pattern] [--noheaders]
        List Glue crawlers.
        Example: list_crawlers 'test*' --noheaders

 list_jobs [pattern] [--noheaders]
        List Glue jobs.
        Example: list_jobs 'test*'

 list_partitions <db> <table> [--noheaders]
        List the partitions in a table.
        Example: list_partitions datalake usage

 list_runs [job_name] [--lines=num] [--noheaders]
        Print Glue jobs history.
        Example: list_runs my_batch_job --lines 10

 run_crawler <crawler_name> [--async] [--timeout=seconds]
        Run a crawler. If not async, wait until execution is finished.
        Example: run_crawler my_usage_crawler --async

 run_job <job_name> [--async] [--param1=value...]
        Run a Glue job. if not async, wait until execution is finished.
        Example: cmd_run_job --DATALAKE_BUCKET=test --THE_DATE=20191112 --HOUR=15

Command aliases:
 lsc -> list_crawlers
 lsj -> list_jobs
 runc -> run_crawler
 lsr -> list_runs
 runj -> run_job
 lsp -> list_partitions
 addp -> add_partition
 rmp -> del_partition