Skip to main content

Glue ETL without constipation

Project description

GLUEttalax

Glue ETL without constipation

usage: gluettalax <command> [parameters]

Commands:
 add_partition <db> <table> [--partition1=value...]
        Create a new Glue partition.
        Example: add_partition datalake usage --year=2019 --month=09

 del_partition <db> <table> [--partition1=value...]
        Delete a Glue partition.
        Example: del_partition datalake usage --year=2019 --month=09

 help [command]
        Display information about commands.

 list_crawlers [pattern] [--noheaders]
        List Glue crawlers.
        Example: list_crawlers 'test*' --noheaders

 list_jobs [pattern] [--noheaders]
        List Glue jobs.
        Example: list_jobs 'test*'

 list_partitions <db> <table> [--noheaders]
        List the partitions in a table.
        Example: list_partitions datalake usage

 list_runs [job_name] [--lines=num] [--noheaders]
        Print Glue jobs history.
        Example: list_runs my_batch_job --lines 10

 run_crawler <crawler_name> [--async] [--timeout=seconds]
        Run a crawler. If not async, wait until execution is finished.
        Example: run_crawler my_usage_crawler --async

 run_job <job_name> [--async] [--param1=value...]
        Run a Glue job. if not async, wait until execution is finished.
        Example: cmd_run_job --DATALAKE_BUCKET=test --THE_DATE=20191112 --HOUR=15

Command aliases:
 lsc -> list_crawlers
 lsj -> list_jobs
 runc -> run_crawler
 lsr -> list_runs
 runj -> run_job
 lsp -> list_partitions
 addp -> add_partition
 rmp -> del_partition


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for gluettalax, version 1.0.1
Filename, size File type Python version Upload date Hashes
Filename, size gluettalax-1.0.1-py2.py3-none-any.whl (9.2 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size gluettalax-1.0.1.tar.gz (8.5 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page