csv2athena_schema 0.1.1

A Python Script to build a athena create table from csv file

A Python Script to build a athena create table from csv file

Features

• TODO

Install & Setup

$ git clone https://github.com/yuokada/csv2athena_schema.git
$ pip3 install -r requirements.txt

Execute script

$ python3 scripts/csv2athena_schema.py \
--table-properties skip.header.line.count=1 has_encrypted_data=false \
--schema your_schema \
--location 's3://your_bucket/path_to_csv'
/path/to/your.csv

Requirements

• Python >= 3.5

License

MIT licensed. See the bundled LICENSE file for more details.

Link

• sloria/cookiecutter-docopt: A Python command-line script template that uses docopt for arguments parsing

• okfn/messytables: Tools for parsing messy tabular data. This is now superseded by https://github.com/frictionlessdata/tabulator-py

• pallets/jinja: The Jinja2 template engine

• Flake8: Your Tool For Style Guide Enforcement — flake8 3.7.2 documentation

Athena

• CREATE TABLE - Amazon Athena

• SerDe Reference - Amazon Athena

• Compression Formats - Amazon Athena