csvputty 0.1.0

CSV CLI utility functions and packages in Python.

Command-fu with csv files

A set of command line interfaces and python modules for easily manipulating, transforming and dealing with csv files quickly and effectively.

CLI Usage

All csvputty commands start with csvputty, optionally any input/output files you wish to use, and then the command you wish to perform.

If you do not supply i/o files then csvputty will use stdin/stdout instead.

Example:

$ csvputty -i data.csv -o out.txt

markup

This command will take the selected columns of a CSV file, process each row through a format string, and return the collective output. For example:

$ csvputty -i data.csv -o rendered.html markup 0 1 3 template.html

This parses each row of data.csv using the content of template.html as a format string and saves to rendered.html.

In the above example, template.html could be the following:

<div class="row">
  <div class="col-sm-4">{}</div>
  <div class="col-sm-4">{}</div>
  <div class="col-sm-4">{}</div>
</div>

or

<div class="row">
  <div class="col-sm-4">{coconuts}</div>
  <div class="col-sm-4">{cheese}</div>
  <div class="col-sm-4">{sausages}</div>
</div>

If used with the -h --header flag the first row of the CSV is used to key the template.

However csvputty really becomes useful in the full context of the command line. Take the following example:

$ cat data1.csv data2.csv | csvputty -o rendered.html markup 0 1 template.html

This passes data1.csv and data2.csv through the same template and renders them together in a single file.

csvputty -i data.csv markup 0 1 -

This opens stdin allowing you to enter the template via command line and prints the results to stdout.

diff

Diff compares the input CSV against another CSV and outputs rows where selected columns fulfil the match condition.

$ cat subtract1.csv subtract2.csv | csvputty -i source.csv -o out.csv diff -sc 18 -

The above example returns rows from source.csv where column 18 is not found on column column 0 anywhere in subtract1.csv or subtract2.csv.

Package Usage

Importing csvputty into your project allows you to use some features unavailable via the command line interface.

For example:

import csvputty


def parse_row(row, row_index):
    for idx, col in enumerate(row):
        row[idx] = col.strip().replace("&", "&")
    img_url = row[2].lower().replace(" ", "_").replace('&', 'and')
    insta_url = row[4].replace("@", "")

    return (img_url, row[1], insta_url, row[3], row[6])


input = open('data.csv', 'r')
out = open('rendered.html', 'w')
template = open('template.html', 'r')

csvputty.markup.generate(custom_row_parser=parse_row, csv_file=input
                         template_file=template, out_file=out)

The above example allows me to strip whitespace and replace ampersands with html entities on all columns, and perform further processing on other columns.