CSV CLI utility functions and packages in Python.
Project description
Command-fu with csv files
A set of command line interfaces and python modules for easily manipulating, transforming and dealing with csv files quickly and effectively.
CLI Usage
All csvputty commands start with csvputty, optionally any input/output files you wish to use, and then the command you wish to perform.
If you do not supply i/o files then csvputty will use stdin/stdout instead.
Example:
$ csvputty -i data.csv -o out.txt
markup
This command will take the selected columns of a CSV file, process each row through a format string, and return the collective output. For example:
$ csvputty -i data.csv -o rendered.html markup 0 1 3 template.html
This parses each row of data.csv using the content of template.html as a format string and saves to rendered.html.
In the above example, template.html could be the following:
<div class="row">
<div class="col-sm-4">{}</div>
<div class="col-sm-4">{}</div>
<div class="col-sm-4">{}</div>
</div>
or
<div class="row">
<div class="col-sm-4">{coconuts}</div>
<div class="col-sm-4">{cheese}</div>
<div class="col-sm-4">{sausages}</div>
</div>
If used with the -h --header flag the first row of the CSV is used to key the template.
However csvputty really becomes useful in the full context of the command line. Take the following example:
$ cat data1.csv data2.csv | csvputty -o rendered.html markup 0 1 template.html
This passes data1.csv and data2.csv through the same template and renders them together in a single file.
csvputty -i data.csv markup 0 1 -
This opens stdin allowing you to enter the template via command line and prints the results to stdout.
diff
Diff compares the input CSV against another CSV and outputs rows where selected columns fulfil the match condition.
$ cat subtract1.csv subtract2.csv | csvputty -i source.csv -o out.csv diff -sc 18 -
The above example returns rows from source.csv where column 18 is not found on column column 0 anywhere in subtract1.csv or subtract2.csv.
Package Usage
Importing csvputty into your project allows you to use some features unavailable via the command line interface.
For example:
import csvputty
def parse_row(row, row_index):
for idx, col in enumerate(row):
row[idx] = col.strip().replace("&", "&")
img_url = row[2].lower().replace(" ", "_").replace('&', 'and')
insta_url = row[4].replace("@", "")
return (img_url, row[1], insta_url, row[3], row[6])
input = open('data.csv', 'r')
out = open('rendered.html', 'w')
template = open('template.html', 'r')
csvputty.markup.generate(custom_row_parser=parse_row, csv_file=input
template_file=template, out_file=out)
The above example allows me to strip whitespace and replace ampersands with html entities on all columns, and perform further processing on other columns.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.