a build tool for data
make for your data.
An automation tool for data manipulation.
Inspired by Open Refine.
The general principles in Databuild are:
- Low entry barrier
- Easy to install
- Easy to grasp
Databuild can be useful for scenarios such as:
- Documenting data transformations in your infoviz project
- Automate data processing in a declarative way
$ pip install databuild
For more details, see the Extended Documentation.
$ data-build.py buildfile.json
buildfile.yaml contains a list of operations to be performed on data. Think of it as a script for a spreadsheet.
An example of build file could be:
- operation: sheets.import_data description: Importing data from csv file params: sheet: dataset1 format: csv filename: dataset1.csv skip_last_lines: 1 - operation: columns.add_column description: Calculate the gender ratio params: sheet: dataset1 name: Gender Ratio expression: language: python content: "return float(row['Totale Maschi']) / float(row['Totale Femmine'])" - operation: sheets.export_data description: save the data params: sheet: dataset1 format: csv filename: dataset2.csv
JSON buildfiles are also supported. databuild will guess the type based on the extension.
Licensed under BSD 3-clauses.
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.