jsonvice 0.1.2

jsonvice minifies JSON files by trimming floating point precision.

About jsonvice

jsonvice is small command line tool (cli) for minifying JSON but with optimal precision truncation/rounding. In many applications floating point values in JSON can be very long (15 digits) but this level of accuracy isn't needed and takes up much space.

jsonvice allows the truncation of all the embedded floating point numbers to a specified number of digits.

It also removes unencessary white space to help minify JSON files. However there are many tools that can minify JSON.

input.json

{
    "x" :   12.32,
    "y": 0.23482498323433,
    "z": "simple test",
    "a" : [ 1, 2, 3.23423434343 ]
}

run jsonvice

jsonvice -i input.json -o output.json -p 4

ouput.json

{"x":12.32,"y":0.2348,"z":"simple test","a":[1,2,3.2342]}

More Examples

compactify json and reduce floating point precision to max of 5 digits by rounding

jsonvice -i myfile.json -o output.json -p 5

compactify json and reduce floating point precision to max of 5 digits by rounding down

jsonvice -i myfile.json -o output.json -p 5 -q floor

jsonvice also allows stdin / stdout pipes to be used

cat simple_test.json | python3 path/to/jsonvice.py -i - -o - > output_test.json

jsonvice can also beautify (pretty print) json, while still performing precision truncation. Note this makes the file larger.

jsonvice -i myfile.json -o output.json -p 3 -b

Building and Source

All source is at jsonvice

jsonvice is built with Python using the Poetry packaging and build tool.

pip3 install poetry # if not installed.

poetry update poetry install poetry build

poetry run jsonvice ...parameters...

Example

poetry run jsonvice -i inputfile.json -o outputfile.json -p 4

Installing as stand alone commandline tool

pipx can be used to install an isolated version of jsonvice as a command line tool.

pipx install jsonvice

or install from github repo

pipx install git+https://github.com/deftio/jsonvice

Now you can use jsonvice at the commandline without typing python3 like this example:

jsonvice -i inputfile.json -o - -b

Python version support

Python version 3.6 or higher is required to build

Testing

poetry run pytest

or

tox

History & Motivation

json vice started as a script to compactify / minify some large machine learning model files which had large floating point numbers. By rounding to fixed number of sig digits and then testing the models against testsuites to see the effects of truncation.

At the time couldn't find a tool and whipped up small script (the original script is in /dev directory).

So jsonvice was built to learn / test practices around the python poetry and pipx tools, for use in other projects, but starting with a small example cli program that already worked.

License

jsonvice uses the BSD-2 open source license