jsonvice minifies JSON files by trimming floating point precision.
Project description
About jsonvice
jsonvice is command line tool for minifying JSON with optimal precision truncation/rounding. In many applications floating point values in JSON can be very long (15 digits or more) but this level of accuracy isn't needed and takes up much space.
jsonvice allows the truncation of all the embedded floating point numbers (wherever they appear) to a specified number of digits.
It also removes unnecessary white space to minify JSON files.
sample_input.json
{
"x" : 12.32,
"y": 0.23482498323433,
"z": "simple test",
"a" : [ 1, 2, 3.23423434343 ]
}
now run jsonvice
jsonvice -i input.json -o output.json -p 4
ouput.json
{"x":12.32,"y":0.2348,"z":"simple test","a":[1,2,3.2342]}
More Examples
compactify json and reduce floating point precision to max of 5 digits by rounding sh
jsonvice -i sample_input.json -o output.json -p 5
compactify json and reduce floating point precision to max of 5 digits by rounding down
jsonvice -i myfile.json -o output.json -p 5 -q floor
jsonvice also allows stdin / stdout pipes to be used
cat simple_test.json | python3 path/to/jsonvice.py -i - -o - > output_test.json
jsonvice can also beautify (pretty print) json, while still performing precision truncation. Note this makes the file larger.
jsonvice -i myfile.json -o output.json -p 3 -b
Building and Source
All source is at jsonvice
jsonvice is built with Python using the Poetry packaging and build tool.
pip3 install poetry # if not installed.
poetry update poetry install poetry build
poetry run jsonvice ...parameters...
Example
poetry run jsonvice -i inputfile.json -o outputfile.json -p 4
Installing as stand alone commandline tool
pip can be used into install jsonvice as stand alone tool (note python 3.6 should or later specified)
pip install jsonvice
pipx install
pipx can be used to install a stand alone version of jsonvice as a command line tool. Note pipx is like pip or pip3 but installs programs with their own virtual environment.
pipx install jsonvice
or install from github repo
pipx install git+https://github.com/deftio/jsonvice
Now you can use jsonvice at the commandline without typing python3 like this example:
jsonvice -i inputfile.json -o - -b
Python version support
Python version 3.6 or higher is required to build jsonvice. If pipx is used for install isolation takes place automatically.
Testing
Both pytest and tox were used to build jsonvice. Testing can be performed at the command line via either tool:
poetry run pytest
or
tox
History & Motivation
json vice started as a script to compactify / minify some large machine learning model files which had large floating point numbers. By rounding to fixed number of sig digits and then testing the models against testsuites to see the effects of truncation.
At the time couldn't find a tool and whipped up small script (the original script is in /dev directory).
So jsonvice was built to learn / test practices around the python poetry and pipx tools, for use in other projects, but starting with a small example cli program that already worked.
License
jsonvice uses the BSD-2 open source license
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.