Skip to main content

jsonvice minifies JSON files by trimming floating point precision.

Project description

PyPI version Build Status License

About jsonvice

jsonvice is command line tool for minifying JSON with optimal precision truncation/rounding. In many applications floating point values in JSON can be very long (15 digits or more) but this level of accuracy isn't needed and takes up much space.

jsonvice allows the truncation of all the embedded floating point numbers (wherever they appear) to a specified number of digits.

It also removes unnecessary white space to minify JSON files.

sample_input.json

{
    "x" :   12.32,
    "y": 0.23482498323433,
    "z": "simple test",
    "a" : [ 1, 2, 3.23423434343 ]
}

now run jsonvice

jsonvice -i input.json -o output.json -p 4

ouput.json

{"x":12.32,"y":0.2348,"z":"simple test","a":[1,2,3.2342]}

More Examples

compactify json and reduce floating point precision to max of 5 digits by rounding sh

jsonvice -i sample_input.json -o output.json -p 5

compactify json and reduce floating point precision to max of 5 digits by rounding down

jsonvice -i myfile.json -o output.json -p 5 -q floor

jsonvice also allows stdin / stdout pipes to be used

cat simple_test.json | python3 path/to/jsonvice.py -i - -o - > output_test.json

jsonvice can also beautify (pretty print) json, while still performing precision truncation. Note this makes the file larger.

jsonvice -i myfile.json -o output.json -p 3 -b

Building and Source

All source is at jsonvice

jsonvice is built with Python using the Poetry packaging and build tool.

pip3 install poetry # if not installed.

poetry update poetry install poetry build

poetry run jsonvice ...parameters...

Example

poetry run jsonvice -i inputfile.json -o outputfile.json -p 4

Installing as stand alone commandline tool

pip can be used into install jsonvice as stand alone tool (note python 3.6 should or later specified)

pip install jsonvice

pipx install

pipx can be used to install a stand alone version of jsonvice as a command line tool. Note pipx is like pip or pip3 but installs programs with their own virtual environment.

pipx install jsonvice

or install from github repo

pipx install git+https://github.com/deftio/jsonvice

Now you can use jsonvice at the commandline without typing python3 like this example:

jsonvice -i inputfile.json -o - -b

Python version support

Python version 3.6 or higher is required to build jsonvice. If pipx is used for install isolation takes place automatically.

Testing

Both pytest and tox were used to build jsonvice. Testing can be performed at the command line via either tool:

poetry run pytest

or

tox

History & Motivation

json vice started as a script to compactify / minify some large machine learning model files which had large floating point numbers. By rounding to fixed number of sig digits and then testing the models against testsuites to see the effects of truncation.

At the time couldn't find a tool and whipped up small script (the original script is in /dev directory).

So jsonvice was built to learn / test practices around the python poetry and pipx tools, for use in other projects, but starting with a small example cli program that already worked.

License

jsonvice uses the BSD-2 open source license

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jsonvice-1.0.2.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

jsonvice-1.0.2-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file jsonvice-1.0.2.tar.gz.

File metadata

  • Download URL: jsonvice-1.0.2.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.9 Darwin/23.4.0

File hashes

Hashes for jsonvice-1.0.2.tar.gz
Algorithm Hash digest
SHA256 2e11cb98eba02919109b5c1ebdc566026f40ccb84719262442d85b3ba06a46ac
MD5 ac4f2bb15baaf4dd18161b2a2d56805d
BLAKE2b-256 c24b62d5bc1a46a0d446211b23203d05d8ebfd0653504105b0430a64aa9abad8

See more details on using hashes here.

File details

Details for the file jsonvice-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: jsonvice-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 6.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.11.9 Darwin/23.4.0

File hashes

Hashes for jsonvice-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 ac129a6d645fbf1ca734fd5589a13b6b9e87746a37728813fc0937f328d574da
MD5 34c0644a37050a3417e3f91dec3174e0
BLAKE2b-256 943278e40b111291157a9c68fa0686fea7ca0fd952bdfe860c7c2b7756f40a6e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page