jf 1.0.3

Python jsonl query engine

JF

JF, aka “jndex fingers” or more commonly “json filter pipeline”, is a jq-clone written in python. It supports evaluation of python one-liners, making it especially appealing for data scientists who are used to working with python.

Installing

pip install jf

Basic usage

Filter selected fields

$ cat samples.jsonl | jf '{id: x.id, subject: x.fields.subject}'
{"id": "87086895", "subject": "Swedish children stories"}
{"id": "87114792", "subject": "New Finnish storybooks"}
...

Features

supported formats:

• json (uncompressed, gzip, bz2)

• jsonl (uncompressed, gzip, bz2)

• yaml (uncompressed, gzip, bz2)

• csv and xlsx support if pandas and openpyxl is installed

• markdown table output support

• xlsx (excel)

• parquet

transformations:

• import and use python modules with –import

• import additional json for merging and joining using –import name=filename.json

• initialize transformations with –init

• access json dict as classes with dot-notation for attributes

• datetime and timedelta comparison

  • age() for timedelta between datetime and current time

• first(N), last(N), islice(start, stop, step)

  • head and tail alias for last and first

• firstnlast(N) (or headntail(N))

• import your own modules for more complex filtering and transformations

  • Support stateful classes for complex interactions between items

• sklearn toolbox for machine learning

• running restful service for the transformation pipeline