jsonSpark 0.0.1

This is a wrapper package for pyspark to process json files. It pythonifies the json pyspark object.

JsonSpark

This package is meant to give a python simplicity and feel to pyspark while handling json files.

It is very simple to use and doesn't need extra information if you are using python.

Steps:

• Import the package
  import jsonSpark
• Pass the pyspark json file object
  df = sql.read.json("filename", multiLine=True) # or get from S3 bucket
• Create a JsonSpark object.
  df = jsonSpark(df)
• See the schema if you wish.
  df.printSchema()

` df.show() ` * Use it as python dictionary
` df["key1"]["key2"]["key3"]["key4"].show() `

I will update the documentation and include a working example soon ....