spark-project-sql-restore 0.1.0

Restore SQL from Spark Project logical plan JSON

spark-project-sql-restore

Standalone Python package that restores SQL text from Spark logical plan JSON containing org.apache.spark.sql.catalyst.plans.logical.Project.

Install

pip install spark-project-sql-restore

Usage

from spark_project_sql_restore import project_json_to_sql

plan_json = """
{
  "class": "org.apache.spark.sql.catalyst.plans.logical.Project",
  "projectList": [
    {
      "class": "org.apache.spark.sql.catalyst.expressions.Alias",
      "name": "a",
      "child": {
        "class": "org.apache.spark.sql.catalyst.expressions.Literal",
        "value": 1,
        "dataType": "integer"
      }
    }
  ],
  "child": {"class": "org.apache.spark.sql.catalyst.plans.logical.OneRowRelation"}
}
"""

sql = project_json_to_sql(plan_json)
print(sql)
# SELECT 1 AS a FROM (SELECT 1)