spark-logicalplan-sql-restorer 0.1.0

Restore SQL from Apache Spark Catalyst LogicalPlan JSON

spark-logicalplan-sql-restorer

Restore SQL from Apache Spark Catalyst LogicalPlan JSON payloads.

Install

pip install spark-logicalplan-sql-restorer

Python API

from pathlib import Path
import json
from spark_logicalplan_sql_restorer import (
    restore_sql,
    restore_sql_from_json_file,
    restore_sql_from_json_string,
)

json_str = Path("test_json/001_00_setup_schema_01.json").read_text(encoding="utf-8")
sql1 = restore_sql_from_json_string(json_str)

payload = json.loads(json_str)
sql2 = restore_sql(payload)

sql3 = restore_sql_from_json_file(Path("test_json/001_00_setup_schema_01.json"))
print(sql1, sql2, sql3)

CLI

Restore one file:

logicalplan-sql-restorer test_json/001_00_setup_schema_01.json

Restore directory:

logicalplan-sql-restorer test_json --output restored_sql