3 projects
flatten-spark-dataframe
Databricks PySpark module to flatten nested spark dataframes, basically struct and array of struct till the specified level
sql-metadata-lineage
Package to get SQL query metadata(first level lineage), column -> database.table.actual_column mapping along with table alias mapping(alias -> database.table)
xml-to-df
Package to convert xml to Pandas dataframe (flattens each and every xml element to dataframe column)