Skip to main content

Engine-agnostic medallion facade on ETLantic (native authoring + SparkForge IR migrate).

Project description

Medallantic

Engine-agnostic medallion facade on ETLantic: native bronze/silver/gold authoring plus a SparkForge IR migrate path. Prefer medallantic over the deprecated etlantic-sparkforge redirect.

Medallantic owns bronze/silver/gold authoring conventions; ETLantic owns the portable contracts, graph, validation, planning, execution lifecycle, and plugin coordination underneath it. ETLantic core never gains medallion types.

The current 0.34 (M6) line includes native authoring, portable quality gates, importable transform execution, lifecycle/write semantics, PySpark and Delta differential coverage, SQLAlchemy relational parity, observability providers, durable run history, event consumers, and production conformance. Native PySpark Column and Moltres rules remain explicitly capability-gated.

Documentation:

Install

pip install medallantic

Native authoring

from medallantic import MedallionBuilder

defn = (
    MedallionBuilder("ecommerce", schema="demo")
    .bronze("orders", asset="bronze_orders")
    .silver("clean", source="orders", asset="silver_orders")
    .gold("kpis", source="clean", asset="gold_kpis", write_mode="merge")
    .build()
)

Migration bridges

Feed SparkForgePipelineSpec (JSON/YAML fixtures or hand-built dataclasses) via adapt_pipeline or medallantic.migrate.sparkforge. Existing live builders can use:

from medallantic.migrate.sparkforge import from_pipeline_builder
from medallantic.migrate.sql import from_sql_pipeline_builder

The adapted result supplies an ordinary ETLantic pipeline and profile; select execution plugins such as Profile.spark_engine="pyspark" separately. Production profiles must allowlist every trusted execution plugin.

Links

Documentation · Source · Issues

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

medallantic-0.34.0.tar.gz (50.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

medallantic-0.34.0-py3-none-any.whl (49.2 kB view details)

Uploaded Python 3

File details

Details for the file medallantic-0.34.0.tar.gz.

File metadata

  • Download URL: medallantic-0.34.0.tar.gz
  • Upload date:
  • Size: 50.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for medallantic-0.34.0.tar.gz
Algorithm Hash digest
SHA256 bad37deb6fbe9eb057a85f796b49d50e1fcc84ade306d73e6d78bfcb8b42c9f7
MD5 54aa88ba4cc822602623818e59b429ee
BLAKE2b-256 96a521f7d355e3e93563305fa9accfe6ef13c1ee0b0492364bd685d65517c00e

See more details on using hashes here.

File details

Details for the file medallantic-0.34.0-py3-none-any.whl.

File metadata

  • Download URL: medallantic-0.34.0-py3-none-any.whl
  • Upload date:
  • Size: 49.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for medallantic-0.34.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cd5c1da7d9dd0a3124c81c2de2e1445b9bb369e58fd5095408f8f107088d051f
MD5 d3228cbf84b219729b9622c1a02d1b06
BLAKE2b-256 48c658ebfac6ca6b8ab5dd92f062cfa6a4091ef222347ba232ed136fc909beb1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page