4 projects
dbt-spark-on-k8s
Experimental invocation-scoped Spark on Kubernetes adapter for dbt Core
spark-on-k8s
A Python package to submit and manage Apache Spark applications on Kubernetes.
async-batcher
Async Python batching for bulk functions, database writes, messaging, and model inference.
airflow-duckdb
A package to run DuckDB queries from Apache Airflow