Skip to main content

Seamless integration between Dagster and SQLMesh for modern data engineering workflows

Project description

dg-sqlmesh

PyPI version Current Version Tests Documentation License Python

A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.

🚀 Quick Start

# Install the package
pip install dg-sqlmesh

# Or install from source
pip install -e .

📚 Documentation

📖 Full Documentation →

Our comprehensive documentation includes:

  • Getting Started - Installation and setup guides
  • User Guide - Core concepts and architecture
  • Examples - Practical usage patterns
  • Development - Contributing guidelines

🎯 Key Features

  • SQLMesh Integration - Native support for SQLMesh models and schedules
  • Asset Management - Automatic asset creation from SQLMesh models
  • Scheduling - Adaptive scheduling with Dagster's scheduling system
  • Audit Integration - Built-in audit checks and validation
  • Environment Management - Multi-environment support

🏗️ Architecture

dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:

  • SQLMeshResource - Manages SQLMesh context and execution
  • SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
  • Factory Functions - Easy setup and configuration

🔧 Installation

From PyPI

pip install dg-sqlmesh

From Source

git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .

📖 Examples

See our examples directory and documentation for comprehensive usage examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dg_sqlmesh-1.9.3.tar.gz (41.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dg_sqlmesh-1.9.3-py3-none-any.whl (46.8 kB view details)

Uploaded Python 3

File details

Details for the file dg_sqlmesh-1.9.3.tar.gz.

File metadata

  • Download URL: dg_sqlmesh-1.9.3.tar.gz
  • Upload date:
  • Size: 41.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.9.3.tar.gz
Algorithm Hash digest
SHA256 f84b5dafc84b85e41c2ccfd8f733819de5f5ceef837f1299900403595c083123
MD5 7bfb02abd87937ec0f53f713c508afcc
BLAKE2b-256 b453d624bc20d399698101af9d3894b1ce8368e3e455108d05c9c609730d82c9

See more details on using hashes here.

File details

Details for the file dg_sqlmesh-1.9.3-py3-none-any.whl.

File metadata

  • Download URL: dg_sqlmesh-1.9.3-py3-none-any.whl
  • Upload date:
  • Size: 46.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.9.3-py3-none-any.whl
Algorithm Hash digest
SHA256 1edca2daddaf632758d16d17048bca0f7155e1db404531f197b7bf7886fe09e1
MD5 fdcf1c90c623cbbe68f73b39714f2a8c
BLAKE2b-256 96fd734b2e7809d3cf828e080be9f44f1172f40495063326fff8af34084d119b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page