Skip to main content

Seamless integration between Dagster and SQLMesh for modern data engineering workflows

Project description

dg-sqlmesh

PyPI version Current Version

A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.

🚀 Quick Start

# Install the package
pip install dg-sqlmesh

# Or install from source
pip install -e .

📚 Documentation

📖 Full Documentation →

Our comprehensive documentation includes:

  • Getting Started - Installation and setup guides
  • User Guide - Core concepts and architecture
  • Examples - Practical usage patterns
  • Development - Contributing guidelines

🎯 Key Features

  • SQLMesh Integration - Native support for SQLMesh models and schedules
  • Asset Management - Automatic asset creation from SQLMesh models
  • Scheduling - Adaptive scheduling with Dagster's scheduling system
  • Audit Integration - Built-in audit checks and validation
  • Environment Management - Multi-environment support

🏗️ Architecture

dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:

  • SQLMeshResource - Manages SQLMesh context and execution
  • SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
  • Factory Functions - Easy setup and configuration

🔧 Installation

From PyPI

pip install dg-sqlmesh

From Source

git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .

📖 Examples

See our examples directory and documentation for comprehensive usage examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dg_sqlmesh-1.9.2.tar.gz (41.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dg_sqlmesh-1.9.2-py3-none-any.whl (46.7 kB view details)

Uploaded Python 3

File details

Details for the file dg_sqlmesh-1.9.2.tar.gz.

File metadata

  • Download URL: dg_sqlmesh-1.9.2.tar.gz
  • Upload date:
  • Size: 41.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.9.2.tar.gz
Algorithm Hash digest
SHA256 77e167764de56cbe2d72305534519841b480e050bfbb022839d376c4b4555201
MD5 ffff0f76cd7e3d54ad419e0681216a47
BLAKE2b-256 4b7b3287292477414b9f23ca78d5e8539f7767f6971cd76baab565e526fdb8fd

See more details on using hashes here.

File details

Details for the file dg_sqlmesh-1.9.2-py3-none-any.whl.

File metadata

  • Download URL: dg_sqlmesh-1.9.2-py3-none-any.whl
  • Upload date:
  • Size: 46.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.9.2-py3-none-any.whl
Algorithm Hash digest
SHA256 872609e875ec2269c6f97fca2174454e6a1a9fbaff063ff09f8cedd8f6f470a8
MD5 8bf4dec39b37ce4f66c3703b878a8ae8
BLAKE2b-256 b643422cac6a1ff7932cffcd64324c592a842aeaaf9778d552b87d727238996c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page