Skip to main content

Seamless integration between Dagster and SQLMesh for modern data engineering workflows

Project description

dg-sqlmesh

PyPI version Current Version Tests Documentation License Python

A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.

🚀 Quick Start

# Install the package
pip install dg-sqlmesh

# Or install from source
pip install -e .

📚 Documentation

📖 Full Documentation →

Our comprehensive documentation includes:

  • Getting Started - Installation and setup guides
  • User Guide - Core concepts and architecture
  • Examples - Practical usage patterns
  • Development - Contributing guidelines

🎯 Key Features

  • SQLMesh Integration - Native support for SQLMesh models and schedules
  • Asset Management - Automatic asset creation from SQLMesh models
  • Scheduling - Adaptive scheduling with Dagster's scheduling system
  • Audit Integration - Built-in audit checks and validation
  • Environment Management - Multi-environment support

🏗️ Architecture

dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:

  • SQLMeshResource - Manages SQLMesh context and execution
  • SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
  • Factory Functions - Easy setup and configuration

🔧 Installation

From PyPI

pip install dg-sqlmesh

From Source

git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .

📖 Examples

See our examples directory and documentation for comprehensive usage examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dg_sqlmesh-1.10.1.tar.gz (44.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dg_sqlmesh-1.10.1-py3-none-any.whl (50.6 kB view details)

Uploaded Python 3

File details

Details for the file dg_sqlmesh-1.10.1.tar.gz.

File metadata

  • Download URL: dg_sqlmesh-1.10.1.tar.gz
  • Upload date:
  • Size: 44.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.10.1.tar.gz
Algorithm Hash digest
SHA256 0dbf9ab546d0233dcff99f8752a9007ae372b47cd87495cfa924dde8896b2e90
MD5 1ef7f1daa91e3fd0d71a9cce625731c0
BLAKE2b-256 7969052b510d75284400d80348072ed17ce2ce16b2bd7a8abede973405fe238d

See more details on using hashes here.

File details

Details for the file dg_sqlmesh-1.10.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dg_sqlmesh-1.10.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4588a56845a7d00a12b760ad47edacecaac3b7928386f72e0488f8ef1b61204a
MD5 2b49d9c05154068c37a9fd569c766235
BLAKE2b-256 728121851e75f0e211d2f0e4581bf3d53492fc1828defbfa62446a18b4d77ad7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page