Skip to main content

Seamless integration between Dagster and SQLMesh for modern data engineering workflows

Project description

dg-sqlmesh

PyPI version Current Version Tests Documentation License Python

A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.

🚀 Quick Start

# Install the package
pip install dg-sqlmesh

# Or install from source
pip install -e .

📚 Documentation

📖 Full Documentation →

Our comprehensive documentation includes:

  • Getting Started - Installation and setup guides
  • User Guide - Core concepts and architecture
  • Examples - Practical usage patterns
  • Development - Contributing guidelines

🎯 Key Features

  • SQLMesh Integration - Native support for SQLMesh models and schedules
  • Asset Management - Automatic asset creation from SQLMesh models
  • Scheduling - Adaptive scheduling with Dagster's scheduling system
  • Audit Integration - Built-in audit checks and validation
  • Environment Management - Multi-environment support

🏗️ Architecture

dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:

  • SQLMeshResource - Manages SQLMesh context and execution
  • SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
  • Factory Functions - Easy setup and configuration

🔧 Installation

From PyPI

pip install dg-sqlmesh

From Source

git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .

📖 Examples

See our examples directory and documentation for comprehensive usage examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dg_sqlmesh-1.10.0.tar.gz (44.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dg_sqlmesh-1.10.0-py3-none-any.whl (50.6 kB view details)

Uploaded Python 3

File details

Details for the file dg_sqlmesh-1.10.0.tar.gz.

File metadata

  • Download URL: dg_sqlmesh-1.10.0.tar.gz
  • Upload date:
  • Size: 44.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.24

File hashes

Hashes for dg_sqlmesh-1.10.0.tar.gz
Algorithm Hash digest
SHA256 daf44d10a30afe435e115a68b7b2afe96df66f8a93b9045dd3c83fb3e044b694
MD5 2aa5050638fe90c05329f06685a1a2f8
BLAKE2b-256 dd6ce7599c4a31f3cb78cc537d803c81decf50eb3ddbec4ab696543703d9d47b

See more details on using hashes here.

File details

Details for the file dg_sqlmesh-1.10.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dg_sqlmesh-1.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5bfda9e8ea0bbb5528b7d74c7b0b3832c6769c0b122884a26afddd5c85c198ab
MD5 df6d7cb1ebd405f1eceaab8e62b714b1
BLAKE2b-256 5b56ce6b48a39e2bf6b181183475c83bceff920d0b6868fca430107af1eca542

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page