Seamless integration between Dagster and SQLMesh for modern data engineering workflows
Project description
dg-sqlmesh
A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.
🚀 Quick Start
# Install the package
pip install dg-sqlmesh
# Or install from source
pip install -e .
📚 Documentation
Our comprehensive documentation includes:
- Getting Started - Installation and setup guides
- User Guide - Core concepts and architecture
- Examples - Practical usage patterns
- Development - Contributing guidelines
🎯 Key Features
- SQLMesh Integration - Native support for SQLMesh models and schedules
- Asset Management - Automatic asset creation from SQLMesh models
- Scheduling - Adaptive scheduling with Dagster's scheduling system
- Audit Integration - Built-in audit checks and validation
- Environment Management - Multi-environment support
🏗️ Architecture
dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:
- SQLMeshResource - Manages SQLMesh context and execution
- SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
- Factory Functions - Easy setup and configuration
🔧 Installation
From PyPI
pip install dg-sqlmesh
From Source
git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .
📖 Examples
See our examples directory and documentation for comprehensive usage examples.
🤝 Contributing
We welcome contributions! Please see our Contributing Guide for details.
📄 License
This project is licensed under the MIT License - see the LICENSE file for details.
🔗 Links
- Documentation: https://fosk06.github.io/dagster-sqlmesh/
- GitHub: https://github.com/fosk06/dagster-sqlmesh
- PyPI: https://pypi.org/project/dg-sqlmesh/
- Releases: https://github.com/fosk06/dagster-sqlmesh/releases
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dg_sqlmesh-1.10.1.tar.gz.
File metadata
- Download URL: dg_sqlmesh-1.10.1.tar.gz
- Upload date:
- Size: 44.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.5.24
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0dbf9ab546d0233dcff99f8752a9007ae372b47cd87495cfa924dde8896b2e90
|
|
| MD5 |
1ef7f1daa91e3fd0d71a9cce625731c0
|
|
| BLAKE2b-256 |
7969052b510d75284400d80348072ed17ce2ce16b2bd7a8abede973405fe238d
|
File details
Details for the file dg_sqlmesh-1.10.1-py3-none-any.whl.
File metadata
- Download URL: dg_sqlmesh-1.10.1-py3-none-any.whl
- Upload date:
- Size: 50.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.5.24
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4588a56845a7d00a12b760ad47edacecaac3b7928386f72e0488f8ef1b61204a
|
|
| MD5 |
2b49d9c05154068c37a9fd569c766235
|
|
| BLAKE2b-256 |
728121851e75f0e211d2f0e4581bf3d53492fc1828defbfa62446a18b4d77ad7
|