ternyxmimosa 0.2.0

A minimal modern data stack with working data pipelines in a single Docker container.

mimosa

A minimal modern data stack with working data pipelines in a single Docker container.
Explore the docs »

Report Bug · Request Feature

Table of Contents

1. About the Project
2. Getting Started
   • Prerequisites
   • Installation
3. Usage
4. Roadmap
5. Contributing
6. Contact

(back to top)

About the Project

THIS IS A CONCEPT AND WORK IN PROGRESS

A minimal modern data stack with working data pipelines in a single Docker container. This is similar in concept to mimodast using alternative software options.

Useful for an exploration of the tools involved:

• dltHub for data loading

(back to top)

Getting Started

Prerequisites

(back to top)

Installation

(back to top)

Usage

(back to top)

Roadmap

Consider:

• Get source data (Using REST API)
• Transform data, possibly SQL Mesh or dbt.
  • Create data vault transformations (https://automate-dv.readthedocs.io/en/latest/).
• dlt update/error messages using Slack
• [-] Storage (currently local DuckDB, maybe consider some cloud alternative. Though that would stray from the data stack in a Docker concept.)
• Scheduling Tool
• Reporting tool (Metabase?)

(back to top)

Contributing

Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also open a feature request or bug report. Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

Contact

Project Link: mimosa

(back to top)