Vivid DB

Vivid DB (alias Deet) is a universal data mapper and SQL-Database engine, that implements high-performance and security requirements for large-scale enterprise analytical applications.

The primary goal of Deet is to separate data integration and data analysis into independent tasks, by providing a universal data interface for machine learning- and data analysis applications. To achieve this goal, Deet implements the two fundamental layers of a data warehouse:

The integration layer of Deet utilizes SQLAlchemy to allow it's connection to a variety of SQL-Databases (e.g. IBM DB2, Oracle, SAP, MS-SQL, MS-Access, Firebird, Sybase, MySQL, Postgresql, SQLite, etc.). Thereupon it provides native support for flat file databases (e.g. CSV-Tables, R-Table exports), laboratory measurements and data generators.

The staging layer of Deet is implemented as a native SQL-Database engine, featuring a DB-API 2.0 interface with full SQL:2016 support, a vertical data storage manager and real-time encryption. This allows the data analysis application to integrate a variety of different data sources, by using a unified data interface (and SQL dialect).

Deet is open source, based on the Python programming language and actively developed as a component of the Vivid Code framework at Frootlab.

Current Development Status

Deet currently is in Pre-Alpha development stage, which immediately follows the Planning stage. This means, that at least some essential requirements of Deet are not yet implemented. A comprehensive list of all currently supported data back-ends is given in the online manual.

Installation

Comprehensive information and installation support is provided within the online manual. If you already have a Python environment configured on your computer, you can install the latest distributed version by using pip:

$ pip install deet

Or alternatively:

$ pip install vivid-db

Documentation

The latest Deet documentation is available as an online manual and for download in the formats PDF, EPUB and HTML.

Contribute

Contributors are very welcome! Feel free to report bugs and feature requests to the issue tracker provided by GitHub. Currently, as the Frootlab Developers team still is growing, we do not provide any Contribution Guide Lines to collaboration partners. However, if you are interested to join the team, we would be glad, to receive an informal application.

License

Deet is open source and available free for any use under the GPLv3 license:

© 2019 The Frootlab Organization
© 2018-2019 Patrick Michl