gldb 1.0.0

Generic linked database approach to manage RDF and raw data together.

generic-linked-database

An approach to integrate multiple databases behind a unified interface. At least on database is intended to be an RDF database for metadata storage, the others are raw data storages like SQL or noSQL databases.

Quickstart

Installation

Install the package:

pip install gldb

Example

An example exists as Jupyter Notebook in docs/examples/. You may also try it online with Google Colab:

Design

Abstractions

The package provides the following abstractions:

• GenericLinkedDatabase: The unified interface to interact with the semantic metadata and raw data storage
• RDFStore: The interface to interact with the semantic metadata storage
• RawDataStore: The interface to interact with the raw data storage
• DataStoreManager: The manager to interact with the different data stores
• Query: The interface to interact with the different data stores
• RDFStoreQuery: The interface to interact with the semantic metadata storage
• RawDataStoreQuery: The interface to interact with the raw data storage

Class Diagram

classDiagram
    class GenericLinkedDatabase {
        <<abstract>>
        +StoreManager store_manager
        +linked_upload(filename)
        +execute_query(store_name, query)
    }

    class DataStoreManager {
        +stores: Dict
        +add_store(store_name, store)
        +get_store(store_name)
        +execute_query(store_name, query)
        +upload_file(store_name, filename)
    }

    class DataStore {
        <<abstract>>
        +execute_query(query)
        +upload_file(filename)
    }

    class RDFStore {
        <<abstract>>
        +execute_query(query)
        +upload_file(filename)
    }

    class RawDataStore {
        <<abstract>>
        +execute_query(query)
        +upload_file(filename)
    }

    class Query {
        <<abstract>>
        +execute(*args, **kwargs)
    }

    class RDFStoreQuery {
        <<abstract>>
    }

    class RawDataStoreQuery {
        <<abstract>>
    }
    
    class SparqlQuery {
        +sparql_query: str
        +execute(graph: rdflib.Graph)
    }

    %% Relationships
    GenericLinkedDatabase --> DataStoreManager
    GenericLinkedDatabase --> Query
    DataStoreManager --> DataStore
    DataStore <|-- RDFStore
    DataStore <|-- RawDataStore
    Query <|-- RDFStoreQuery
    Query <|-- RawDataStoreQuery
    RDFStoreQuery <|-- SparqlQuery : implements