spolstore 0.3

rdflib store using SQLite Fulltext index

SPOLStore

A Python RDFLib store that stores RDF data on a simple Subject-Predicate-Object-Literal basis, with all literals fulltext indexed using the SQLite FTS5.

Usage

First install the package, this can be done with:

pip install spolstore

To use this as a store in RDFlib, initialize and open a graph:

import rdflib
g = rdflib.Graph("spol")

Before you can use it, it needs to be opened by specifying where on the filesystem the sqlite database containing the graph is.

import rdflib
g = rdflib.Graph("spol")
g.open("/tmp/example.spol")

If you do not open a graph first, an exception is thrown when trying to call any methods on it.

Once a graph has been parsed, you can perform fulltext searches using a SPARQL query:

import rdflib
g = rdflib.Graph("spol")
g.open("/tmp/example.spol")
g.parse("http://www.w3.org/People/Berners-Lee/card")
q = """
    PREFIX foaf: <http://xmlns.com/foaf/0.1/>

    SELECT ?s ?p2 ?o
    WHERE {
            ?s ?p "web workshop" .
            ?s ?p2 ?o .
    }
"""
for r in g.query(q):
    print(r)

Querying the database directly

For applications that need to do bulk data reconciliation, it is useful to query the SPOLstore database directly, and not do access via a HTTP or SPARQL interface.

The database schema for a SPOLStore is conceptually very simple:

CREATE TABLE IF NOT EXISTS spo(s INTEGER, p INTEGER, o INTEGER);
CREATE TABLE IF NOT EXISTS iris(iri);
CREATE VIRTUAL TABLE IF NOT EXISTS literals USING fts5(s UNINDEXED, p UNINDEXED, o);

And there are some simple indices defined:

CREATE UNIQUE INDEX IF NOT EXISTS iris_u ON iris(iri);
CREATE INDEX IF NOT EXISTS spo_s ON spo(s);
CREATE INDEX IF NOT EXISTS spo_p ON spo(p);
CREATE INDEX IF NOT EXISTS spo_o ON spo(o);

So, given an index database, for example the FOAF entries from earlier in this readme, the database can be queried:

import sqlite3
db = sqlite3.connect("/tmp/example.spol")
db.execute("select iris.iri, literals.o from iris inner join literals on iris.rowid = literals.s where o match 'Lee'")

http://www.w3.org/People/Berners-Lee/card|Tim Berners-Lee's FOAF file
https://timbl.com/timbl/Public/friends.ttl|Tim Berners-Lee's editable profile
https://www.w3.org/People/Berners-Lee/card#i|Tim Berners-Lee
https://www.w3.org/People/Berners-Lee/card#i|https://www.w3.org/People/Berners-Lee/card#i
https://www.w3.org/People/Berners-Lee/card#i|Tim Berners-Lee
https://www.w3.org/People/Berners-Lee/card#i|Berners-Lee
https://www.w3.org/People/Berners-Lee/card#i|Timothy Berners-Lee

TODO

This is very much the first working version. Consider it a practical prototype. Probably many bugs...

• Handle languages and data types properly for Literals, in stead of the current dumb dumps