Skip to main content

A generic pipeline that can be used to map raw data to RDF.

Project description

data2rdf

A pipeline for generating data representation in RDF out of raw data given in ASCII, CSV, JSON or EXCEL format.

https://data2rdf.readthedocs.io/en/latest/

Coverage

Coverage Report
FileStmtsMissCoverMissing
data2rdf
   init.py50100% 
   config.py190100% 
   utils.py811 88%
   warnings.py20100% 
data2rdf/models
   init.py30100% 
   base.py5455 91%
   graph.py10077 93%
   mapping.py3911 97%
   utils.py581414 76%
data2rdf/modes
   init.py40100% 
data2rdf/parsers
   init.py60100% 
   base.py1351111 92%
   csv.py1682020 88%
   excel.py1741717 90%
   json.py2053737 82%
   utils.py881010 89%
data2rdf/pipelines
   init.py20100% 
   main.py8299 89%
data2rdf/qudt
   init.py00100% 
   utils.py421212 71%
TOTAL119414488% 

Installation

Install for using the package

Either install the package from the pypi

pip install data2rdf

Install for development

Install the package from the source code:

git clone git@github.com:MI-FraunhoferIWM/data2rdf.git
cd data2rdf
pip install -e .

Unit tests

Before running the unit tests, please install the needed packages:

pip install data2rdf[tests]

Afterwards, run the unittest with:

pytest

Building the docs locally

HTML

A server will start, generate the docs and listen for changes in the source files. This can be done by using docker or installing the development environment directly on the you machine. Next are installation guides for Docker and Linux OS.

Docker

First, build the Docker image by running the following command:

$ docker build -f docs.Dockerfile -t data2rdf-docs .

Then, start the program by running:

$ docker run -it --rm -v $PWD:/app -p 8000:8000 data2rdf-docs

Linux

At an OS level (these commands work on Linux Debian):

$ sudo apt install pandoc graphviz default-jre
$ sudo apt-get install texlive-latex-recommended \
                       texlive-latex-extra \
                       texlive-fonts-recommended \
                       latexmk

The python dependencies:

$ pip install .[docs]

Now you can start the server and render the docs:

$ sphinx-autobuild docs/source docs/build/html

The documentation will be available on http://127.0.0.1:8000.

PDF (LaTeX)

To generate a PDF of the documentation, simply run (from the root project folder):

make -C docs latexpdf

The generated PDF can be found under docs/build/latex/data2rdf_docs.pdf

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data2rdf-2.2.1.tar.gz (39.4 kB view details)

Uploaded Source

Built Distribution

data2rdf-2.2.1-py3-none-any.whl (66.6 kB view details)

Uploaded Python 3

File details

Details for the file data2rdf-2.2.1.tar.gz.

File metadata

  • Download URL: data2rdf-2.2.1.tar.gz
  • Upload date:
  • Size: 39.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for data2rdf-2.2.1.tar.gz
Algorithm Hash digest
SHA256 b2d7c9243215b2b8836453eb8387a8421307496c36e546abd5fc23dcb49ae9ad
MD5 79d2a3fcbf2eb5bbf3ba9cf175532f8b
BLAKE2b-256 fbf8dd0dda179917ce8ab15997311aee64279575b6a3b5466ee26fbdff969f9a

See more details on using hashes here.

File details

Details for the file data2rdf-2.2.1-py3-none-any.whl.

File metadata

  • Download URL: data2rdf-2.2.1-py3-none-any.whl
  • Upload date:
  • Size: 66.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for data2rdf-2.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7467e457f63b14aad1a1b83490bb71af9af528ef163404459d8c38076efd1aaf
MD5 0bd19e8ec6c04694859041a932ab38c8
BLAKE2b-256 8fb7d700bf40e3b5623f7f6d4c901c25aaedcc9c92afb50b11dc4de518ba7438

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page