D-REPR
Dataset Representation Language for Reading Heterogeneous Datasets to RDF or JSON. The original dataset can be in different formats (e.g., JSON, CSV, Spreadsheets, etc), layouts (e.g., relational tables, matrix tables, etc), and can contain multiple files (e.g., one file contains data and another file contains data definitions or linked entities).
Table of Contents
Installation
From PyPi: pip install drepr
If you need to process netCDF or fiona, install pip install drepr[fiona,netcdf]. Installing these libraries requires you to have netcdf and gdal preinstalled and configured in your system.
If you want to install from source or have trouble during installation, please look in the Wiki Installation
How D-REPR works
There are four steps in D-REPR to model a dataset:
- Define resources: a resource can be a physical file in CSV, JSON format. A dataset may have multiple resources such as one main CSV file and a data-definition dictionary in a JSON file.
- Define attributes: each attribute denotes values that belong to a group. For example, in a relational table, each column is an attribute.
- Define alignments between attributes: a method to get a value of an attribute from a value of a corresponding attribute. The common methods are accessing by index and by value. For example, in a relational table of products, given a product id, we can retrieve the corresponding product name in the same row (by index). This step essentially defines the layout of the dataset.
- Define a semantic model: given each attribute a type and relationships between attributes.
Docs and Examples
Please see the paper D-REPR: A Language for Describing and Mapping Diversely-Structured Data Sources to RDF and the slides.
The example datasets can be found in the example folder.
Testing
Testing rust package: cargo test --no-default-features --features pyo3/auto-initialize
Contributing
Please read the Wiki Contributing for details on our code of conduct, how to setup the development environment and the process for submitting pull requests to us.
2 maintainers
Metadata
2 maintainers
Release files for drepr 2.11.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| drepr-2.11.2.tar.gz | 9.7 MB | Details |
Built distributions (wheels)
Total release size: 52.0 MB
Release files / drepr-2.11.2.tar.gz
| Download URL | drepr-2.11.2.tar.gz |
|---|---|
| Size | 9.7 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2b48fc2786ebf75a88418cbe3581c330bdc3c4fd565e0f0dbe44ae5cb77e1c56
|
|
BLAKE2b-256 checksum How to use checksums |
8dbd4261da202b2c0367eb5b78ac26621f1c2f3510f3fd0d7f5a50b4cba56c1f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
4a3af4b95cedf304539443adcf6da189f3692f8c66b3a7a9256a4871ceafeda7
|
|
BLAKE2b-256 checksum How to use checksums |
6d166174cf5ce3324fc3d83e07be02168b1483595d8fd1942445b5ad8fe1ce96
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
9bddc9d0f2b5dd719699e1d221e149907125f19912a4e0697dfd9f79e40574a6
|
|
BLAKE2b-256 checksum How to use checksums |
a1e1cb0b947691c69c08e4988101a728bbc063e8dd095451b63df2ad0d7c4301
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
a74c95d70d62272aa41f7426b7394aaf4a9b5507d5fa3912a2f96eda36a37400
|
|
BLAKE2b-256 checksum How to use checksums |
de365351d71d12d0508a3f004adebb6bd60221369511c19da4c2268a7a005465
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp312-none-win_amd64.whl
| Download URL | drepr-2.11.2-cp312-none-win_amd64.whl |
|---|---|
| Size | 2.7 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
a7da77811778966091a8895d830c10fb2934bbe4580369dff66c180fc8062c21
|
|
BLAKE2b-256 checksum How to use checksums |
ffb1a04c9e7bf7eb60ae93526f268f78294defda8fab48fa7f55e6b555bda2ad
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
4f556fee898b8241895977321cb514ccebbf823219dd9af53b2877ecc3ff0977
|
|
BLAKE2b-256 checksum How to use checksums |
bf9e9c71dba54cda31249a8e13ba14a55b1c53f2cd2df4d4597fa989d33b5dca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp312-cp312-macosx_10_14_x86_64.whl
| Download URL | drepr-2.11.2-cp312-cp312-macosx_10_14_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.12 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
85778030da54d561ffe0880a0cf67626997e94eff457545fac6322d02807b020
|
|
BLAKE2b-256 checksum How to use checksums |
32f3692922967aeba2a7976bd804f4006bd9de2b8824087b3775791782f99ee6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp311-none-win_amd64.whl
| Download URL | drepr-2.11.2-cp311-none-win_amd64.whl |
|---|---|
| Size | 2.7 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
82ed85f0c2d285763716325002184edf82df7d4006d5731f1dcf3545450febcc
|
|
BLAKE2b-256 checksum How to use checksums |
df1b4be0295bddf3d85eb64828d96bb8cb554baba952a671a0ee05282804352d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
0c6f2b93e6e807b444f223efea01ef6e4a5e109ef3146ef1b3ea5583dceff975
|
|
BLAKE2b-256 checksum How to use checksums |
624d860c36559ece9b3f2079afaf48fa35b8c7341b57e3a2959ef367ab431a34
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp311-cp311-macosx_10_14_x86_64.whl
| Download URL | drepr-2.11.2-cp311-cp311-macosx_10_14_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.11 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
971f84c8a02ab8cf075b8f7467f30c2d8e8303f876e2b57b6f6e5e4bf48eab1f
|
|
BLAKE2b-256 checksum How to use checksums |
19ec9385845c3e45ca91ad1bdc71244905037efec750e64b0d78e39435f0af02
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp310-none-win_amd64.whl
| Download URL | drepr-2.11.2-cp310-none-win_amd64.whl |
|---|---|
| Size | 2.7 MB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d5a0a0243dab56b9974a1715a35cb314be4995eedee868fcfc54f66ce62951b6
|
|
BLAKE2b-256 checksum How to use checksums |
92bb9ab602beff883a17064425dc55579b5fd9b83adf1a4966dedae196b3e990
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
818e13bc6f26cf3e683484306ab19f0005c0856c47b4d8cd528c2073baeb50fc
|
|
BLAKE2b-256 checksum How to use checksums |
cccf2bbc4c1fe9f97a728fef6c78acb9aa8d7a8ac8b5ac8a9eac2c327472eb27
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp310-cp310-macosx_10_14_x86_64.whl
| Download URL | drepr-2.11.2-cp310-cp310-macosx_10_14_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.10 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
97446601bf08ba4ee2fcaa461cbaa038a16d562843ee01107ab752e19400afac
|
|
BLAKE2b-256 checksum How to use checksums |
dd8676673c5060e69720098edf3baae5a355b88f1b6299d180caf2355fdc65be
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp39-none-win_amd64.whl
| Download URL | drepr-2.11.2-cp39-none-win_amd64.whl |
|---|---|
| Size | 2.7 MB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
311344640f0ad8dcb7ebb4f6d055d25767480fa19dcc3445591bb3521485c154
|
|
BLAKE2b-256 checksum How to use checksums |
d5fe6769a96ca007a61cf85d6b8b8686dba2605986f719461d622aa73de93676
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
be19fb2b52425ba7ee99f3e7b51e18fce1186568920ef842c7104b1c5a040d63
|
|
BLAKE2b-256 checksum How to use checksums |
e8f4395d334c953537b97d83da3eade05f789352d405f74a446547a183dcb080
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp39-cp39-macosx_10_14_x86_64.whl
| Download URL | drepr-2.11.2-cp39-cp39-macosx_10_14_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.9 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
8c782fc4cc29dce95fc4b12da2abe5ffad6083cd5cce453bf66c5d045378157c
|
|
BLAKE2b-256 checksum How to use checksums |
66699e59b9a38df59ccb08ee935c41d0e543f8ab4972fcfee33b233f5400b87d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp38-none-win_amd64.whl
| Download URL | drepr-2.11.2-cp38-none-win_amd64.whl |
|---|---|
| Size | 2.7 MB |
| Tags | CPython 3.8 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
581eabf00c8b6e4280f545a3035874c2b14f6458dd941211948ff7a4dc1e5502
|
|
BLAKE2b-256 checksum How to use checksums |
7934205eaca8401b2e1807c3dd7e1eac8e6efd8bd247ce24c169df8da757031f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | drepr-2.11.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.8 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
d66b540667d579fcf98424476f2bd1b3bc97d6fe26d2c6dbb1efcfc187bea1d0
|
|
BLAKE2b-256 checksum How to use checksums |
cb95ef036e03f2b02e36fa2ce9a1d4922fea6f4f4188e4dd7fed71145a14c49a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
Release files / drepr-2.11.2-cp38-cp38-macosx_10_14_x86_64.whl
| Download URL | drepr-2.11.2-cp38-cp38-macosx_10_14_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.8 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
e1c784b7e6f0c10e1b5a41af837681fcf4f4aacf15ba39db687f403a221771ae
|
|
BLAKE2b-256 checksum How to use checksums |
f56e46665d2fb701e40d66fd91479c92246b4cc487604ce14684d52cc09a5f10
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.4.0
|
