Define, validate and transform DBnomics data
Project description
DBnomics Data Model
In DBnomics, once data has been downloaded from providers, it is converted in a common format: the DBnomics data model.
This Python package provides:
- model classes defining DBnomics entities (provider, dataset, series, etc.) with their business logic and validation rules
- a data storage abstraction to load and save those entities
- adapters implementing the data storage abstraction (e.g.
dbnomics_data_model.storage.adapters.filesystem
)
This package is used in particular by the convert script of fetchers in order to save data.
Documentation
Please read https://db.nomics.world/docs/data-model/
Validate data
To validate a directory containing data written by (or compatible with) the "filesystem" adapter:
dbnomics-validate-storage <storage_dir>
This script outputs the data validation errors it finds.
Run tests
To run unit tests:
pytest
Code quality:
flake8 .
See also: https://git.nomics.world/dbnomics-fetchers/documentation/wikis/code-style
Publish a new version
For package maintainers:
git tag x.y.z
git push
git push --tags
GitLab CI will publish the package to https://pypi.org/project/dbnomics-data-model/ (see .gitlab-ci.yml
).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for dbnomics-data-model-0.13.22.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72efbc8840b462aef5bcabdc5ecf1c02a90273fd9163d80f6fe1379070d9a7ce |
|
MD5 | 00f697320e0d20461290e1dbee4612ca |
|
BLAKE2b-256 | 27318fdf22f3d8a2edce03dc8bd3b80ff5ba1a2303e9428820f61e9175dc3b25 |
Hashes for dbnomics_data_model-0.13.22-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b658c3e79dc12c41e07a48779644ade865119c7bc445a5e5ea931b94957d685 |
|
MD5 | 34703282576a591300d53bc7dca900a8 |
|
BLAKE2b-256 | b5d1ab056b9ab9c088c4426c200c261d7a9bc0b1bcd1b40c2e30f1063c509f1a |