Skip to main content

Define, validate and transform DBnomics data

Reason this release was yanked:

Sub-packages are missing (`model`, `storage`)

Project description

DBnomics Data Model

In DBnomics, once data has been downloaded from providers, it is converted in a common format: the DBnomics data model.

This Python package provides:

  • model classes defining DBnomics entities (provider, dataset, series, etc.) with their business logic and validation rules
  • a data storage abstraction to load and save those entities
  • adapters implementing the data storage abstraction (e.g. dbnomics_data_model.storage.adapters.filesystem)

This package is used in particular by the convert script of fetchers in order to save data.

Documentation

Please read https://db.nomics.world/docs/data-model/

Validate data

To validate a directory containing data written by (or compatible with) the "filesystem" adapter:

dbnomics-validate-storage <storage_dir>

This script outputs the data validation errors it finds.

Run tests

To run unit tests:

pytest

Code quality:

flake8 .

See also: https://git.nomics.world/dbnomics-fetchers/documentation/wikis/code-style

Publish a new version

For package maintainers:

git tag x.y.z
git push
git push --tags

GitLab CI will publish the package to https://pypi.org/project/dbnomics-data-model/ (see .gitlab-ci.yml).

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics-data-model-0.13.21.tar.gz (15.5 kB view hashes)

Uploaded Source

Built Distribution

dbnomics_data_model-0.13.21-py2.py3-none-any.whl (15.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page