Skip to main content

Developing a Gen3 Data Dictionary

overview.png

This repository aims to provide the documentation, learning materials, and software tools to facilitate the creation of a data model in Gen3.

Pre-Reading: Please become familiar with some core data modelling concepts before starting.

Using Gen3SchemaDev as a data modelling tool

Null description placeholders

gen3schemadev validate warns about description: null placeholders anywhere in the dictionary (commonly in _definitions.yaml's enum definitions). The Gen3 metaschema requires descriptions to be strings; null placeholders cause "No Description" in the data-dictionary viewer and metaschema validation failures that surface on resolved node schemas, far from the offending definition. Remove the null description keys to resolve the warning.

Deep dive into Gen3 Data Modelling

Special Thanks to Marion Shadbolt for providing the source material

  1. Gen3 Dictionary Overview
  2. Gen3 Schema Explained
    1. Descriptors
    2. Links
    3. Properties
  3. Example of a Gen3 Schema yaml
  4. Handy tips
  5. FAIR Concepts for Data Modelling

For Developers

Installation and testing

# To install
pip install poetry
poetry install
source $(poetry env info --path)/bin/activate
gen3schemadev --version

# To run tests
poetry run pytest

Contributing

Gen3SchemaDev is an open source project, and we highly encourage any contributions and PRs. Specifically we need the community to help with the following:

  1. Keeping the gen3 metaschema up to date
  2. Adding business rule logic to the rule validator module.
    1. For example, a node with the category data_file should have a collection of required data file properties such as md5sum, filesize, etc.

For PRs, please follow the contributing guidelines.

License

Apache 2.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gen3schemadev-2.6.2.tar.gz (42.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gen3schemadev-2.6.2-py3-none-any.whl (49.7 kB view details)

Uploaded Python 3

File details

Details for the file gen3schemadev-2.6.2.tar.gz.

File metadata

  • Download URL: gen3schemadev-2.6.2.tar.gz
  • Upload date:
  • Size: 42.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.4.1 CPython/3.12.13 Linux/6.17.0-1020-azure

File hashes

Hashes for gen3schemadev-2.6.2.tar.gz
Algorithm Hash digest
SHA256 cc1efaeaa3805ba08ea39c9c0fe347ce1946a97a16d58f07acd5417571c77103
MD5 1cedc8b0f108ae6bbd237a9aa18202c5
BLAKE2b-256 1828dc50a0909c6c8147cf1abe8498e839913e9699c27ead5ce9fac53c824619

See more details on using hashes here.

File details

Details for the file gen3schemadev-2.6.2-py3-none-any.whl.

File metadata

  • Download URL: gen3schemadev-2.6.2-py3-none-any.whl
  • Upload date:
  • Size: 49.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.4.1 CPython/3.12.13 Linux/6.17.0-1020-azure

File hashes

Hashes for gen3schemadev-2.6.2-py3-none-any.whl
Algorithm Hash digest
SHA256 34a39b16906f6151d6072ca2f097dd23ed04d9cd732399b30d5a4bbc4944db6f
MD5 c853d0eaec850076380365d6cf2105a4
BLAKE2b-256 5e6650c2e4abf17592597385a6a3cb0f8a4c96d8eba59f51e784e71753a4c1b7

See more details on using hashes here.

Release history Release notifications | RSS feed

4.0.1

2 files

4.0.0

2 files

3.2.0

2 files

3.1.0

2 files

3.0.1

2 files

3.0.0

2 files

This release

2.6.2 This release

2 files

2.6.1

2 files

2.6.0

2 files

2.5.0

2 files

2.4.0

2 files

2.3.6

2 files

2.3.5

2 files

2.3.4

2 files

2.3.3

2 files

2.3.2

2 files

2.3.1

2 files

2.3.0

2 files

2.2.0

2 files

2.1.1

2 files

2.1.0

2 files

2.0.11

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page