Skip to main content

ontology_loader

Project description

ontology_loader

Suite of tools to configure and load an ontology from the OboFoundary into the data object for OntologyClass as specified by NMDC schema.

Development Environment

Pre-requisites

  • =Python 3.9

  • Poetry
  • Docker
  • MongoDB
  • NMDC materialized schema
  • ENV variable for MONGO_PASSWORD (or pass it in via the cli/runner itself directly)
% docker pull mongo
% docker run -d --name mongodb-container -p 27018:27017 mongo

Basic mongosh commands

% docker ps
% docker exec -it [mongodb-container-id] bash
% mongosh mongodb://admin:root@mongo:27017/nmdc?authSource=admin
% show dbs
% use nmdc
% db.ontology_class_set.find().pretty()
% db.ontology_relation_set.find().pretty()

Command line

% poetry install
% poetry run ontology_loader --help
% poetry run ontology_loader --source-ontology "envo"
% poetry run ontology_loader --source-ontology "uberon"

Running the tests

% make test

Running the linter

% make lint

python example usage

pip install nmdc-ontology-loader
from  nmdc_ontology_loader.ontology_loader import OntologyLoader
import tempfile

def test_load_ontology():
    """Test the load_ontology method."""
    ontology_loader = OntologyLoader(
        source_ontology="envo",
        output_directory=tempfile.gettempdir(),
        generate_reports=True,
    )
    ontology_loader.load_ontology()
    assert ontology_loader.ontology_class_set
    assert ontology_loader.ontology_relation_set
    assert ontology_loader.ontology_class_set.count() > 0
    assert ontology_loader.ontology_relation_set.count() > 0

Testing CRUD operations in a live MongoDB

If you want to test the CRUD operations in a live MongoDB instance, you need to set two environment variables: MONGO_PASSWORD="your_valid_password" ENABLE_DB_TESTS=true

This will allow you to run tests to actually insert/update/delete records in your MongoDB tests instance instead of simply mocking the calls. You can then run the tests with the following command:

make test

The same test command will run without the environment variables, but it will only mock the calls to the database. This is intended to help prevent accidental data loss or corruption in a live database environment and to ensure that MONGO_PASSWORD is not hardcoded in the codebase.

Reset collections in dev

% docker exec -it mongo bash
% mongosh mongodb://admin:root@mongo:27017/nmdc?authSource=admin
% db.ontology_class_set.find({}).pretty()
% db.ontology_relation_set.find({}).pretty()
% db.biosample_set.find({}).pretty()
% db.ontology_class_set.drop()
% db.ontology_relation_set.drop()
% db.ontology_class_set.countDocuments()
% db.ontology_relation_set.countDocuments()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ontology_loader-0.1.14.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ontology_loader-0.1.14-py3-none-any.whl (12.2 kB view details)

Uploaded Python 3

File details

Details for the file ontology_loader-0.1.14.tar.gz.

File metadata

  • Download URL: ontology_loader-0.1.14.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.20

File hashes

Hashes for ontology_loader-0.1.14.tar.gz
Algorithm Hash digest
SHA256 f55232f72aa09839b34d158ad08ace37303a03dff2b860344416090240466cf0
MD5 3d2493fb6d216aa4453a5676a145bb59
BLAKE2b-256 1cac0ecc14b900bc282f9d148d04d725c12961af50a353a74f946c3379da7908

See more details on using hashes here.

File details

Details for the file ontology_loader-0.1.14-py3-none-any.whl.

File metadata

File hashes

Hashes for ontology_loader-0.1.14-py3-none-any.whl
Algorithm Hash digest
SHA256 102cde28818f45f9d009d0c3f120540b10f8618e06ca3b78f2e01ac35e3466e5
MD5 33b9983ce033115013fb8d3cb89612f6
BLAKE2b-256 dfd5b0a5e1de0a171c8fc25462fd48a381bb062232261fac6719aaa161925b1e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page