Skip to main content

lx-data-types

Project description

lx-data-models

PyPI CI Docs Publish

CodeCov (Main) codecov

CodeCov (Dev) codecov

lx-dtypes provides strongly typed, Pydantic-powered data models for Lux Group medical research projects. The package ships opinionated validators, utilities for ingestion/export, and a common vocabulary so downstream services can reason about patient examinations, knowledge-base entries, and related clinical data.

Features

  • Comprehensive Pydantic models covering patient records, exam findings, and knowledge-base entities.
  • Data loaders/encoders that normalize multiple file formats into the same abstractions.
  • Utilities for working with Lux Research tooling (paths, logging, export helpers, etc.).
  • Ready-to-run pytest suite with coverage and optional type-checking.

Installation

Install the latest release from PyPI (coming soon):

pip install lx-dtypes

For contributors and power users, install with the development extras:

pip install "lx-dtypes[dev]"

Quick Start

from lx_dtypes import __version__
from lx_dtypes.models.patient import Patient

patient = Patient.model_validate({
		"id": "1234",
		"first_name": "Ada",
		"last_name": "Lovelace",
})

print(patient.full_name)
print(__version__)

Development

git clone https://github.com/wg-lux/lx-data-models
cd lx-data-models
python -m venv .venv && source .venv/bin/activate
pip install -e ".[dev]"

Architecture Notes

  • Treat lx-data-models as a package boundary when consumed by sibling services.
  • Import package-owned symbols through public modules where available.
  • Keep demo outputs under temp/generated_exports/; tests should use tmp_path instead of writing repository-root artifacts.
  • Do not import from lx_dtypes...tests or ...test_fixtures in consuming applications.

Django Integration

If you want to use the packaged Django API in another project, do not infer the host-model requirements from the code. Use the explicit contract in docs/guides/django-host-integration.md.

That guide defines:

  • required settings such as LX_DTYPES_HOST_MODELS_MODULE
  • the exact host ORM models that must be exported
  • the required fields, relations, and methods on those models
  • the supported URL mounting pattern

Prototype KB Workflow

For fast local knowledge-base prototyping with lx-terminology-editor, keep the editor's .published/ output as the handoff artifact and point LX_DTYPES_KB_REGISTRY at its registry JSON.

Inside devenv shell, this repo exposes:

  • LX_DTYPES_EDITOR_KB_REGISTRY
  • use_editor_kb
  • use_packaged_kb
  • show_kb_mode

Example:

use_editor_kb
lx-dtypes-prototype-kb-smoke --module my_module --version 0.1.0-dev.1

This keeps prototype loading deterministic because resolution happens through the same versioned registry path used by KnowledgeBaseResolver.

Migrations

The following command shortcuts are available for managing migratons, see line below for what they do:

mkmigrations

"uv run python manage.py makemigrations ${DJANGO_APP_NAME}";

migrate

"uv run python manage.py migrate";

runserver

"uv run python manage.py runserver";

resetdb

"rm -f db.sqlite3";

resetmigrations

rm -rf ${DJANGO_APP_DIR}/migrations/;
uv run python manage.py makemigrations ${DJANGO_APP_NAME};

Initialized Models

Some pydantic models with ForwardRefs require initialization before use. Import initialized models from lx_dtypes.utils.initialized_models

If you encounter this error when using a model, you may add it there.

Example for the PatientLedger model which references Examiner. This would cause a circular import, therefore we just use the Examiner model during TYPE_CHECKING in the PatientLedger model file and rebuild the model here.

from lx_dtypes.models.examiner import (
    Examiner,  # for model rebuild # type: ignore # noqa: F401
)

PatientLedger.model_rebuild()

Test & Lint

pytest
ruff check lx_dtypes tests
mypy lx_dtypes

Documentation

Install the documentation extras (included in .[dev]) and build the HTML site with Sphinx:

pip install -e ".[docs]"
make -C docs html
# open docs/_build/html/index.html in your browser

Use make -C docs linkcheck to verify outbound references before publishing to Read the Docs or GitHub Pages.

Release Process

  1. Update CHANGELOG.md and bump the version in pyproject.toml.
  2. Run formatting, linting, type-checking, and the full test suite.
  3. Build artifacts with python -m build and verify with twine check dist/*.
  4. Trigger the "Publish" GitHub workflow (either via tag/release or manual dispatch). Trusted Publisher entries for test.pypi.org and pypi.org should already reference the publish.yml workflow and the testpypi/pypi environments; approve those environments as needed and the workflow will push to TestPyPI first, then PyPI.

Easier Release Commands

lx-dtypes-release current
lx-dtypes-release prepare 0.1.2
lx-dtypes-release build
git tag v0.1.2 && git push origin v0.1.2

Easier KB Registry Commands

Register the current installed knowledge base version and data root:

lx-dtypes-kb-registry add-current /path/to/kb_registry.json --module report_template_examples

Register an explicit historical version from a provisioned path:

lx-dtypes-kb-registry add /path/to/kb_registry.json \
  --module report_template_examples \
  --version 0.1.0 \
  --input-dir /nix/store/.../site-packages/lx_dtypes/data

Smoke-test an explicit prototype module/version through the configured registry:

lx-dtypes-prototype-kb-smoke --module report_template_examples --version 0.1.0

Contributing

See CONTRIBUTING.md for the full workflow, coding standards, and release guidelines. Bug reports and pull requests are welcome!

License

Distributed under the MIT License. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lx_dtypes-0.1.5.tar.gz (2.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lx_dtypes-0.1.5-py3-none-any.whl (514.8 kB view details)

Uploaded Python 3

File details

Details for the file lx_dtypes-0.1.5.tar.gz.

File metadata

  • Download URL: lx_dtypes-0.1.5.tar.gz
  • Upload date:
  • Size: 2.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for lx_dtypes-0.1.5.tar.gz
Algorithm Hash digest
SHA256 404b25091469cbc2ce573ef69a290b03381a6bea6f8db89f6a372401a0ca0d9f
MD5 717be6408cc57ffd05b801c5d47bc6dc
BLAKE2b-256 25f7eec7ce806e8c02238998064e89d639436157563ed8df2dde5d87519887c9

See more details on using hashes here.

File details

Details for the file lx_dtypes-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: lx_dtypes-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 514.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for lx_dtypes-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 c7048286a2fe16edeb7f8a42db2805c4429b799f6a9af2724ea59e7efd4cbb95
MD5 645c4a543adb431f7463b4a76879b62d
BLAKE2b-256 9ecbdb16f76785c1606a9530dc0064c1ace7c11ae1686621e7e04758d1e9ec6c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page