Skip to main content

lobster-metadata

Sample metadata management and harmonization for multi-omics datasets.

Installation

pip install lobster-metadata

Agents

Agent Description
metadata_assistant Metadata operations specialist. Sample ID mapping, schema standardization, dataset validation, and disease annotation enrichment.

Services

Service Purpose
SampleMappingService Map sample IDs between datasets using multiple strategies
MetadataStandardizationService Standardize metadata fields to Pydantic schemas
MetadataFilteringService Filter datasets by metadata criteria
DiseaseStandardizationService Standardize disease names to controlled vocabularies
DiseaseOntologyService Map diseases to ontology terms (MONDO, DO)
ClinicalMetadataService Extract and validate clinical metadata fields
SampleGroupingService Group samples by metadata attributes
MicrobiomeFilteringService Microbiome-specific metadata filtering

Features

Sample ID Mapping

  • Exact match between matrix and metadata identifiers
  • Fuzzy matching with configurable similarity thresholds
  • Pattern-based matching using regular expressions
  • Metadata-based correlation for complex mapping scenarios

Metadata Standardization

  • Transcriptomics schema (cell type, tissue, organism, disease)
  • Proteomics schema (platform, quantification method, normalization)
  • Microbiome schema (16S vs shotgun, taxonomic level, diversity)

Dataset Validation

  • Sample count consistency between matrix and metadata
  • Condition coverage verification for experimental design
  • Control sample identification and validation
  • Biological and technical replicate detection
  • Platform consistency checks across samples

Disease Enrichment

Four-phase hierarchy for missing disease annotations:

  1. Column re-scan for disease-related field names
  2. LLM-based abstract extraction from publication context
  3. LLM-based methods section parsing
  4. Manual mapping fallback for known datasets

Multi-Omics Integration

  • Cross-modality sample alignment
  • Shared sample identification across data types
  • Metadata merging with conflict resolution

Requirements

  • Python 3.12+
  • lobster-ai >= 1.0.0

Testing

To run the test suite for this package:

# Install in editable mode with dev dependencies
pip install -e ".[dev]"

# Run all tests
pytest tests/ -v

# Run specific test categories
pytest tests/services/metadata/ -v  # Service tests only
pytest tests/agents/ -v             # Agent tests only

Documentation

Full documentation: docs.omics-os.com/docs/agents/metadata

License

AGPL-3.0-or-later

Metadata

Release files for lobster-metadata 1.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lobster-metadata 1.2.0
File Size Uploaded Provenance Actions
lobster_metadata-1.2.0.tar.gz 106.0 kB With provenance Details for lobster_metadata-1.2.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for lobster-metadata 1.2.0
File Interpreter ABI Platform Actions
lobster_metadata-1.2.0-py3-none-any.whl Python 3 none any Details for lobster_metadata-1.2.0-py3-none-any.whl

Total release size: 223.2 kB

Release files / lobster_metadata-1.2.0.tar.gz

Download URL lobster_metadata-1.2.0.tar.gz
Size 106.0 kB
Tags Source
SHA-256 checksum
How to use checksums
603ed8e5e721355fd6b19c070bfd755c8c3677c237b40a760d9ff78a3deb7898
BLAKE2b-256 checksum
How to use checksums
cde591abe508a9dfbdeccc45e0e36c91fe613c1f33c4edc018cbc6e328b51aa8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 30, 2026.

Transparency log

Release files / lobster_metadata-1.2.0-py3-none-any.whl

Download URL lobster_metadata-1.2.0-py3-none-any.whl
Size 117.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
dc1b89d765511bfba5f7779479c932e0aa102a1d42635e1133aedf911c87d26c
BLAKE2b-256 checksum
How to use checksums
f40853f02a7fb43b9ce9a346893be122d10eeb505c9a18c7b1339fb9864e5ba5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 30, 2026.

Transparency log

Security for lobster-metadata 1.2.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for lobster_metadata-1.2.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 30, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page