Skip to main content

Production-grade gene ID conversion tool with multi-species support and auto-updates

Project description

gene-id-resolver

PyPI version Python versions Downloads DOI License: MIT

Convert gene IDs without the headaches.

Handle deprecated symbols, ambiguous mappings, and silent failures transparently. Know exactly what happened to every gene in your list.

Born from the frustration of inconsistent gene mappings

Key Features:

  • Multi-species support: Human, mouse, and rat genomes
  • Comprehensive deprecated gene handling: 145,000+ mappings (HGNC, MGI, RGD)
  • ✅ Smart ambiguity resolution (don't silently drop genes)
  • Database updates: Stay current with latest Ensembl releases
  • ✅ Offline operation (no API limits, cached downloads)
  • ✅ Full audit trail (know why conversions fail)
  • ✅ Works with TSV, CSV, and plain text files

Installation

pip install gene-id-resolver

Quick Start

Command line:

# One-time setup
gene-resolver init

# Convert genes
gene-resolver convert TP53 BRCA1 EGFR --to-type ensembl

Python API:

from pathlib import Path
from gene_id_resolver.core.resolver import GeneResolver

resolver = GeneResolver(Path("./data"))
result = resolver.convert(
    gene_ids=["TP53", "BRCA1", "SEPT4"],
    from_type="symbol",
    to_type="ensembl",
    genome_build="hg38"
)

print(f"Converted: {len(result.successful)} genes")
for gene, mapping in result.successful.items():
    print(f"{gene}{mapping.identifiers.ensembl_id}")

Why This Tool?

If you've ever spent hours tracking down why your gene list shrank after ID conversion, or discovered that "MEF2C" maps to multiple Ensembl IDs, this tool is for you. Gene ID conversion seems simple until you encounter:

  • Deprecated symbols (SEPT4 → SEPTIN4, ENO1L1 → ENO1)
  • Ambiguous genes (genes with multiple genomic locations)
  • Silent failures (tools that drop genes without telling you why)
  • Reproducibility issues (different tools, different results)

This tool handles all these cases transparently, so you know exactly what happened to every gene in your list.

Detailed Usage

Command Line Interface

Initialize the database (one-time setup):

gene-resolver init

Convert gene IDs:

# Convert gene symbols to Ensembl IDs
gene-resolver convert TP53 BRCA1 EGFR --to-type ensembl

# Convert from a file
gene-resolver convert-file genes.txt --output results.csv

# Check database status
gene-resolver status

Python API

from pathlib import Path
from gene_id_resolver.core.resolver import GeneResolver

# Initialize resolver
resolver = GeneResolver(Path("./data"))

# Convert gene symbols to Ensembl IDs
result = resolver.convert(
    gene_ids=["TP53", "BRCA1", "SEPT4"],  # SEPT4 is deprecated
    from_type="symbol",
    to_type="ensembl",
    genome_build="hg38",
    ambiguity_strategy="primary"
)

# Check results
print(f"Successful: {len(result.successful)}")
print(f"Failed: {len(result.failed)}")
print(f"Ambiguous: {len(result.ambiguous)}")

# Get converted IDs
for gene, mapping in result.successful.items():
    print(f"{gene}{mapping.identifiers.ensembl_id}")

resolver.close()

Features

Deprecated Gene Handling

Automatically corrects outdated gene symbols:

gene-resolver convert SEPT4 ENO1L1 CDKN2 --to-type ensembl
# Auto-corrected: SEPT4 → SEPTIN4
# Auto-corrected: ENO1L1 → ENO1
# Auto-corrected: CDKN2 → CDKN2A

The tool uses HGNC's complete gene history dataset (58,000+ mappings) to handle symbol changes.

Multi-Species Support

Work with human, mouse, and rat genomes with species-specific deprecated gene support:

# Initialize mouse database
gene-resolver init --species mus_musculus

# Initialize rat database
gene-resolver init --species rattus_norvegicus --release 109

# Convert mouse genes
gene-resolver convert Actb Gapdh --to-type ensembl --from-type symbol

Deprecated gene coverage:

  • Human: 58,083 mappings from HGNC
  • Mouse: 77,100 mappings from MGI (Mouse Genome Informatics)
  • Rat: 10,751 mappings from RGD (Rat Genome Database)

Each species automatically downloads and uses its specific gene history database.

Database Updates

Keep your gene mappings current with the latest Ensembl releases:

# Check for updates
gene-resolver update --check

# Update to latest release
gene-resolver update

# Update to specific release
gene-resolver update --release 115

# Update mouse database
gene-resolver update --species mus_musculus

Updates are safe - your current database is backed up automatically before updating.

Ambiguity Resolution

When genes map to multiple locations, you decide what to do:

# Strategy 1: Prefer protein-coding genes (recommended)
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy primary

# Strategy 2: Return all matches for manual review
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy all

# Strategy 3: Use first match found
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy first

# Strategy 4: Treat as failure
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy fail

File Processing

Process entire gene lists from CSV, TSV, or plain text files:

# From a text file (one gene per line)
gene-resolver convert-file genes.txt --output results.csv

# From a CSV (specify column)
gene-resolver convert-file data.csv --column 0 --output results.csv

# With custom settings
gene-resolver convert-file genes.txt \
    --from-type symbol \
    --to-type ensembl \
    --genome-build hg38 \
    --ambiguity-strategy primary \
    --output results.csv

Genome Build Support

  • Human: hg38/GRCh38, hg19/GRCh37
  • Mouse: GRCm39, GRCm38
  • Rat: Rnor_6.0
gene-resolver convert Tp53 --genome-build GRCm39 --to-type ensembl

Multi-Species Support

Work with human, mouse, or rat genes - each species has its own optimized database:

# Initialize databases for different species
gene-resolver init --species homo_sapiens --release 109  # Human (default)
gene-resolver init --species mus_musculus --release 109  # Mouse
gene-resolver init --species rattus_norvegicus --release 109  # Rat

# Convert mouse genes
gene-resolver init --species mus_musculus --data-dir ./mouse_data
gene-resolver convert Actb Gapdh --genome-build GRCm39 \
    --data-dir ./mouse_data --to-type ensembl

Python API:

# Work with mouse genes
mouse_resolver = GeneResolver(Path("./mouse_data"))
mouse_resolver.initialize_database(species="mus_musculus", release="109")

result = mouse_resolver.convert(
    gene_ids=["Actb", "Gapdh"],
    from_type="symbol",
    to_type="ensembl",
    genome_build="GRCm39"
)

Database Updates

Keep your gene annotations up-to-date with Ensembl's latest releases:

# Check for available updates
gene-resolver update --check

# Update to latest Ensembl release
gene-resolver update

# Update to specific release
gene-resolver update --release 115

# Update mouse database
gene-resolver update --species mus_musculus --data-dir ./mouse_data

Python API:

# Check for updates
update_info = resolver.check_for_updates()
print(f"Current: Ensembl {update_info['current']['ensembl_release']}")

# Perform update
success = resolver.update_database(target_release="115")

Note: Updates download new Ensembl data (~100MB) and rebuild the database. Your current database is automatically backed up with a .backup extension.

Database Information

The tool uses Ensembl annotations (release 109+, auto-updatable) with comprehensive deprecated gene support:

Gene Coverage:

  • Human: 62,710 genes (GRCh38) + 58,083 deprecated mappings (HGNC)
  • Mouse: 57,010 genes (GRCm39) + 77,100 deprecated mappings (MGI)
  • Rat: 30,560 genes (mRatBN7.2) + 10,751 deprecated mappings (RGD)

Total: 145,934 deprecated gene mappings across all species

Storage & Performance:

  • Database: ./data/genes.db (~18 MB per species)
  • Gene history: ./data/downloads/gene_history_*.txt.gz (1-14 MB per species)
  • Downloads cached locally - no repeated downloads
  • Offline operation after initialization
  • Update to latest Ensembl releases anytime

Advanced Usage

Python: Batch Processing

from pathlib import Path
from gene_id_resolver.core.resolver_enhanced import EnhancedGeneResolver

# Enhanced resolver with auto-correction
resolver = EnhancedGeneResolver(Path("./data"))

# Convert with automatic deprecated gene correction
result = resolver.convert_with_correction(
    gene_ids=["TP53", "SEPT4", "BRCA1"],
    from_type="symbol",
    to_type="ensembl",
    genome_build="hg38",
    ambiguity_strategy="primary"
)

# Check which genes were auto-corrected
if hasattr(result, 'corrections_applied'):
    for old, new in result.corrections_applied.items():
        print(f"Corrected: {old}{new}")

resolver.close()

Python: Detailed Results

# Examine successful conversions
for gene_id, mapping in result.successful.items():
    print(f"Gene: {gene_id}")
    print(f"  Ensembl ID: {mapping.identifiers.ensembl_id}")
    print(f"  Symbol: {mapping.identifiers.gene_symbol}")
    print(f"  Entrez ID: {mapping.identifiers.entrez_id}")
    print(f"  Biotype: {mapping.biotype}")
    print(f"  Location: {mapping.chromosome}:{mapping.start}-{mapping.end}")

# Check ambiguous genes
for gene_id, mappings in result.ambiguous.items():
    print(f"\n{gene_id} has {len(mappings)} possible matches:")
    for i, mapping in enumerate(mappings):
        print(f"  {i+1}. {mapping.identifiers.ensembl_id} ({mapping.biotype})")

# Examine failures
for failed_gene in result.failed:
    resolution = result.ambiguity_resolutions.get(failed_gene, "not found")
    print(f"Failed: {failed_gene} - {resolution}")

Use Cases

Cross-Species Comparative Studies

Work seamlessly across human, mouse, and rat genomes with species-specific deprecated gene handling.

Cancer Research

Convert gene lists from publications to your preferred ID system while tracking deprecated symbols.

Multi-Omics Integration

Ensure consistent gene identifiers across RNA-seq, proteomics, and methylation datasets.

Database Maintenance

Keep your gene annotations current with automatic Ensembl updates - no manual downloads needed.

Reproducible Pipelines

Version-controlled annotations mean your conversions are reproducible across time and platforms.

Quality Control

Audit trails show exactly which genes failed conversion and why.

Technical Details

Built with:

  • Ensembl REST API and FTP (gene annotations)
  • SQLite (local database)
  • HGNC, MGI, RGD (species-specific gene history)
  • Python 3.8+ (pandas, click, tqdm)

Data sources:

  • Human: Ensembl + HGNC (Human Genome Organisation)
  • Mouse: Ensembl + MGI (Mouse Genome Informatics)
  • Rat: Ensembl + RGD (Rat Genome Database)

Design principles:

  • Offline-first (no API rate limits)
  • Transparent failures (no silent drops)
  • Comprehensive testing (96.9% coverage)
  • Clean CLI and Python API

Contributing

Found a bug or have a feature request? Please open an issue on GitHub.

License

MIT License - see LICENSE file for details.

Citation

If you use this tool in your research, please cite:

Ahmad, T. (2025). gene-id-resolver: Production-grade gene ID conversion with deprecated gene support.
https://doi.org/10.5281/zenodo.17547077

BibTeX:

@software{ahmad2025geneidresolver,
  author       = {Ahmad, Taha},
  title        = {gene-id-resolver: Production-grade gene ID conversion with deprecated gene support},
  year         = 2025,
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.17547077},
  url          = {https://doi.org/10.5281/zenodo.17547077}
}

Acknowledgments

  • Gene annotations from Ensembl
  • Deprecated gene mappings from HGNC
  • Inspired by the countless hours spent debugging gene ID mismatches

Developed by Taha Ahmad

  • Bioinformatics-optimized .gitignore
  • Modular package structure
  • Core dependencies for data engineering phase"

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gene_id_resolver-0.2.0.tar.gz (33.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gene_id_resolver-0.2.0-py3-none-any.whl (35.8 kB view details)

Uploaded Python 3

File details

Details for the file gene_id_resolver-0.2.0.tar.gz.

File metadata

  • Download URL: gene_id_resolver-0.2.0.tar.gz
  • Upload date:
  • Size: 33.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for gene_id_resolver-0.2.0.tar.gz
Algorithm Hash digest
SHA256 eee40ead4afbe0311316b27077c6ac41a07296093c5bd0216bce86b0ef156b4d
MD5 8873514c7625a95d9bb9f1f48a4d26dc
BLAKE2b-256 613acae367f1852d4f2ccaec4dd1789bd00b503c5b10733178d127d3703ffa79

See more details on using hashes here.

File details

Details for the file gene_id_resolver-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for gene_id_resolver-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3772af561901e2f81a19d07ec0e145e0e205d8957e166b33e4c9b48372c990fb
MD5 f1fe8e408367d59614bed89b53a6c7d0
BLAKE2b-256 4e6399bdf18071c1b5430149091761f87c06ddb77f08594550142ad1ae3e5881

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page