Production-grade gene ID conversion tool with multi-species support and auto-updates
Project description
gene-id-resolver
Convert gene IDs without the headaches.
Handle deprecated symbols, ambiguous mappings, and silent failures transparently. Know exactly what happened to every gene in your list.
Born from the frustration of inconsistent gene mappings
Key Features:
- ✅ Multi-species support: Human, mouse, and rat genomes
- ✅ Comprehensive deprecated gene handling: 145,000+ mappings (HGNC, MGI, RGD)
- ✅ Smart ambiguity resolution (don't silently drop genes)
- ✅ Database updates: Stay current with latest Ensembl releases
- ✅ Offline operation (no API limits, cached downloads)
- ✅ Full audit trail (know why conversions fail)
- ✅ Works with TSV, CSV, and plain text files
Installation
pip install gene-id-resolver
Quick Start
Command line:
# One-time setup
gene-resolver init
# Convert genes
gene-resolver convert TP53 BRCA1 EGFR --to-type ensembl
Python API:
from pathlib import Path
from gene_id_resolver.core.resolver import GeneResolver
resolver = GeneResolver(Path("./data"))
result = resolver.convert(
gene_ids=["TP53", "BRCA1", "SEPT4"],
from_type="symbol",
to_type="ensembl",
genome_build="hg38"
)
print(f"Converted: {len(result.successful)} genes")
for gene, mapping in result.successful.items():
print(f"{gene} → {mapping.identifiers.ensembl_id}")
Why This Tool?
If you've ever spent hours tracking down why your gene list shrank after ID conversion, or discovered that "MEF2C" maps to multiple Ensembl IDs, this tool is for you. Gene ID conversion seems simple until you encounter:
- Deprecated symbols (SEPT4 → SEPTIN4, ENO1L1 → ENO1)
- Ambiguous genes (genes with multiple genomic locations)
- Silent failures (tools that drop genes without telling you why)
- Reproducibility issues (different tools, different results)
This tool handles all these cases transparently, so you know exactly what happened to every gene in your list.
Detailed Usage
Command Line Interface
Initialize the database (one-time setup):
gene-resolver init
Convert gene IDs:
# Convert gene symbols to Ensembl IDs
gene-resolver convert TP53 BRCA1 EGFR --to-type ensembl
# Convert from a file
gene-resolver convert-file genes.txt --output results.csv
# Check database status
gene-resolver status
Python API
from pathlib import Path
from gene_id_resolver.core.resolver import GeneResolver
# Initialize resolver
resolver = GeneResolver(Path("./data"))
# Convert gene symbols to Ensembl IDs
result = resolver.convert(
gene_ids=["TP53", "BRCA1", "SEPT4"], # SEPT4 is deprecated
from_type="symbol",
to_type="ensembl",
genome_build="hg38",
ambiguity_strategy="primary"
)
# Check results
print(f"Successful: {len(result.successful)}")
print(f"Failed: {len(result.failed)}")
print(f"Ambiguous: {len(result.ambiguous)}")
# Get converted IDs
for gene, mapping in result.successful.items():
print(f"{gene} → {mapping.identifiers.ensembl_id}")
resolver.close()
Features
Deprecated Gene Handling
Automatically corrects outdated gene symbols:
gene-resolver convert SEPT4 ENO1L1 CDKN2 --to-type ensembl
# Auto-corrected: SEPT4 → SEPTIN4
# Auto-corrected: ENO1L1 → ENO1
# Auto-corrected: CDKN2 → CDKN2A
The tool uses HGNC's complete gene history dataset (58,000+ mappings) to handle symbol changes.
Multi-Species Support
Work with human, mouse, and rat genomes with species-specific deprecated gene support:
# Initialize mouse database
gene-resolver init --species mus_musculus
# Initialize rat database
gene-resolver init --species rattus_norvegicus --release 109
# Convert mouse genes
gene-resolver convert Actb Gapdh --to-type ensembl --from-type symbol
Deprecated gene coverage:
- Human: 58,083 mappings from HGNC
- Mouse: 77,100 mappings from MGI (Mouse Genome Informatics)
- Rat: 10,751 mappings from RGD (Rat Genome Database)
Each species automatically downloads and uses its specific gene history database.
Database Updates
Keep your gene mappings current with the latest Ensembl releases:
# Check for updates
gene-resolver update --check
# Update to latest release
gene-resolver update
# Update to specific release
gene-resolver update --release 115
# Update mouse database
gene-resolver update --species mus_musculus
Updates are safe - your current database is backed up automatically before updating.
Ambiguity Resolution
When genes map to multiple locations, you decide what to do:
# Strategy 1: Prefer protein-coding genes (recommended)
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy primary
# Strategy 2: Return all matches for manual review
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy all
# Strategy 3: Use first match found
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy first
# Strategy 4: Treat as failure
gene-resolver convert AMBIGUOUS_GENE --ambiguity-strategy fail
File Processing
Process entire gene lists from CSV, TSV, or plain text files:
# From a text file (one gene per line)
gene-resolver convert-file genes.txt --output results.csv
# From a CSV (specify column)
gene-resolver convert-file data.csv --column 0 --output results.csv
# With custom settings
gene-resolver convert-file genes.txt \
--from-type symbol \
--to-type ensembl \
--genome-build hg38 \
--ambiguity-strategy primary \
--output results.csv
Genome Build Support
- Human: hg38/GRCh38, hg19/GRCh37
- Mouse: GRCm39, GRCm38
- Rat: Rnor_6.0
gene-resolver convert Tp53 --genome-build GRCm39 --to-type ensembl
Multi-Species Support
Work with human, mouse, or rat genes - each species has its own optimized database:
# Initialize databases for different species
gene-resolver init --species homo_sapiens --release 109 # Human (default)
gene-resolver init --species mus_musculus --release 109 # Mouse
gene-resolver init --species rattus_norvegicus --release 109 # Rat
# Convert mouse genes
gene-resolver init --species mus_musculus --data-dir ./mouse_data
gene-resolver convert Actb Gapdh --genome-build GRCm39 \
--data-dir ./mouse_data --to-type ensembl
Python API:
# Work with mouse genes
mouse_resolver = GeneResolver(Path("./mouse_data"))
mouse_resolver.initialize_database(species="mus_musculus", release="109")
result = mouse_resolver.convert(
gene_ids=["Actb", "Gapdh"],
from_type="symbol",
to_type="ensembl",
genome_build="GRCm39"
)
Database Updates
Keep your gene annotations up-to-date with Ensembl's latest releases:
# Check for available updates
gene-resolver update --check
# Update to latest Ensembl release
gene-resolver update
# Update to specific release
gene-resolver update --release 115
# Update mouse database
gene-resolver update --species mus_musculus --data-dir ./mouse_data
Python API:
# Check for updates
update_info = resolver.check_for_updates()
print(f"Current: Ensembl {update_info['current']['ensembl_release']}")
# Perform update
success = resolver.update_database(target_release="115")
Note: Updates download new Ensembl data (~100MB) and rebuild the database. Your current database is automatically backed up with a
.backupextension.
Database Information
The tool uses Ensembl annotations (release 109+, auto-updatable) with comprehensive deprecated gene support:
Gene Coverage:
- Human: 62,710 genes (GRCh38) + 58,083 deprecated mappings (HGNC)
- Mouse: 57,010 genes (GRCm39) + 77,100 deprecated mappings (MGI)
- Rat: 30,560 genes (mRatBN7.2) + 10,751 deprecated mappings (RGD)
Total: 145,934 deprecated gene mappings across all species
Storage & Performance:
- Database:
./data/genes.db(~18 MB per species) - Gene history:
./data/downloads/gene_history_*.txt.gz(1-14 MB per species) - Downloads cached locally - no repeated downloads
- Offline operation after initialization
- Update to latest Ensembl releases anytime
Advanced Usage
Python: Batch Processing
from pathlib import Path
from gene_id_resolver.core.resolver_enhanced import EnhancedGeneResolver
# Enhanced resolver with auto-correction
resolver = EnhancedGeneResolver(Path("./data"))
# Convert with automatic deprecated gene correction
result = resolver.convert_with_correction(
gene_ids=["TP53", "SEPT4", "BRCA1"],
from_type="symbol",
to_type="ensembl",
genome_build="hg38",
ambiguity_strategy="primary"
)
# Check which genes were auto-corrected
if hasattr(result, 'corrections_applied'):
for old, new in result.corrections_applied.items():
print(f"Corrected: {old} → {new}")
resolver.close()
Python: Detailed Results
# Examine successful conversions
for gene_id, mapping in result.successful.items():
print(f"Gene: {gene_id}")
print(f" Ensembl ID: {mapping.identifiers.ensembl_id}")
print(f" Symbol: {mapping.identifiers.gene_symbol}")
print(f" Entrez ID: {mapping.identifiers.entrez_id}")
print(f" Biotype: {mapping.biotype}")
print(f" Location: {mapping.chromosome}:{mapping.start}-{mapping.end}")
# Check ambiguous genes
for gene_id, mappings in result.ambiguous.items():
print(f"\n{gene_id} has {len(mappings)} possible matches:")
for i, mapping in enumerate(mappings):
print(f" {i+1}. {mapping.identifiers.ensembl_id} ({mapping.biotype})")
# Examine failures
for failed_gene in result.failed:
resolution = result.ambiguity_resolutions.get(failed_gene, "not found")
print(f"Failed: {failed_gene} - {resolution}")
Use Cases
Cross-Species Comparative Studies
Work seamlessly across human, mouse, and rat genomes with species-specific deprecated gene handling.
Cancer Research
Convert gene lists from publications to your preferred ID system while tracking deprecated symbols.
Multi-Omics Integration
Ensure consistent gene identifiers across RNA-seq, proteomics, and methylation datasets.
Database Maintenance
Keep your gene annotations current with automatic Ensembl updates - no manual downloads needed.
Reproducible Pipelines
Version-controlled annotations mean your conversions are reproducible across time and platforms.
Quality Control
Audit trails show exactly which genes failed conversion and why.
Technical Details
Built with:
- Ensembl REST API and FTP (gene annotations)
- SQLite (local database)
- HGNC, MGI, RGD (species-specific gene history)
- Python 3.8+ (pandas, click, tqdm)
Data sources:
- Human: Ensembl + HGNC (Human Genome Organisation)
- Mouse: Ensembl + MGI (Mouse Genome Informatics)
- Rat: Ensembl + RGD (Rat Genome Database)
Design principles:
- Offline-first (no API rate limits)
- Transparent failures (no silent drops)
- Comprehensive testing (96.9% coverage)
- Clean CLI and Python API
Contributing
Found a bug or have a feature request? Please open an issue on GitHub.
License
MIT License - see LICENSE file for details.
Citation
If you use this tool in your research, please cite:
Ahmad, T. (2025). gene-id-resolver: Production-grade gene ID conversion with deprecated gene support.
https://doi.org/10.5281/zenodo.17547077
BibTeX:
@software{ahmad2025geneidresolver,
author = {Ahmad, Taha},
title = {gene-id-resolver: Production-grade gene ID conversion with deprecated gene support},
year = 2025,
publisher = {Zenodo},
doi = {10.5281/zenodo.17547077},
url = {https://doi.org/10.5281/zenodo.17547077}
}
Acknowledgments
- Gene annotations from Ensembl
- Deprecated gene mappings from HGNC
- Inspired by the countless hours spent debugging gene ID mismatches
Developed by Taha Ahmad
- Bioinformatics-optimized .gitignore
- Modular package structure
- Core dependencies for data engineering phase"
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file gene_id_resolver-0.2.0.tar.gz.
File metadata
- Download URL: gene_id_resolver-0.2.0.tar.gz
- Upload date:
- Size: 33.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eee40ead4afbe0311316b27077c6ac41a07296093c5bd0216bce86b0ef156b4d
|
|
| MD5 |
8873514c7625a95d9bb9f1f48a4d26dc
|
|
| BLAKE2b-256 |
613acae367f1852d4f2ccaec4dd1789bd00b503c5b10733178d127d3703ffa79
|
File details
Details for the file gene_id_resolver-0.2.0-py3-none-any.whl.
File metadata
- Download URL: gene_id_resolver-0.2.0-py3-none-any.whl
- Upload date:
- Size: 35.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3772af561901e2f81a19d07ec0e145e0e205d8957e166b33e4c9b48372c990fb
|
|
| MD5 |
f1fe8e408367d59614bed89b53a6c7d0
|
|
| BLAKE2b-256 |
4e6399bdf18071c1b5430149091761f87c06ddb77f08594550142ad1ae3e5881
|