nexusLIMS 2.0.0a3

Electron Microscopy Nexus LIMS project (Datasophos fork)

NexusLIMS - Automated Laboratory Information Management for Electron Microscopy

⚠️ Notice: This is a fork of the original NexusLIMS project, created after the lead developer (@jat255) left NIST and founded Datasophos. This fork is maintained by Datasophos and is not affiliated with NIST in any way. For the official NIST version, please visit the original repository.

What is NexusLIMS?

NexusLIMS automatically generates experimental records by extracting metadata from microscopy data files and harvesting information from laboratory calendar systems.

Originally developed by the NIST Office of Data and Informatics, NexusLIMS transforms raw microscopy data into structured, searchable experimental records without requiring manual data entry. By combining file metadata extraction with reservation calendar information, NexusLIMS creates comprehensive documentation of microscopy sessions automatically.

Key Features

• 🔄 Automated Record Generation - Builds XML experimental records conforming to the "Nexus Experiment" schema
• 📊 Multi-Format Metadata Extraction - Supports .dm3/.dm4 (DigitalMicrograph), .tif (FEI/Thermo), .ser/.emi (FEI TIA), and more
• 📅 Calendar Integration - Harvests experimental context from NEMO laboratory management system
• 🔍 Intelligent File Clustering - Groups files into logical acquisition activities using temporal analysis
• 🖼️ Preview Generation - Automatically creates thumbnail images for quick visual reference
• 🌐 Web Interface - Integrates with NexusLIMS CDCS frontend for browsing and searching records

How It Works

1. Harvest - Monitor NEMO for new/ended instrument reservations
2. Discover - Find data files created during reservation windows
3. Extract - Pull metadata from various microscopy file formats
4. Cluster - Group files into logical acquisition activities
5. Build - Generate structured XML records
6. Publish - Upload to searchable web frontend

For more details, see the Record Building Workflow documentation.

Quick Start

Prerequisites

Install uv package manager (uv will automatically manage Python versions for you):

curl -LsSf https://astral.sh/uv/install.sh | sh

Installation

# Clone the repository
git clone https://github.com/datasophos/NexusLIMS.git
cd NexusLIMS

# Install dependencies
uv sync

Configuration

1. Copy the example environment file:

   cp .env.example .env
   

2. Edit .env with your settings:

   • CDCS frontend credentials and URL
   • File paths for data storage
   • NEMO API credentials (if using)
   • Database path

See Configuration Documentation for details.

Initialize Database

sqlite3 nexusLIMS.db < nexusLIMS/db/dev/NexusLIMS_db_creation_script.sql

Then add your instruments to the instruments table (see Database Documentation).

Build Records

# Run the record builder
uv run nexuslims-process-records

# Or use the module directly
uv run python -m nexusLIMS.builder.record_builder

Documentation

📚 Full documentation: https://datasophos.github.io/NexusLIMS

• Getting Started Guide
• User Guide
• Developer Guide
• API Reference

System Requirements

• Backend: Linux or macOS. Windows is not currently supported.
• Python: 3.11 or 3.12
• Network Access: Read-only access to centralized instrument data storage
• Calendar System: NEMO instance (or custom harvester implementation)
• Frontend: NexusLIMS CDCS instance for browsing and searching records (optional, but probably desired)

Current Limitations

NexusLIMS was originally developed for internal NIST use. While we're actively working on generalization:

• File Format Support: Currently supports specific electron microscopy formats. Custom extractors needed for other instruments.
• Calendar Integration: Designed for NEMO. Other systems require custom harvester implementation.
• Platform Support: Linux/macOS only. Windows support would require development effort.

Need help deploying at your institution? Datasophos offers professional services for NexusLIMS deployment, customization, and support. Contact us at [e-mail].

Development

# Install development dependencies
uv sync --dev

# Run tests
./scripts/run_tests.sh

# Run linting
./scripts/run_lint.sh

# Build documentation
./scripts/build_docs.sh

See the Developer Guide for detailed information about:

• Architecture overview
• Adding new file format extractors
• Creating custom harvesters
• Testing and CI/CD
• Release process

Contributing

We welcome contributions! Please:

1. Fork the repository
2. Create a feature branch
3. Make your changes with tests (100% coverage required)
4. Submit a pull request to main

See Contributing Guidelines for more details.

About the Logo

The NexusLIMS logo is inspired by Nobel Prize winner Dan Shechtman's groundbreaking work at NIST in the 1980s. Using transmission electron diffraction, Shechtman discovered quasicrystals - a new class of crystals that have regular structure and diffract, but are not periodic. This discovery overturned fundamental paradigms in crystallography.

We chose Shechtman's first published quasicrystal diffraction pattern as inspiration due to its significance in electron microscopy and its storied NIST heritage.

License

See LICENSE for details.

Support & Professional Services

💼 Need help with NexusLIMS? Datasophos offers:

• 🚀 Deployment & Integration - Expert configuration for your lab environment
• 🔧 Custom Development - Custom extractors, harvesters, and workflow extensions
• 🎓 Training & Support - Team onboarding and ongoing technical support

Contact: [e-mail] | datasophos.co

---

Links:

• 📖 Documentation
• 🐛 Issue Tracker
• 🏢 Datasophos
• 📜 Original NIST Repository