isomap-desktop 0.2.0

Isotopic and paleoecological data standardisation middleware

IsoMap

Isotopic and paleoecological data standardisation middleware.

IsoMap is an open-source desktop application that automates the standardisation, validation, and export of legacy isotopic and paleoecological datasets for submission to centralised repositories (Neotoma, IsoArcH, PANGAEA, NOAA NCEI, LiPD).

📖 User Guide — full walkthrough with screenshots, workflow steps, and troubleshooting. 📋 Changelog — version history and release notes.

Features

IsoMap provides a 6-tab wizard interface backed by 8 processing engines:

• Import Engine: CSV and Excel spreadsheets with automatic encoding detection and type inference.
• Column Mapping Engine: 6-stage fallback pipeline (exact → preferences → fuzzy → semantic embeddings → Valentine ensemble → distribution profiling) to accurately map source columns to 5 target repository schemas.
• Chronology Engine: Auto-detects and normalises uncalibrated/calibrated dates to cal_BP with 1950 CE anchor.
• Spatial Verification Engine: Cleans coordinates, displays on interactive Leaflet map, exports bounding box.
• Validation Engine: Pandera constraint checking with row-level error tracking against schema definitions.
• Export Engine: 9 output formats — CSV, Excel, GeoJSON (Neotoma), IsoArcH JSON, LiPD, PANGAEA, NOAA NCEI, RO-Crate, LaTeX data paper.
• Provenance Engine: PROV-O traceability for reproducible data lineage.
• Automated Data Papers: Jinja2 ESSD-compliant LaTeX manuscript generation.

Technology Stack

Layer	Technology
Desktop shell	Tauri v2 (Rust)
Frontend	React 19, Vite 7, TypeScript, Leaflet
Backend (sidecar)	Python 3.12+, Pandas, Pandera, GeoPandas
ML/NLP	SciBERT ONNX (Optimum), RapidFuzz, Valentine
Testing	Pytest (backend), Playwright (E2E)

Getting Started

Prerequisites

• Rust 1.70+ — rustup.rs
• Python 3.12+ — pip install -e ".[dev]"
• Node.js 20+ with npm

Development

cd ui && npm install        # Frontend dependencies
npm run tauri dev           # Full desktop app with hot-reload
npm run dev                 # Vite frontend only (no Tauri)
cd src-tauri && cargo build # Rust backend only

Testing

pytest tests/               # Python backend (36 tests)
cd ui && npx playwright test # E2E browser tests (6 tests)

Production Build

./scripts/build-sidecar.sh  # PyInstaller standalone binary
cd ui && npm run tauri build # Full desktop app bundle

Bundles output to ui/src-tauri/target/release/bundle/.

Supported Repositories

Schema	Repository	Fields	Required Fields
neotoma_v2	Neotoma	11	SiteName, Latitude, Longitude, TaxonName, Value
isoarch_v1	IsoArcH	10	site_name, latitude, longitude, sample_id, material, d13c
pangaea	PANGAEA	20	Event, Latitude, Longitude, Parameter, Value, Unit
noaa	NOAA NCEI	24	SiteName, Latitude, Longitude, Proxy, Proxy_Value, Proxy_Unit
lipd	LiPD v1.3	24	dataSetName, SiteName, Latitude, Longitude, PaleoData_VariableName, PaleoData_Value, PaleoData_Unit

Add custom schemas in data/schemas/ following the JSON Schema format.

Architecture

React invoke() → Rust Tauri commands → sidecar_rpc() → shell wrapper → Python JSON-RPC

The Rust layer (ui/src-tauri/src/lib.rs) exposes 9 Tauri commands that serialise parameters to JSON-RPC and forward them to the Python sidecar (src/isomap/main.py) via stdin/stdout. The sidecar processes the request and returns a JSON-RPC response.

Key Files

File	Purpose
ui/src-tauri/src/lib.rs	9 Tauri commands + sidecar_rpc() JSON-RPC helper
ui/src-tauri/tauri.conf.json	App config, window, sidecar external binary
ui/src-tauri/binaries/isomap-sidecar*	Platform-specific sidecar wrappers
src/isomap/main.py	Python JSON-RPC server (stdin/stdout or CLI mode)
ui/src/api/sidecar.ts	Frontend API layer (invoke() calls)
ui/src/App.tsx	Main React app with shared wizard state
data/schemas/*.json	Repository schema definitions
scripts/build-sidecar.sh	PyInstaller sidecar binary builder

License

MIT