caliscope 0.7.0

GUI based multicamera calibration that integrates with 2D landmark tracking to triangulate 3D landmark positions

Caliscope

Multicamera Calibration for Research Workflows

Caliscope is a permissively licensed multicamera calibration tool for markerless motion capture workflows. It allows visual assessment and detailed quality metrics at each stage of the calibration workflow to allow high quality output. The approach to initializing parameters for bundle adjustment allows rapid and reliable calibration.

Demo

https://github.com/user-attachments/assets/037c6237-0955-41e2-979e-a4247f7677e6

Quick Start

Installation instructions are in the docs.

For a walkthrough with test data after installing, see the sample project.

---

Features

Calibration

• ChArUco, ArUco, and chessboard calibration targets
• Automated intrinsic calibration from video with distortion model visualization
• Pairwise extrinsic initialization for reliable bundle adjustment across 3+ cameras
• Mirror board support for camera arrangements where no single board position is visible to all cameras
• 3D visualizer for inspecting camera positions and setting the world origin
• Reprojection error display and outlier filtering after optimization
• Exports camera_array.toml (native) and camera_array_aniposelib.toml for use with aniposelib-compatible tools

Tracking and Reconstruction

• Built-in MediaPipe trackers (Hands, Pose, Holistic)
• ONNX model support for custom pose estimators exported from SLEAP, DeepLabCut, RTMPose, and other frameworks
• Output in CSV and TRC (OpenSim) formats

Community & Support

To report a bug or request a feature, please open an issue. For questions, post in Discussions. This is an open-source project supported by volunteer effort.

Acknowledgments

This project was inspired by FreeMoCap (FMC), which is spearheaded by Jon Matthis, PhD of the HuMoN Research Lab. The FMC calibration and triangulation system is built upon Anipose, created by Lili Karushchek, PhD. Caliscope was originally envisioned as an alternative calibration tool to Anipose that would allow more granular estimation and visual feedback. Several lines of the original Anipose triangulation code are used in this code base, though it was otherwise written from the ground up.

License

Caliscope is licensed under the permissive BSD 2-Clause license. The triangulation function was adapted from the Anipose code base which is also licensed under the BSD-2 Clause.