Lightning Pose is an end-to-end package designed for robust multi-view and single-view animal pose estimation using advanced transformer architectures. It leverages Multi-View Transformers and simulated occlusions to learn geometric relationships between views, resulting in strong performance on occlusions (Aharon, Whiteway et al., 2026). For single-view datasets it leverages temporal context and unsupervised losses for strong performance in challenging scenarios (Biderman, Whiteway et al. 2024, Nature Methods). It has a rich GUI that supports the end-to-end workflow: labeling, model management, and evaluation.
Below is a quick start guide; see the full documentation here.
Installation
Lightning Pose requires a Linux or WSL environment with an NVIDIA GPU. It has been tested on Ubuntu 18.04, 22.04, and 24.04 with Python versions 3.10-3.12.
For users without access to a local NVIDIA GPU, it is highly recommended to use the Lightning AI cloud environment, which provides a persistent, browser-based "Studio" with on-demand access to powerful GPUs and pre-configured CUDA environments.
Install dependencies:
sudo apt install ffmpeg
# Verify nvidia-driver with CUDA 12+
nvidia-smi
In a clean python virtual environment (conda or other virtual environment manager), run:
pip install lightning-pose lightning-pose-app
That's it! Installation should take 5-10 minutes depending on your internet connection. To run the app:
litpose run_app
Please see the installation guide for more detailed instructions, and feel free to reach out to us on Discord in case of any hiccups.
Getting Started
To get started with Lightning Pose, follow the guides on our documentation:
- Create your first project using the app
- Follow the CLI User Guides (Singleview, Multiview)
- Test out the API in the demo noteboook
Note that model training time will depend heavily on dataset size and GPU resources. Fitting a typical backbone (ResNet-50 or ViT-Small) on ~200 labeled frames will take about 20 minutes on a T4 GPU. See the publications linked above for more thorough benchmarking of training and inference times.
Community
The Lightning Pose team also actively develops the Ensemble Kalman Smoother (EKS), a simple and performant post-processor that works with any pose estimation package including Lightning Pose, DeepLabCut, and SLEAP.
Lightning Pose is primarily maintained by Karan Sikka (Columbia University) and Matt Whiteway (Columbia University).
Lightning Pose is under active development and we welcome community contributions. Whether you want to implement some of your own ideas or help out with our development roadmap, please get in touch with us on Discord (see contributing guidelines here).
Funding
We are grateful for support from the following:
- Gatsby Charitable Foundation GAT3708
- NIH R50NS145433
- NIH U19NS123716
- NSF 1707398
- The NSF AI Institute for Artificial and Natural Intelligence
- Simons Foundation
- Wellcome Trust 216324
- Zuckerman Institute (Columbia University) Team Science
2 maintainers
Metadata
2 maintainers
Release files for lightning-pose 2.4.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| lightning_pose-2.4.1.tar.gz | 201.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| lightning_pose-2.4.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 451.5 kB
Release files / lightning_pose-2.4.1.tar.gz
| Download URL | lightning_pose-2.4.1.tar.gz |
|---|---|
| Size | 201.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
915e720a86e9fb34c7551dac6695cbd194d36d76f8ba97f04f86387d0a45ad4c
|
|
BLAKE2b-256 checksum How to use checksums |
0d057a687265c5c11aeaa4de57253270effdaf2c9c501aeb1c77862008630aff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.4.1 CPython/3.11.16 Linux/6.17.0-1022-azure
|
Release files / lightning_pose-2.4.1-py3-none-any.whl
| Download URL | lightning_pose-2.4.1-py3-none-any.whl |
|---|---|
| Size | 250.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9a48fc7ce0d8662f6b0cec083254704f9b8c732b13b02672d51720b2b5dac88d
|
|
BLAKE2b-256 checksum How to use checksums |
b2eeb5e518de116879c352103be7925c06574944bd3c1ae8d0bd56478ad44d68
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.4.1 CPython/3.11.16 Linux/6.17.0-1022-azure
|
