BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models
Project description
BoxMOT gives you one CLI and one Python API for running, evaluating, tuning, and exporting modern multi-object tracking pipelines. Swap trackers without rewriting your detector stack, reuse cached detections and embeddings across experiments, and benchmark locally on MOT-style datasets.
Installation • Metrics • CLI • Python API • Detection Layouts • Examples • Contributing
Why BoxMOT
- One interface for
track,generate,eval,tune, andexport. - Works with detection, segmentation, and pose models as long as they emit boxes.
- Supports both motion-only trackers and motion + appearance trackers.
- Reuses saved detections and embeddings to speed up repeated evaluation and tuning.
- Handles both AABB and OBB detection layouts natively.
- Includes local benchmarking workflows for MOT17, MOT20, and DanceTrack ablation splits.
Installation
BoxMOT supports Python 3.9 through 3.12.
pip install boxmot
boxmot --help
Benchmark Results (MOT17 ablation split)
| Tracker | Status | OBB | HOTA↑ | MOTA↑ | IDF1↑ | FPS |
|---|---|---|---|---|---|---|
| botsort | ✅ | ✅ | 69.418 | 78.232 | 81.812 | 12 |
| boosttrack | ✅ | ❌ | 69.253 | 75.914 | 83.206 | 13 |
| strongsort | ✅ | ❌ | 68.05 | 76.185 | 80.763 | 11 |
| deepocsort | ✅ | ❌ | 67.796 | 75.868 | 80.514 | 12 |
| bytetrack | ✅ | ✅ | 67.68 | 78.039 | 79.157 | 720 |
| hybridsort | ✅ | ❌ | 67.39 | 74.127 | 79.105 | 25 |
| ocsort | ✅ | ✅ | 66.441 | 74.548 | 77.899 | 890 |
| sfsort | ✅ | ✅ | 62.653 | 76.87 | 69.184 | 6000 |
Evaluation was run on the second half of the MOT17 training set because the validation split is not public and the ablation detector was trained on the first half. Results used pre-generated detections and embeddings with each tracker configured from its default repository settings.
CLI
BoxMOT provides a unified CLI with a simple syntax:
boxmot MODE [OPTIONS] [DETECTOR] [REID] [TRACKER]
Modes:
track run detector + tracker on webcam, images, videos, directories, or streams
generate precompute detections and embeddings for later reuse
eval benchmark on MOT-style datasets and apply optional postprocessing
tune optimize tracker hyperparameters with multi-objective search
export export ReID models to deployment formats
Use boxmot MODE --help for mode-specific flags.
Use --detector, --reid, and --tracker for explicit component selection. Legacy aliases such as --yolo-model, --reid-model, and --tracking-method are not supported.
Quick examples:
# Track a webcam feed
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker deepocsort --source 0 --show
# Track a video, draw trajectories, and save the result
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker botsort --source video.mp4 --show-trajectories --save
# Evaluate on the MOT17 ablation split with GBRC postprocessing
boxmot eval --benchmark mot17-ablation --tracker boosttrack --postprocessing gbrc --verbose
# Generate reusable detections and embeddings for a benchmark
boxmot generate --benchmark mot17-ablation
# Tune tracker hyperparameters on a benchmark
boxmot tune --benchmark mot17-ablation --tracker ocsort --n-trials 10
# Export a ReID model to ONNX and TensorRT with dynamic input
boxmot export --weights osnet_x0_25_msmt17.pt --include onnx --include engine --dynamic
Common --source values for track and direct-source generate runs include 0, img.jpg, video.mp4, path/, path/*.jpg, YouTube URLs, and RTSP / RTMP / HTTP streams.
For config-driven generate, eval, and tune runs:
--benchmark <benchmark>selects a benchmark config fromboxmot/configs/benchmarks/- the benchmark config selects its associated dataset config from
boxmot/configs/datasets/ - the benchmark config selects its associated detector profile from
boxmot/configs/detectors/ - the benchmark config selects its associated ReID profile from
boxmot/configs/reid/ --tracker <name>selects the tracker and loadsboxmot/configs/trackers/<name>.yaml
Example:
boxmot eval --benchmark mot17-ablation --tracker boosttrack
The benchmark config's associated dataset, detector, and ReID profiles are used automatically.
To override the benchmark's detector and ReID defaults explicitly:
boxmot eval --benchmark mot17-ablation --detector yolo11s_obb --reid lmbn_n_duke --tracker boosttrack
If you want to track only selected classes, pass a comma-separated list:
boxmot track --detector yolov8s --source 0 --classes 16,17
Python API
If you already have detections from your own model, call tracker.update(...) once per frame inside your video loop:
from pathlib import Path
import cv2
import numpy as np
from boxmot import BotSort
tracker = BotSort(
reid_weights=Path("osnet_x0_25_msmt17.pt"),
device="cpu",
half=False,
)
cap = cv2.VideoCapture("video.mp4")
while True:
ok, frame = cap.read()
if not ok:
break
# Replace this with your detector output for the current frame.
# AABB input: (N, 6) = (x1, y1, x2, y2, conf, cls)
# OBB input: (N, 7) = (cx, cy, w, h, angle, conf, cls)
detections = np.empty((0, 6), dtype=np.float32)
# detections = your_detector(frame)
tracks = tracker.update(detections, frame)
tracker.plot_results(frame, show_trajectories=True)
print(tracks)
# AABB output: (N, 8) = (x1, y1, x2, y2, id, conf, cls, det_ind)
# OBB output: (N, 9) = (cx, cy, w, h, angle, id, conf, cls, det_ind)
# Use det_ind to map a track back to the detector output
cv2.imshow("BoxMOT", frame)
if cv2.waitKey(1) & 0xFF == ord("q"):
break
cap.release()
cv2.destroyAllWindows()
For end-to-end detector integrations, see the notebooks in examples.
Detection Layouts
BoxMOT switches tracking mode from the detection tensor shape:
| Geometry | Input detections | Output tracks |
|---|---|---|
| AABB | (N, 6) = (x1, y1, x2, y2, conf, cls) |
(N, 8) = (x1, y1, x2, y2, id, conf, cls, det_ind) |
| OBB | (N, 7) = (cx, cy, w, h, angle, conf, cls) |
(N, 9) = (cx, cy, w, h, angle, id, conf, cls, det_ind) |
OBB-specific tracking paths are enabled automatically when OBB detections are provided. Current OBB-capable trackers: bytetrack, botsort, ocsort, and sfsort.
Examples
The short commands above are enough to get started. The sections below keep the longer recipe list available without turning the README into a wall of commands.
Tracking recipes
Track from common sources:
# Webcam
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker deepocsort --source 0 --show
# Video file
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker botsort --source video.mp4 --save
# Image directory
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker bytetrack --source path/to/images --save
# Stream or URL
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker ocsort --source 'rtsp://example.com/media.mp4'
# YouTube
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker boosttrack --source 'https://youtu.be/Zgi9g1ksQHc'
Detector backends
Swap detectors without changing the overall CLI:
# Ultralytics detection
boxmot track --detector yolov8n
boxmot track --detector yolo11n
# Segmentation and pose variants
boxmot track --detector yolov8n-seg
boxmot track --detector yolov8n-pose
# YOLOX
boxmot track --detector yolox_s
# RF-DETR
boxmot track --detector rf-detr-base
Tracker swaps
Use the same detector and ReID model while changing only the tracker:
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker deepocsort
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker strongsort
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker botsort
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker boosttrack
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker hybridsort
# Motion-only trackers
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker bytetrack
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker ocsort
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker sfsort
Filtering and visualization
Useful flags for inspection and debugging:
# Draw trajectories and show kalman filter predictions when track is lost
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker botsort --source video.mp4 --show-trajectories --show-kf-preds --save
# Track only selected classes
boxmot track --detector yolov8s --source 0 --classes 16,17
# Track each class independently
boxmot track --detector yolov8n --source video.mp4 --per-class --save
# Highlight one target ID
boxmot track --detector yolov8n --reid osnet_x0_25_msmt17 --tracker deepocsort --source video.mp4 --target-id 7 --show
Evaluation and tuning
Benchmark on built-in MOT-style dataset shortcuts:
# Reproduce README-style MOT17 results
boxmot eval --benchmark mot17-ablation --tracker boosttrack --verbose
# MOT20 ablation split
boxmot eval --benchmark mot20-ablation --tracker boosttrack --verbose
# DanceTrack ablation split
boxmot eval --benchmark dancetrack-ablation --tracker boosttrack --verbose
# VisDrone ablation split
boxmot eval --benchmark visdrone-ablation --tracker botsort --verbose
# Apply postprocessing
boxmot eval --benchmark mot17-ablation --tracker boosttrack --postprocessing gsi
boxmot eval --benchmark mot17-ablation --tracker boosttrack --postprocessing gbrc
# Generate detections and embeddings once for a benchmark
boxmot generate --benchmark mot17-ablation
# Generate detections and embeddings for a direct dataset path
boxmot generate --detector yolov8n --reid osnet_x0_25_msmt17 --source ./assets/MOT17-mini/train
# Tune on a built-in benchmark config
boxmot tune --benchmark mot17-ablation --tracker boosttrack --n-trials 9
# Tune a tracker with explicit detector/ReID overrides
boxmot tune --benchmark mot17-ablation --detector yolo11s_obb --reid lmbn_n_duke --tracker botsort --n-trials 9
Export and OBB
Deployment and oriented-box examples:
# Export to ONNX
boxmot export --weights osnet_x0_25_msmt17.pt --include onnx --device cpu
# Export to OpenVINO
boxmot export --weights osnet_x0_25_msmt17.pt --include openvino --device cpu
# Export to TensorRT with dynamic input
boxmot export --weights osnet_x0_25_msmt17.pt --include engine --device 0 --dynamic
OBB references:
- Notebook: examples/det/obb.ipynb
- OBB-capable trackers:
bytetrack,botsort,ocsort,sfsort
Contributing
If you want to contribute, start with CONTRIBUTING.md.
Contributors
Support and Citation
- Bugs and feature requests: GitHub Issues
- Questions and discussion: GitHub Discussions or Discord
- Citation metadata: CITATION.cff
- Commercial support:
box-mot@outlook.com
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file boxmot-17.0.0.tar.gz.
File metadata
- Download URL: boxmot-17.0.0.tar.gz
- Upload date:
- Size: 9.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f0ff22bd86a802d0542a0326a10effb79bed40782b40b35831541eb87cb63d26
|
|
| MD5 |
a427e8a757ac52b0e529fddea8a9c4cd
|
|
| BLAKE2b-256 |
3e586f8b13af7976eb814ac5882f7f9963e23ef59e7b853d1f4d36b54313487e
|
File details
Details for the file boxmot-17.0.0-py3-none-any.whl.
File metadata
- Download URL: boxmot-17.0.0-py3-none-any.whl
- Upload date:
- Size: 1.7 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
41c868434aabd53a8854537cddabe02823656a452fb9cee61bc0e5d9a25c5cc7
|
|
| MD5 |
d6f75177f0a4741ffd1566265ea61c5c
|
|
| BLAKE2b-256 |
495f63aabf621351e04769d2cc526e534378c3c8c859df5198e9ec71832ad47d
|