Skip to main content

Utilities for computing common accuracy metrics on cell tracking challenge solutions with ground truth

Project description

traccuracy: Evaluate Cell Tracking Solutions

License PyPI Python Version CI Benchmarking Documentation Status codecov

traccuracy provides a suite of benchmarking functions that can be used to evaluate cell tracking solutions against ground truth annotations. The goal of this library is to provide a convenient way to run rigorous evaluation and to document and consolidate the wide variety of metrics used in the field.

traccuracy can compute a comprehensive set of metrics for evaluating cell linking and division performance, and can compute biologically meaningful metrics such as the number of correctly reconstructed lineages over N frames and cell cycle length accuracy. As matching ground truth and predicted lineages is a crucial step for performing evaluation, traccuracy includes a number of algorithms for matching ground truth and predicted lineages, both with and without segmentation masks.

Learn more in the documentation or check out the source code.

Installation

pip install traccuracy

How It Works

The traccuracy library has three main components: loaders, matchers, and metrics.

Loaders load tracking graphs from other formats, such as the CTC format, into a TrackingGraph object. A TrackingGraph is a spatiotemporal graph backed by a networkx.DiGraph Nodes represent a single cell in a given time point, and are annotated with a time and a location. Edges point forward in time from a node representing a cell in time point t to the same cell or its daughter in frame t+1 (or beyond, to represent skip edges). Additional terminology is documented in the glossary To load TrackingGraphs from a custom format, you will likely need to implement a loader: see documentation here for more information. Alternatively you can initialize a TrackingGraph with a networkx.DiGraph and ArrayLike objects of segmentation masks if needed.

Matchers take a ground truth and a predicted TrackingGraph with optional segmentation masks and match the nodes and edges to allow evaluation to occur. A list of matchers is available here.

In order to compute metrics, traccuracy begins by annotating the matched graphs with error flags such as False Positive and False Negative. The annotated graph can be exported and used for visualization in other tools. Finally, metrics inspect the error annotations to report both error counts and summary statistics.

The traccuracy library has a flexible Python API, shown in this example notebook. Additionally there is a command line interface for running standard CTC metrics, documented here.

from traccuracy.loaders import load_ctc_data
from traccuracy.matchers import PointMatcher
from traccuracy.metrics import DivisionMetrics, BasicMetrics

# Load data in TrackingGraph objects
gt_data = load_ctc_data(
    "path/to/GT/TRA",
    "path/to/GT/TRA/man_track.txt",
    name="GT"
)
pred_data = load_ctc_data(
    "path/to/prediction",
    "path/to/prediction/track.txt",
    name="prediction"
)

results, matched = run_metrics(
    gt_data=gt_data,
    pred_data=pred_data,
    matcher=PointMatcher(),
    metrics=[DivisionMetrics(), BasicMetrics()]
)

Implemented Metrics

Featured Works

If you use traccuracy in your own work, please let us know so that we can feature it here!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

traccuracy-0.4.3.tar.gz (1.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

traccuracy-0.4.3-py3-none-any.whl (69.3 kB view details)

Uploaded Python 3

File details

Details for the file traccuracy-0.4.3.tar.gz.

File metadata

  • Download URL: traccuracy-0.4.3.tar.gz
  • Upload date:
  • Size: 1.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for traccuracy-0.4.3.tar.gz
Algorithm Hash digest
SHA256 a1b9b5f1a56248a48ff0ed18456fb26e60b0d7142606a401c9878e30e7d753ef
MD5 502ef7564997d9873d2a3df012628e21
BLAKE2b-256 30cdc31a16d65abdb1c4a43f9f348084cc5a72ef76a7c77107baa36ef9725c48

See more details on using hashes here.

File details

Details for the file traccuracy-0.4.3-py3-none-any.whl.

File metadata

  • Download URL: traccuracy-0.4.3-py3-none-any.whl
  • Upload date:
  • Size: 69.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for traccuracy-0.4.3-py3-none-any.whl
Algorithm Hash digest
SHA256 422275d8607b409985f8448234167b19f660899ee05a4467a3e8fad9716c630f
MD5 e225b378cf505a98a76da1c8f2232e52
BLAKE2b-256 b549860f4666cb46e0e8d4cc0ea292620cd7477fe85bb0ce1ae5e11b5ce31670

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page