Bucketed Scene Flow Evaluation
Project description
Bucketed Scene Flow Evaluation
This repo provides:
- A speed and class aware evaluation protocol called Bucketed Scene Flow Evaluation
- A standardized interface for working with Scene Flow datasets.
Currently supported datasets:
- Argoverse 2 (Human Labeled and NSFP Pseudolabeled)
- Waymo Open
The Bucketed Scene Flow Evaluation protocol
The Bucketed Scene Flow Evaluation protocol is designed to quantitatively measure the failure of state-of-the-art scene flow methods to properly capture motion on smaller objects. In the Autononous Vehicle domain, SotA methods almost universially fail on important objects like Pedestrians and Bicyclists. As part of organizing the community around addressing these issues, the Argoverse 2 2024 Scene Flow Challenge uses this protocol to evaluate submissions. More details about the protocol can be found in the challenge blogpost.
Installation
pip install bucketed-scene-flow-eval
Setup
Follow our Getting Started for setup instructions.
Demo
We provide a demo script which shows off the various features of the API.
To run with Argoverse 2:
python scripts/demo.py --dataset Argoverse2SceneFlow --root_dir /efs/argoverse2/val/
To run with Waymo Open:
python scripts/demo.py --dataset WaymoOpenSceneFlow --root_dir /efs/waymo_open_processed_flow/validation/
Evaluating AV2 flow submissions
To evaluate an AV2 Scene Flow challenge entry named ./submission_val.zip
against validation dataset masks /efs/argoverse2/val_official_masks.zip
, run
python scripts/av2_eval.py /efs/argoverse2/val /efs/argoverse2/val_official_masks.zip ./submission_val.zip
Documentation
See docs/
for more documentation .
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for bucketed_scene_flow_eval-1.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0947f80a347f7f17a9fe5bc6d9645fb5e5db39d7a4d152c4fa347af8f3d9fcf5 |
|
MD5 | bd3f6806420e6988c41915cef7d9b5d5 |
|
BLAKE2b-256 | c8159736dddf657462849bb7fb1290e64a223be44885c7f8d6081ed70271da10 |
Hashes for bucketed_scene_flow_eval-1.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bbe6704b0c943b7f8869ef02045e859ba655e7f9324aaac5901277cd44c3cdc1 |
|
MD5 | a96cfb3506d2b9de3666160c81193374 |
|
BLAKE2b-256 | 11b7869b169da605e0fb6f043f8540fa83c7acc7b36b9c24095333d326d1d53e |