Evaluation of two stereo matchers on long real-world video sequences


by Shin, B-S, Caudillo, D and Klette, R
Abstract:
The paper evaluates iterative semi-global matching (iSGM) and linear belief-propagation matching (linBPM), both using a census data-cost function, which are two of the currently top-ranked stereo matchers. The evaluation is on long real-world video sequences where disparity ground-truth is not available. The paper applies two alternative (or mutually supporting) techniques for performance evaluation: the previously known third-eye method, and a few new data measures on video sequences. The main contribution of the paper is on answering the questions, how to evaluate stereo matchers on long real-world sequences if disparity ground truth is not available, and how to compare evaluation measures relatively to each other. The two stereo matchers used are illustrating the discussed evaluation measures; they could be replaced by other matchers, but evaluation results for those two matchers are also of interest on its own, by illustrating correlations in the behavior of those two basically very different matchers (defined by dynamic programming or by belief propagation optimization, respectively) on data sequences recorded in different traffic situations.
Reference:
Evaluation of two stereo matchers on long real-world video sequences (Shin, B-S, Caudillo, D and Klette, R), In Pattern Recognition, Elsevier Ltd, volume 48, 2015.
Bibtex Entry:
@article{shin2015evaluationsequences,
author = "Shin, B-S and Caudillo, D and Klette, R",
journal = "Pattern Recognition",
month = "Apr",
pages = "1109--1120",
publisher = "Elsevier Ltd",
title = "Evaluation of two stereo matchers on long real-world video sequences",
volume = "48",
year = "2015",
abstract = "The paper evaluates iterative semi-global matching (iSGM) and linear belief-propagation matching (linBPM), both using a census data-cost function, which are two of the currently top-ranked stereo matchers. The evaluation is on long real-world video sequences where disparity ground-truth is not available. The paper applies two alternative (or mutually supporting) techniques for performance evaluation: the previously known third-eye method, and a few new data measures on video sequences. The main contribution of the paper is on answering the questions, how to evaluate stereo matchers on long real-world sequences if disparity ground truth is not available, and how to compare evaluation measures relatively to each other. The two stereo matchers used are illustrating the discussed evaluation measures; they could be replaced by other matchers, but evaluation results for those two matchers are also of interest on its own, by illustrating correlations in the behavior of those two basically very different matchers (defined by dynamic programming or by belief propagation optimization, respectively) on data sequences recorded in different traffic situations.",
doi = "10.1016/j.patcog.2014.04.011",
issn = "0031-3203",
issue = "4",
keyword = "Belief-propagation matching",
keyword = "Data measures",
keyword = "Performance evaluation",
keyword = "Semi-global matching",
keyword = "Stereo vision",
keyword = "Third-eye method",
language = "eng",
pii = "S0031320314001563",
day = "1",
}