ESTIMATING DISPARITY AND OCCLUSIONS IN STEREO VIDEO SEQUENCES

O.Williams, M.Isard and J.MacCormick

2005

We propose an algorithm for estimating disparity and occlusion in stereo video sequences. The algorithm defines a prior on sequences of disparity maps using a 3D Markov random field, and approximately computes the MAP estimate for the disparity sequence using loopy belief propagation. In contrast to previous work on temporal stereo, the algorithm (i) correctly models half-occlusionsscene points visible in one camera but not the other and (ii) enforces the so-called monotonicity constraint on the boundary of half-occluded regions. The algorithm is also able to exploit temporal coherence more appropriately than many previous approaches to temporal stereo, by employing additional states in the Markov random field. These additional states permit rudimentary motion estimation to be performed as part of the belief propagation, thus improving the quality of temporal inference. Parameters of the algorithm are learned from the ground truth disparities of a real stereo sequence. Qualitative results are shown on real sequences, including comparisons with competing approaches, and the performance of the algorithm is assessed quantitatively using the ground truth data.

(ftp:) williams_cvpr2005.pdf (http:) williams_cvpr2005.pdf

If you have difficulty viewing files that end `'.gz'`

,
which are gzip compressed, then you may be able to find
tools to uncompress them at the gzip
web site.

If you have difficulty viewing files that are in PostScript, (ending
`'.ps'`

or `'.ps.gz'`

), then you may be able to
find tools to view them at
the gsview
web site.

We have attempted to provide automatically generated PDF copies of documents for which only PostScript versions have previously been available. These are clearly marked in the database - due to the nature of the automatic conversion process, they are likely to be badly aliased when viewed at default resolution on screen by acroread.