Analysis of Disparity Maps for Detecting Saliency in Stereoscopic Video

Kopf, Stephan ; Guthier, Benjamin ; Schaber, Philipp ; Dittrich, Torben ; Effelsberg, Wolfgang

Vorschau

PDF
Kopf_2013c.pdf - Veröffentlichte Version
Download (10MB)

URL:	https://ub-madoc.bib.uni-mannheim.de/33093
URN:	urn:nbn:de:bsz:180-madoc-330935
Dokumenttyp:	Arbeitspapier
Erscheinungsjahr:	2013
Titel einer Zeitschrift oder einer Reihe:	Technical Reports
Band/Volume:	13-003
Ort der Veröffentlichung:	Mannheim
Sprache der Veröffentlichung:	Englisch
Einrichtung:	Fakultät für Wirtschaftsinformatik und Wirtschaftsmathematik > Praktische Informatik IV (Effelsberg 1989-2017)
MADOC-Schriftenreihe:	Veröffentlichungen der Fakultät für Mathematik und Informatik > Institut für Informatik > Technical Reports
Fachgebiet:	004 Informatik
Freie Schlagwörter (Englisch):	Video saliency , depth saliency , disparity maps , visual attention , stereoscopic video
Abstract:	We present a system for automatically detecting salient image regions in stereoscopic videos. This report extends our previous system and provides additional details about its implementation. Our proposed algorithm considers information based on three dimensions: salient colors in individual frames, salient information derived from camera and object motion, and depth saliency. These three components are dynamically combined into one final saliency map based on the reliability of the individual saliency detectors. Such a combination allows using more efficient algorithms even if the quality of one detector degrades. For example, we use a computationally efficient stereo correspondence algorithm that might cause noisy disparity maps for certain scenarios. In this case, however, a more reliable saliency detection algorithm such as the image saliency is preferred. To evaluate the quality of the saliency detection, we created modified versions of stereoscopic videos with the non-salient regions blurred. Having users rate the quality of these videos, the results show that most users do not detect the blurred regions and that the automatic saliency detection is very reliable.