Objectivization of Audio-Visual Correlation analysis

Bartosz Kunka; Bożena Kostek

Objectivization of Audio-Visual Correlation analysis

Abstrakt

Simultaneous perception of audio and visual stimuli often causes the concealment or misrepresentation of information actually contained in these stimuli. Such effects are called the ''image proximity effect'' or the ''ventriloquism effect'' in literature. Until recently, most research carried out to understand their nature was based on subjective assessments. The Authors of this paper propose a methodology based on both subjective and objectively retrieved data. In this methodology, objective data reflect what screen areas attract most attention. The data were collected and processed by the eye-gaze tracking system. To justify the proposed methodology, two series of experiments were conducted - one with a commercial eye-gaze tracking system Tobii T60, and another with the Cyber-Eye system developed at the Multimedia Systems Department of the Gdansk University of Technology. In most cases, the visual-auditory stimuli were presented using 3D video. It was found that the eye-gaze tracking system did objectivize the results of experiments. Moreover, the tests revealed a strong correlation between the localization of a visual stimulus on which a participant's gaze focused and the value of the "image proximity effect". It was also proved that gaze tracking may be useful in experiments which aim at the evaluation of the proximity effect when the presented visual stimuli is stereoscopic.

Autorzy (2)

Bartosz Kunka dr inż.
Bożena Kostek prof. dr hab. inż.

Cytuj jako

Pełna treść

pobierz publikację

pobrano 6 razy

Wersja publikacji: Accepted albo Published Version
Licencja: otwiera się w nowej karcie

Słowa kluczowe

Informacje szczegółowe

Kategoria:: Publikacja w czasopiśmie
Typ:: artykuł w czasopiśmie wyróżnionym w JCR
Opublikowano w:: Archives of Acoustics nr 37, strony 0 - 0,
ISSN: 0137-5075
Język:: angielski
Rok wydania:: 2012
Opis bibliograficzny:: Kunka B., Kostek B.: Objectivization of Audio-Visual Correlation analysis// Archives of Acoustics. -Vol. 37, iss. No. 1 (2012), s.0-0
Weryfikacja:: Politechnika Gdańska