An new method of audio-visual correlation analysis - Publication - Bridge of Knowledge

Search

An new method of audio-visual correlation analysis

Abstract

This paper presents a new methodology of conducting the audio-visual correlation analysis employing the gaze tracking system. Interaction between two perceptual modalities, seeing and hearing, their interaction and mutual reinforcement in a complex relationship was a subject of many research studies. Earlier stage of the carried out experiments at the Multimedia Systems Department (MSD) showed that there exists a relationship between perception of video presented in the screen and accompanying audio signals, both stereo and spatial. These results were based on subjective tests. Applying the gaze tracking system to the subjective domain may be a step towards objectivization of results obtained during such tests. In the paper, first a short review of audio-visual correlation examination methods is presented. Then, a gaze tracking system engineered at the MSD is shortly presented. The system calibration is also shown. Assumptions of the preliminary experiments are outlined, and the realization of some preliminary tests is described. Conclusions concerning the objective methodology of audio-visual correlation analysis proposed are also included.

Cite as

Full text

full text is not available in portal

Keywords

Details

Category:
Conference activity
Type:
publikacja w wydawnictwie zbiorowym recenzowanym (także w materiałach konferencyjnych)
Title of issue:
International multiconference on computer science and information technology, multimedia; October 12-14, 2009. Mrągowo, Poland. - [online] strony 497 - 502
Language:
English
Publication year:
2009
Bibliographic description:
Kunka B., Kostek B.: An new method of audio-visual correlation analysis// International multiconference on computer science and information technology, multimedia; October 12-14, 2009. Mrągowo, Poland. - [online]/ : , 2009, s.497-502
Verified by:
Gdańsk University of Technology

seen 55 times

Recommended for you

Meta Tags