Multimodal human-computer interfaces based on advanced video and audio analysis - Publikacja - MOST Wiedzy

Wyszukiwarka

Multimodal human-computer interfaces based on advanced video and audio analysis

Abstrakt

Multimodal interfaces development history is reviewed briefly in the introduction. Some applications of multimodal interfaces to education software for disabled people are presented. One of them, the LipMouse is a novel, vision-based human-computer interface that tracks user’s lip movements and detect lips gestures. A new approach to diagnosing Parkinson’s disease is also shown. The progression of the disease can be measured employing the UPDRS (Unified Parkinson Disease Rating Scale) scale which is used to evaluate motor and behavioral symptoms of the Parkinson’s disease, based on the multimodal interface called Virtual-Touchpad (VTP) used for supporting medical diagnosis. The scent emitting multimodal computer interface provides an important supplement of the polysensoric stimulation process, playing an essential role in education and therapy of children with certain developmental disorders. The Smart Pen providing a tool for supporting therapy of developmental dyslexia is presented and results achieved with its application are discussed. The eye-gaze tracking system named Cyber Eye, developed at the Multimedia Systems Department employed to many kinds of experiments is presented including analysis of visual activity of patients remaining in vegetative state and their awareness evaluation. The paper is concluded with some general remarks concerning the role of multimodal computer interfaces applied to learning, therapy and everyday usage of computerized devices.

Cytowania

  • 3

    CrossRef

  • 0

    Web of Science

  • 2

    Scopus

Cytuj jako

Pełna treść

pełna treść publikacji nie jest dostępna w portalu

Słowa kluczowe

Informacje szczegółowe

Kategoria:
Publikacja monograficzna
Typ:
rozdział, artykuł w książce - dziele zbiorowym /podręczniku w języku o zasięgu międzynarodowym
Opublikowano w:
Advances in Intelligent Systems and Computing nr 300, strony 87 - 102,
ISSN: 2194-5357
Tytuł wydania:
W : Human-Computer Systems Interaction: Backgrounds and Applications 3 strony 87 - 102
Język:
angielski
Rok wydania:
2014
Opis bibliograficzny:
Czyżewski A., Dalka P., Kosikowski Ł., Kunka B., Odya P.: Multimodal human-computer interfaces based on advanced video and audio analysis// W : Human-Computer Systems Interaction: Backgrounds and Applications 3/ : , 2014, s.87-102
DOI:
Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/978-3-319-08491-6_8
Weryfikacja:
Politechnika Gdańska

wyświetlono 85 razy

Publikacje, które mogą cię zainteresować

Meta Tagi