Multimodal system for diagnosis and polysensory stimulation of subjects with communication disorders
Abstrakt
An experimental multimodal system, designed for polysensory diagnosis and stimulation of persons with impaired communication skills or even non-communicative subjects is presented. The user interface includes an eye tracking device and the EEG monitoring of the subject. Furthermore, the system consists of a device for objective hearing testing and an autostereoscopic projection system designed to stimulate subjects through their immersion in a virtual environment. Data analysis methods are described, and experiments associated with classification of mental states during listening exercises as well as audio-visual stimuli are presented and discussed. Feature extraction was based on discrete wavelet transformation and clustering employing the k-means algorithm was designed. All algorithms were implemented in the Python programming language with the use of Open Source libraries. Tests of the proposed system were performed in a Special School and Educational Center in Koś-cierzyna, Poland. Results and comparison with data gathered from the control group of healthy people are presented and discussed.
Cytowania
-
1
CrossRef
-
0
Web of Science
-
1
Scopus
Autorzy (7)
Cytuj jako
Pełna treść
pełna treść publikacji nie jest dostępna w portalu
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Aktywność konferencyjna
- Typ:
- materiały konferencyjne indeksowane w Web of Science
- Tytuł wydania:
- Foundations of Intelligent Systems : 23rd International Symposium on Methodologies for Intelligent Systems, ISMIS 2017 strony 47 - 56
- ISSN:
- 0302-9743
- Język:
- angielski
- Rok wydania:
- 2017
- Opis bibliograficzny:
- Kurowski A., Odya P., Szczuko P., Lech M., Spaleniak P., Kostek B., Czyżewski A..: Multimodal system for diagnosis and polysensory stimulation of subjects with communication disorders, W: Foundations of Intelligent Systems : 23rd International Symposium on Methodologies for Intelligent Systems, ISMIS 2017, 2017, ,.
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/978-3-319-60438-1_5
- Weryfikacja:
- Politechnika Gdańska
wyświetlono 151 razy