Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Agnieszka Landowska; Aleksandra Karpus; Teresa Zawadzka; Ben Robins; Duygun Erol Barkana; Hatice Kose; Tatjana Zorcec; Nicholas Cummins

doi:10.3390/s22041649

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Abstract

The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.

Citations

2 6

CrossRef
0

Web of Science
2 0

Scopus

Authors (8)

Agnieszka Landowska dr hab. inż.
- Faculty of Electronics, Telecommunications and Informatics
- Gdańsk University of Technology
Aleksandra Karpus dr inż.
- Faculty of Electronics, Telecommunications and Informatics
- Gdańsk University of Technology
Teresa Zawadzka dr inż.
- Faculty of Electronics, Telecommunications and Informatics
- Gdańsk University of Technology
Ben Robins
- University of Hertfordshire
Duygun Erol Barkana
- Yeditepe University
Hatice Kose
- Istanbul Technical University
Tatjana Zorcec
- University Children’s Hospital
Nicholas Cummins
- University of Augsburg

Cite as

Full text

download paper

downloaded 35 times

Publication version: Accepted or Published Version
DOI:: Digital Object Identifier (open in new tab) 10.3390/s22041649
License: open in new tab

full content of the article see on external site open in new tab

Keywords

Details

Category:

Articles

Type:

artykuły w czasopismach

Published in:

SENSORS no. 22,
ISSN: 1424-8220

Language:

English

Publication year:

2022

Bibliographic description:

Landowska A., Karpus A., Zawadzka T., Robins B., Erol Barkana D., Kose H., Zorcec T., Cummins N.: Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review// SENSORS -Vol. 22,iss. 4 (2022), s.1649-

DOI:

10.3390/s22041649

Sources of funding:

Erasmus Plus project of European Commission: EMBOA, Affective loop in Socially Assistive Robotics as an intervention tool for children with autism, contract no 2019-1-PL01- KA203-065096

Verified by: