Search
Abstract
This work aims at predicting emotion based on the colors present in images and video excerpts using a machine-learning approach. The purpose of this paper is threefold: (a) to develop a machine-learning algorithm that classifies emotions based on the color present in an image, (b) to select the best-performing algorithm from the first phase and apply it to film excerpt emotion analysis based on colors, (c) to design an online survey to check the accuracy of the annotations of the collected film data. In the first, three approaches to color extraction are tested, namely clustering colors into a palette of predefined colors, assigning colors to the RYB (Red, Yellow, Blue) model, and extracting a histogram of colors present in an image. This is based on image datasets containing color and emotion annotations. Classification is conducted using several algorithms, both deep learning and baseline artificial intelligence algorithms. The obtained results, under different configurations of parameters and training sets, are then presented. In the second part, the bestperforming algorithm from the first phase is applied to film excerpt emotion analysis based on colors. This is followed by the third part, which is an online survey created to check the accuracy of the algorithm’s annotations to the collected film data by the questionnaire respondents. Further, a discussion of the results achieved is presented. Conclusions contain a summary of the results and further direction for improving the performance of the created algorithm.
Citations
-
1
CrossRef
-
0
Web of Science
-
2
Scopus
Authors (3)
Cite as
Full text
- Publication version
- Accepted or Published Version
- DOI:
- Digital Object Identifier (open in new tab) 10.1109/ACCESS.2023.3289713
- License
-
open in new tab
Keywords
Details
- Category:
- Articles
- Type:
- artykuły w czasopismach
- Published in:
-
IEEE Access
no. 11,
pages 66357 - 66373,
ISSN: 2169-3536 - Language:
- English
- Publication year:
- 2023
- Bibliographic description:
- Wędołowska A., Weber D., Kostek B.: Predicting emotion from color present in images and video excerpts by machine learning// IEEE Access -,iss. 11 (2023), s.66357-66373
- DOI:
- Digital Object Identifier (open in new tab) 10.1109/access.2023.3289713
- Sources of funding:
-
- Free publication
- Verified by:
- Gdańsk University of Technology
seen 104 times