Abstrakt
This work aims at predicting emotion based on the colors present in images and video excerpts using a machine-learning approach. The purpose of this paper is threefold: (a) to develop a machine-learning algorithm that classifies emotions based on the color present in an image, (b) to select the best-performing algorithm from the first phase and apply it to film excerpt emotion analysis based on colors, (c) to design an online survey to check the accuracy of the annotations of the collected film data. In the first, three approaches to color extraction are tested, namely clustering colors into a palette of predefined colors, assigning colors to the RYB (Red, Yellow, Blue) model, and extracting a histogram of colors present in an image. This is based on image datasets containing color and emotion annotations. Classification is conducted using several algorithms, both deep learning and baseline artificial intelligence algorithms. The obtained results, under different configurations of parameters and training sets, are then presented. In the second part, the bestperforming algorithm from the first phase is applied to film excerpt emotion analysis based on colors. This is followed by the third part, which is an online survey created to check the accuracy of the algorithm’s annotations to the collected film data by the questionnaire respondents. Further, a discussion of the results achieved is presented. Conclusions contain a summary of the results and further direction for improving the performance of the created algorithm.
Cytowania
-
1
CrossRef
-
0
Web of Science
-
2
Scopus
Autorzy (3)
Cytuj jako
Pełna treść
- Wersja publikacji
- Accepted albo Published Version
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1109/ACCESS.2023.3289713
- Licencja
- otwiera się w nowej karcie
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Publikacja w czasopiśmie
- Typ:
- artykuły w czasopismach
- Opublikowano w:
-
IEEE Access
nr 11,
strony 66357 - 66373,
ISSN: 2169-3536 - Język:
- angielski
- Rok wydania:
- 2023
- Opis bibliograficzny:
- Wędołowska A., Weber D., Kostek B.: Predicting emotion from color present in images and video excerpts by machine learning// IEEE Access -,iss. 11 (2023), s.66357-66373
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1109/access.2023.3289713
- Źródła finansowania:
-
- Publikacja bezkosztowa
- Weryfikacja:
- Politechnika Gdańska
wyświetlono 104 razy