Abstrakt
The broad objective of the present research is the analysis of spoken English employing a multiplicity of modalities. An important stage of this process, discussed in the paper, is creating a database of speech accompanied with facial expressions. Recordings of speakers were made using an advanced system for capturing facial muscle motion. A brief historical outline, current applications, limitations and the ways of capturing face muscle motion as well as the problems with recording facial expressions are discussed. In particular, the scope of the present analysis concerns the registration of facial expressions related to emotions of speakers which accompany articulation. The camera system, instrumentation and software used for registration and for post-production are outlined. An analysis of the registration procedure and the results of the registration process was performed. The obtained results demonstrate how muscle movements can be registered employing reflective markers and point at the advantages and limitations of applying FMC (Face Motion Capture) technology in compiling a multimodal speech database. A short discussion pertaining to the usage of FMC as ground truth data source in facial expression databases concludes the paper.
Cytowania
-
5
CrossRef
-
0
Web of Science
-
6
Scopus
Autorzy (2)
Cytuj jako
Pełna treść
- Wersja publikacji
- Accepted albo Published Version
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/s10844-019-00547-y
- Licencja
- otwiera się w nowej karcie
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Publikacja w czasopiśmie
- Typ:
- artykuły w czasopismach
- Opublikowano w:
-
JOURNAL OF INTELLIGENT INFORMATION SYSTEMS
nr 53,
strony 381 - 404,
ISSN: 0925-9902 - Język:
- angielski
- Rok wydania:
- 2019
- Opis bibliograficzny:
- Czyżewski A., Kawaler M.: Database of speech and facial expressions recorded with optimized face motion capture settings// JOURNAL OF INTELLIGENT INFORMATION SYSTEMS -Vol. 53, (2019), s.381-404
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1007/s10844-019-00547-y
- Weryfikacja:
- Politechnika Gdańska
Powiązane datasety
- dane badawcze ALOFON corpus
wyświetlono 179 razy
Publikacje, które mogą cię zainteresować
WEB-CAM AS A MEANS OF INFORMATION ABOUT EMOTIONAL ATTEMPT OF STUDENTS IN THE PROCESS OF DISTANT LEARNING
- M. Błażek,
- A. Janowski,
- M. Kazmierczak
- + 2 autorów