Search
Search results for: MOTION CAPTURE FACIAL EXPRESSIONS REGISTRATION AND POST-PRODUCTION
-
Database of speech and facial expressions recorded with optimized face motion capture settings
PublicationThe broad objective of the present research is the analysis of spoken English employing a multiplicity of modalities. An important stage of this process, discussed in the paper, is creating a database of speech accompanied with facial expressions. Recordings of speakers were made using an advanced system for capturing facial muscle motion. A brief historical outline, current applications, limitations and the ways of capturing face...
-
FEEDB: A multimodal database of facial expressions and emotions
PublicationIn this paper a first version of a multimodal FEEDB database of facial expressions and emotions is presented. The database contains labeled RGB-D recordings of people expressing a specific set of expressions that have been recorded using Microsoft Kinect sensor. Such a database can be used for classifier training and testing in face recognition as well as in recognition of facial expressions and human emotions. Also initial experiences...
-
Wiktoria Wojnicz dr hab. inż.
PeopleDSc in Mechanics (in the field of Biomechanics) - Lodz Univeristy of Technology, 2019 PhD in Mechanics (in the field of Biomechanics) - Lodz Univeristy of Technology, 2009 (with distinction) List of papers (2009 - ) Wojnicz W., Wittbrodt E., Analysis of muscles' behaviour. Part I. The computational model of muscle. Acta of Bioengineering and Biomechanics, Vol. 11, No.4, 2009, p. 15-21 Wojnicz W., Wittbrodt E., Analysis of...
-
Bimodal classification of English allophones employing acoustic speech signal and facial motion capture
PublicationA method for automatic transcription of English speech into International Phonetic Alphabet (IPA) system is developed and studied. The principal objective of the study is to evaluate to what extent the visual data related to lip reading can enhance recognition accuracy of the transcription of English consonantal and vocalic allophones. To this end, motion capture markers were placed on the faces of seven speakers to obtain lip...
-
An unorthodox view on the problem of tracking facial expressions
PublicationRecent developments in imaging cameras has opened a new way of analyzing facial expression. We would like to take advantage from this new technology and present a method of imaging and processing images of human face as a response to the particular stimuli. The response in this case is represented by the facial expressions and the stimuli are still images representing six basic emotions according to Eckmann. Working hypothesis...
-
An unorthodox view on the problem of tracking facial expressions
PublicationRecent developments in imaging cameras has opened a new way of analyzing facial expression. We would like to take advantage from this new technology and present a method of imaging and processing images of human face as a response to the particular stimuli. The response in this case is represented by the facial expressions and the stimuli are still images representing six basic emotions according to Eckmann. Working hypothesis...
-
On Facial Expressions and Emotions RGB-D Database
PublicationThe goal of this paper is to present the idea of creating reference database of RGB-D video recordings for recognition of facial expressions and emotions. Two different formats of the recordings used for creation of two versions of the database are described and compared using different criteria. Examples of first applications using databases are also presented to evaluate their usefulness.
-
Emotion Recognition Based on Facial Expressions of Gamers
PublicationThis article presents an approach to emotion recognition based on facial expressions of gamers. With application of certain methods crucial features of an analyzed face like eyebrows' shape, eyes and mouth width, height were extracted. Afterwards a group of artificial intelligence methods was applied to classify a given feature set as one of the following emotions: happiness, sadness, anger and fear. The approach presented in this...
-
Emotion Recognition Based on Facial Expressions of Gamers
PublicationThis article presents an approach to emotion recognition based on facial expressions of gamers. With application of certain methods crucial features of an analysed face like eyebrows' shape, eyes and mouth width, height were extracted. Afterwards a group of artificial intelligence methods was applied to classify a given feature set as one of the following emotions: happiness, sadness, anger and fear.The approach presented in this...
-
Limitations of Emotion Recognition from Facial Expressions in e-Learning Context
PublicationThe paper concerns technology of automatic emotion recognition applied in e-learning environment. During a study of e-learning process the authors applied facial expressions observation via multiple video cameras. Preliminary analysis of the facial expressions using automatic emotion recognition tools revealed several unexpected results, including unavailability of recognition due to face coverage and significant inconsistency...
-
Acquisition and indexing of RGB-D recordings for facial expressions and emotion recognition
PublicationIn this paper KinectRecorder comprehensive tool is described which provides for convenient and fast acquisition, indexing and storing of RGB-D video streams from Microsoft Kinect sensor. The application is especially useful as a supporting tool for creation of fully indexed databases of facial expressions and emotions that can be further used for learning and testing of emotion recognition algorithms for affect-aware applications....
-
Robot Eye Perspective in Perceiving Facial Expressions in Interaction with Children with Autism
PublicationThe paper concerns automatic facial expression analysis applied in a study of natural “in the wild” interaction between children with autism and a social robot. The paper reports a study that analyzed the recordings captured via a camera located in the eye of a robot. Children with autism exhibit a diverse level of deficits, including ones in social interaction and emotional expression. The aim of the study was to explore the possibility...
-
Identification of Emotions Based on Human Facial Expressions Using a Color-Space Approach
PublicationHCI technology improves human-computer interaction. Such communication can be carried out with the use of emotions that are visible on the human face since birth. In this paper the Emotion system for detecting and recognizing facial expressions, developed in the MSc work, is presented. The system recognizes emotion from webcam video in real time. It is based on color segmentation and morphological operations. The system uses a...
-
Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions
PublicationThe paper concerns accuracy of emotion recognition from facial expressions. As there are a couple of ready off-the-shelf solutions available in the market today, this study aims at practical evaluation of selected solutions in order to provide some insight into what potential buyers might expect. Two solutions were compared: FaceReader by Noldus and Xpress Engine by QuantumLab. The performed evaluation revealed that the recognition...
-
Vocalic Segments Classification Assisted by Mouth Motion Capture
PublicationVisual features convey important information for automatic speech recognition (ASR), especially in noisy environment. The purpose of this study is to evaluate to what extent visual data (i.e. lip reading) can enhance recognition accuracy in the multi-modal approach. For that purpose motion capture markers were placed on speakers' faces to obtain lips tracking data during speaking. Different parameterizations strategies were tested...
-
An unorthodox view on the problem of tracking facial expressions
Publication -
Facial data registration facility for biometric protection of electronic documents
PublicationIn modern world, information is crucial, and its leakage may lead to serious losses. Documents as the main medium of information must be therefore highly protected. Nowadays, the most common way of protecting data is using passwords, however it seems inconvenient to type complex passwords, when it is needed many times a day. For that reason a significant research has been conducted on biometric authentication...
-
An extension to the FEEDB Multimodal Database of Facial Expressions and Emotions
PublicationFEEDB is a multimodal database that contains recordings of people expressing different emotions, captured by using a Microsoft Kinect sensor. Data were originally provided in the device’s proprietary format (XED), requiring both the Microsoft Kinect Studio application and a Kinect sensor attached to the system to use the files. In this paper, we present an extension of the database. For a selection of recordings, we also provide...
-
Image-based Analysis of Emotional Facial Expressions in Full Face Transplants
Publication -
ID 382 – Electrophysiological evaluation of emotional expressions in the facial transplantation patients
Publication -
Studies on the utilization of post-distillation liquid from Solvay process to carbon dioxide capture and storage
PublicationIn this work, a method of precipitated calcium carbonate production from the post-distillation liquid created in the Solvay process and waste carbon dioxide was proposed and investigated. Precipitation was carried out in a model solution of calcium chloride containing ammonia at various molar ratios in relation to Ca2+ ions, while gaseous carbon dioxide was supplied to the reactor as a pure gas or as a mixture with air. It was...
-
Recovery of facial expressions using functional electrical stimulation after full-face transplantation
Publication -
Synthesis of irregular motion mechanisms for production machine drives
Publication -
The impact of resistance exercise range of motion on the magnitude of upper-body post-activation performance enhancement
Publication -
ALOFON corpus
Open Research DataThe ALOFON corpus is one of the multimodal database of word recordings in English, available at http://www.modality-corpus.org/. The ALOFON corpus is oriented towards the recording of the speech equivalence variants. For this purpose, a total of 7 people who are or speak English with native speaker fluency and a variety of Standard Southern British...
-
Efficiency of Electricity Production Technology from Post-Process Gas Heat: Ecological, Economic and Social Benefits
Publication -
Negative CO2 Emission Gas Power Plant As Technology for Utilization of Sewage Sludge, Production of Electrical Energy, and CO2 Capture - Case of Chamber Under Transpiration Cooling
PublicationThis work focuses on the concept developed in the nCO2PP project, which aims to demonstrate a technology that allows to achieve negative CO2 emissions through Carbon Capture and Storage (CCS) applied to sewage sludge. A feedstock is first gasified, then the resulting syngas is burned in a semi-closed oxy-fuel gas turbine with pure oxygen and water, using the advantages of oxy-combustion, to ease the capture of CO2 in the resulting...
-
Selection of Features for Multimodal Vocalic Segments Classification
PublicationEnglish speech recognition experiments are presented employing both: audio signal and Facial Motion Capture (FMC) recordings. The principal aim of the study was to evaluate the influence of feature vector dimension reduction for the accuracy of vocalic segments classification employing neural networks. Several parameter reduction strategies were adopted, namely: Extremely Randomized Trees, Principal Component Analysis and Recursive...
-
WEB-CAM AS A MEANS OF INFORMATION ABOUT EMOTIONAL ATTEMPT OF STUDENTS IN THE PROCESS OF DISTANT LEARNING
PublicationNew methods in education become more popular nowadays. Distant learning is a good example when teacher and student meet in virtual environment. Because interaction in this virtual world might be complicated it seems necessary to assure as much methods of conforming that student is still engaged in the process of learning as it is possible. We would like to present assumption that by means of web-cam we will be able to track facial...
-
Piotr Szczuko dr hab. inż.
PeoplePiotr Szczuko received his M.Sc. degree in 2002. His thesis was dedicated to examination of correlation phenomena between perception of sound and vision for surround sound and digital image. He finished Ph.D. studies in 2007 and one year later completed a dissertation "Application of Fuzzy Rules in Computer Character Animation" that received award of Prime Minister of Poland. His interests include: processing of audio and video, computer...
-
Emotion Recognition for Affect Aware Video Games
PublicationIn this paper the idea of affect aware video games is presented. A brief review of automatic multimodal affect recognition of facial expressions and emotions is given. The first result of emotions recognition using depth data as well as prototype affect aware video game are presented
-
Jolanta Łopatowska dr inż.
PeopleJolanta Łopatowska, assistant professor at the Department of Management Engineering and Quality at the Faculty of Management and Economics, is a graduate of the Faculty of Electronics at Gdańsk University of Technology and Institute of Organization and Design of Production Systems at Gdańsk University of Technology. She obtained Ph.D. degree in the discipline of Economic Science. Her scientific and research interests focus on organizationally...
-
Facial emotion recognition using depth data
PublicationIn this paper an original approach is presented for facial expression and emotion recognition based only on depth channel from Microsoft Kinect sensor. The emotional user model contains nine emotions including the neutral one. The proposed recognition algorithm uses local movements detection within the face area in order to recognize actual facial expression. This approach has been validated on Facial Expressions and Emotions Database...
-
Przegląd robotów humanoidalnych
PublicationW artykule przedstawiono przegląd najpopularniejszych robotów humanoidalnych, wyróżniając ich ważniejsze cechy i porównując podstawowe charakterystyki, biorąc przy tym pod uwagę pożądane kognitywne aspekty rozwoju robotyki. Wśród osiągalnych cech rozmaitych rozwiązań aparatów humanoidalnych dostępnych na rynku – wyróżnia się głównie liczbę stopni swobody, rodzaj zastosowanego układu lokomocji oraz możliwości wyrażania mimiki twarzy,...
-
Evaluation Criteria for Affect-Annotated Databases
PublicationIn this paper a set of comprehensive evaluation criteria for affect-annotated databases is proposed. These criteria can be used for evaluation of the quality of a database on the stage of its creation as well as for evaluation and comparison of existing databases. The usefulness of these criteria is demonstrated on several databases selected from affect computing domain. The databases contain different kind of data: video or still...
-
Detection of Face Position and Orientation Using Depth Data
PublicationIn this paper an original approach is presented for real-time detection of user's face position and orientation based only on depth channel from a Microsoft Kinect sensor which can be used in facial analysis on scenes with poor lighting conditions where traditional algorithms based on optical channel may have failed. Thus the proposed approach can support, or even replace, algorithms based on optical channel or based on skeleton...
-
Hydraulic equations for vortex separators dimensioning
PublicationThe paper presents a set of hydraulic expressions developed to design vortex separators. These devices are used for gravitational removal of suspensions from wastewater. Measurements and theoretical considerations allowed the authors to formulate a mathematically simple velocity field model. Than, equations describing particle motion in the separator were derived. Finally, a technical procedure for hydraulic design of vortex separators...
-
AeroSense Measurements: Wind Tunnel EPFL
Open Research DataData from wind tunnel tests of Aerosesne measurement system installed on NACA63418 at EPFL wind tunnel.
-
Emotion monitoring system for drivers
PublicationThis article describes a new approach to the issue of building a driver monitoring system. Actual systems focus, for example, on tracking eyelid and eyebrow movements that result from fatigue. We propose a different approach based on monitoring the state of emotions. Such a system assumes that by using the emotion model based on our own concept, referred to as the reverse Plutchik’s paraboloid of emotions, the recognition of emotions...
-
Aleksandra Parteka dr hab. inż.
PeopleAbout me: I am an associate professor and head of doctoral studies at the Faculty of Management and Economics, Gdansk University of Technology (GdanskTech, Poland). I got my MSc degree in Economics from Gdansk University of Technology (2003) and Universita’ Politecnica delle Marche (2005), as well as MA degree in Contemporary European Studies from Sussex University (2006, with distinction). I received my PhD in Economics...
-
A New Method for Automatic Generation of Animated Motion
PublicationA new method for generation of animation with a quality comparable to a natural motion is presented. Proposed algorithm is based on fuzzy description of motion parameters and subjective features. It is assumed that such processing increases naturalness and quality of motion, which is verified by subjective evaluation tests. First, reference motion data are gathered utilizing a motion capture system, then these data are reduced...
-
Real-Time Skin Quality Assessment System
PublicationThis thesis presents a real-time skin assessment system with the main aim of detecting inflammatory acne lesions and tracking skin conditions. A facial acne lesion detection algorithm was developed, using a pre-trained YOLOv8 model for lesion detection and a Mediapipe detector for face detection. The proposed solution aims to create a system used in smart mirrors to help users self-monitor and monitor their skin condition in real...
-
IMAGE CORRELATION AS A TOLL FOR TRACKING FACIAL CHANGES CAUSING BY EXTERNAL STIMULI
PublicationExpressions of the human face bring a lot of information, which are a valuable source in the areas of computer vision, remote sensing and affective computing. For years, by analyzing the movement of the skin and facial muscles scientists are trying to create the perfect tool, based on image analysis, allowing the recognition of emotional states of human beings. To create a reliable algorithm, it is necessary to explore and examine...
-
Improvement of CO2 absorption and inhibition of NH3 escape during CaCO3 precipitation in the presence of selected alcohols and polyols
PublicationThis research aims to investigate the effect of selected organic substances containing hydroxyl groups on the reduction of NH3 escape and the improvement of CO2 capture during the precipitation of calcium carbonate by carbonation method using post-distillation liquid from the Solvay process and gas stream containing CO2 in the amount corresponding to the exhausted gases produced by the combustion of fossil fuels. Glycerol, ethylene...
-
CaO-based high temperature CO2 sorbents – Literature review
PublicationThe use of CaO-based adsorbents has a high potential to capture CO2 from various systems due to its high reactivity with CO2, high capacity, and low cost of naturally derived CaO. The application of CaO-based sorbents to remove carbon dioxide is based on a reversible reaction between CaO and CO2. However, multiple carbonation/calcination cycles lead to a rapid reduction in the sorption capacity of natural CaO, and therefore efforts...
-
DevEmo—Software Developers’ Facial Expression Dataset
PublicationThe COVID-19 pandemic has increased the relevance of remote activities and digital tools for education, work, and other aspects of daily life. This reality has highlighted the need for emotion recognition technology to better understand the emotions of computer users and provide support in remote environments. Emotion recognition can play a critical role in improving the remote experience and ensuring that individuals are able...
-
Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review
PublicationThe automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities...
-
Polyurethane-wood composites (PU-WC) as a method of wood waste management
PublicationIn recent years, due to the progressive environmental degradation and increase of environmental awareness, the sustainability of production systems in wood processing, the wood industry, and wood waste management is a crucial issue for European industry and society. Consequently, the problem of generating wood-like waste and the associated risks has become an increasingly noticeable challenge for science. Although various methods...
-
A new relevant membrane application: CO2 direct air capture (DAC)
PublicationSince carbon dioxide (CO2) is the primary greenhouse gas emitted into the atmosphere due to human activities, strong research efforts have been developed towards capturing and decreasing its production. Unfortunately, specific processes and activities make it impossible to avoid CO2 emissions. Among the different strategies scientists propose for CO2 reduction, direct CO2 capture from the atmosphere, also known as direct air capture...
-
Corrosion monitoring as a factor increasing the safety of hydrotechnical infrastructure
PublicationWater distribution systems at KGHM S.A. are of great importance for the efficient production of copper and environmental protection. For failures leading to perforation and leakage, the corrosion processes are responsible. This paper aims to assess corrosion on the basis of the analysis of the exposure of the Hydrotechnical Plant pipelines. To this end, the system of transfer and deposition of post-flotation waste as well as the...