Search
Filters
total: 752
filtered: 689
Search results for: facial motion capture
-
Bimodal classification of English allophones employing acoustic speech signal and facial motion capture
PublicationA method for automatic transcription of English speech into International Phonetic Alphabet (IPA) system is developed and studied. The principal objective of the study is to evaluate to what extent the visual data related to lip reading can enhance recognition accuracy of the transcription of English consonantal and vocalic allophones. To this end, motion capture markers were placed on the faces of seven speakers to obtain lip...
-
Database of speech and facial expressions recorded with optimized face motion capture settings
PublicationThe broad objective of the present research is the analysis of spoken English employing a multiplicity of modalities. An important stage of this process, discussed in the paper, is creating a database of speech accompanied with facial expressions. Recordings of speakers were made using an advanced system for capturing facial muscle motion. A brief historical outline, current applications, limitations and the ways of capturing face...
-
Vocalic Segments Classification Assisted by Mouth Motion Capture
PublicationVisual features convey important information for automatic speech recognition (ASR), especially in noisy environment. The purpose of this study is to evaluate to what extent visual data (i.e. lip reading) can enhance recognition accuracy in the multi-modal approach. For that purpose motion capture markers were placed on speakers' faces to obtain lips tracking data during speaking. Different parameterizations strategies were tested...
-
Selection of Features for Multimodal Vocalic Segments Classification
PublicationEnglish speech recognition experiments are presented employing both: audio signal and Facial Motion Capture (FMC) recordings. The principal aim of the study was to evaluate the influence of feature vector dimension reduction for the accuracy of vocalic segments classification employing neural networks. Several parameter reduction strategies were adopted, namely: Extremely Randomized Trees, Principal Component Analysis and Recursive...
-
A New Method for Automatic Generation of Animated Motion
PublicationA new method for generation of animation with a quality comparable to a natural motion is presented. Proposed algorithm is based on fuzzy description of motion parameters and subjective features. It is assumed that such processing increases naturalness and quality of motion, which is verified by subjective evaluation tests. First, reference motion data are gathered utilizing a motion capture system, then these data are reduced...
-
Brownian Motion in Optical Tweezers, a Comparison between MD Simulations and Experimental Data in the Ballistic Regime
PublicationThe four most popular water models in molecular dynamics were studied in large-scale simulations of Brownian motion of colloidal particles in optical tweezers and then compared with experimental measurements in the same time scale. We present the most direct comparison of colloidal polystyrene particle diffusion in molecular dynamics simulations and experimental data on the same time scales in the ballistic regime. The four most...
-
Real-Time Skin Quality Assessment System
PublicationThis thesis presents a real-time skin assessment system with the main aim of detecting inflammatory acne lesions and tracking skin conditions. A facial acne lesion detection algorithm was developed, using a pre-trained YOLOv8 model for lesion detection and a Mediapipe detector for face detection. The proposed solution aims to create a system used in smart mirrors to help users self-monitor and monitor their skin condition in real...
-
Multiscale model for blood flow after a bileaflet artificial aortic valve implantation
PublicationCardiovascular diseases are the leading cause of mortality in the world, mainly due to atherosclerosis and its consequences. The article presents the numerical model of the blood flow through artificial aortic valve. The overset mesh approach was applied to simulate the valve leaflets motion and to realize the moving mesh, in the aortic arch and the main branches of cardiovascular system. To capture the cardiac system’s response...
-
Nutrient transport and acquisition by diatom chains in a moving fluid
PublicationThe role of fluid motion in delivery of nutrients to phytoplankton cells is a fundamental question in biological and chemical oceanography. In the study of mass transfer to phytoplankton, diatoms are of particular interest. They are non-motile, are often the most abundant components in aggregates and often form chains, so they are the ones expected to benefit most from enhancement of nutrient flux due to dissipating turbulence....
-
Facial emotion recognition using depth data
PublicationIn this paper an original approach is presented for facial expression and emotion recognition based only on depth channel from Microsoft Kinect sensor. The emotional user model contains nine emotions including the neutral one. The proposed recognition algorithm uses local movements detection within the face area in order to recognize actual facial expression. This approach has been validated on Facial Expressions and Emotions Database...
-
FEEDB: A multimodal database of facial expressions and emotions
PublicationIn this paper a first version of a multimodal FEEDB database of facial expressions and emotions is presented. The database contains labeled RGB-D recordings of people expressing a specific set of expressions that have been recorded using Microsoft Kinect sensor. Such a database can be used for classifier training and testing in face recognition as well as in recognition of facial expressions and human emotions. Also initial experiences...
-
An unorthodox view on the problem of tracking facial expressions
PublicationRecent developments in imaging cameras has opened a new way of analyzing facial expression. We would like to take advantage from this new technology and present a method of imaging and processing images of human face as a response to the particular stimuli. The response in this case is represented by the facial expressions and the stimuli are still images representing six basic emotions according to Eckmann. Working hypothesis...
-
An unorthodox view on the problem of tracking facial expressions
PublicationRecent developments in imaging cameras has opened a new way of analyzing facial expression. We would like to take advantage from this new technology and present a method of imaging and processing images of human face as a response to the particular stimuli. The response in this case is represented by the facial expressions and the stimuli are still images representing six basic emotions according to Eckmann. Working hypothesis...
-
Facial Feature extraction from a monochromatic picture
PublicationFace pose determination represents an important area of research in Human Machine Interaction. In this paper, I describe a new method of extracting facial feature locations from a single monochromatic monocular camera for the purpose of estimating and tracking the three dimensional pose of human face and eye-gaze direction.
-
Facial feature extraction from a monochromatic picture.
PublicationFace pose determination represents an important area of research in Human Machine Interaction. In this paper, I describe a new method of extracting facial feature locations from a single monochromatic monocular camera for the purpose of estimating and tracking the three dimensional pose of human face and eye-gaze direction.
-
Facial features extraction for color, frontal images
PublicationThe problem of facial characteristic features extraction is discussed. Several methods of features extraction for color en--face photographs are discussed. The methods are based mainly on the colors features related to the specific regions of the human face. The usefulness of presented methods was tested on a database of en--face photographs consisting of 100 photographs.
-
On Facial Expressions and Emotions RGB-D Database
PublicationThe goal of this paper is to present the idea of creating reference database of RGB-D video recordings for recognition of facial expressions and emotions. Two different formats of the recordings used for creation of two versions of the database are described and compared using different criteria. Examples of first applications using databases are also presented to evaluate their usefulness.
-
Real-time facial feature tracking in poor quality thermal imagery
PublicationRecently, facial feature tracking systems have become more and more popular because of many possible use cases. Especially in medical applications location of the face and facial features are very useful. Many researches have presented methods to detect and track facial features in visible light. However, facial feature analysis in thermography may also be very advantageous. Some examples of using infrared imagery in medicine include...
-
Emotion Recognition Based on Facial Expressions of Gamers
PublicationThis article presents an approach to emotion recognition based on facial expressions of gamers. With application of certain methods crucial features of an analyzed face like eyebrows' shape, eyes and mouth width, height were extracted. Afterwards a group of artificial intelligence methods was applied to classify a given feature set as one of the following emotions: happiness, sadness, anger and fear. The approach presented in this...
-
Emotion Recognition Based on Facial Expressions of Gamers
PublicationThis article presents an approach to emotion recognition based on facial expressions of gamers. With application of certain methods crucial features of an analysed face like eyebrows' shape, eyes and mouth width, height were extracted. Afterwards a group of artificial intelligence methods was applied to classify a given feature set as one of the following emotions: happiness, sadness, anger and fear.The approach presented in this...
-
Recognition of Emotions in Speech Using Convolutional Neural Networks on Different Datasets
PublicationArtificial Neural Network (ANN) models, specifically Convolutional Neural Networks (CNN), were applied to extract emotions based on spectrograms and mel-spectrograms. This study uses spectrograms and mel-spectrograms to investigate which feature extraction method better represents emotions and how big the differences in efficiency are in this context. The conducted studies demonstrated that mel-spectrograms are a better-suited...
-
Limitations of Emotion Recognition from Facial Expressions in e-Learning Context
PublicationThe paper concerns technology of automatic emotion recognition applied in e-learning environment. During a study of e-learning process the authors applied facial expressions observation via multiple video cameras. Preliminary analysis of the facial expressions using automatic emotion recognition tools revealed several unexpected results, including unavailability of recognition due to face coverage and significant inconsistency...
-
Driver fatigue detection method based on facial image analysis
PublicationNowadays, ensuring road safety is a crucial issue that demands continuous development and measures to minimize the risk of accidents. This paper presents the development of a driver fatigue detection method based on the analysis of facial images. To monitor the driver's condition in real-time, a video camera was used. The method of detection is based on analyzing facial features related to the mouth area and eyes, such as...
-
Acquisition and indexing of RGB-D recordings for facial expressions and emotion recognition
PublicationIn this paper KinectRecorder comprehensive tool is described which provides for convenient and fast acquisition, indexing and storing of RGB-D video streams from Microsoft Kinect sensor. The application is especially useful as a supporting tool for creation of fully indexed databases of facial expressions and emotions that can be further used for learning and testing of emotion recognition algorithms for affect-aware applications....
-
DevEmo—Software Developers’ Facial Expression Dataset
PublicationThe COVID-19 pandemic has increased the relevance of remote activities and digital tools for education, work, and other aspects of daily life. This reality has highlighted the need for emotion recognition technology to better understand the emotions of computer users and provide support in remote environments. Emotion recognition can play a critical role in improving the remote experience and ensuring that individuals are able...
-
Dynamical objectivity in quantum Brownian motion
PublicationClassical objectivity as a property of quantum states —a view proposed to explain the observer-independent character of our world from quantum theory, is an important step in bridging the quantum-classical gap. It was recently derived in terms of spectrum broadcast structures for small objects embedded in noisy photon-like environments. However, two fundamental problems have arisen: a description of objective motion and applicability...
-
Robot Eye Perspective in Perceiving Facial Expressions in Interaction with Children with Autism
PublicationThe paper concerns automatic facial expression analysis applied in a study of natural “in the wild” interaction between children with autism and a social robot. The paper reports a study that analyzed the recordings captured via a camera located in the eye of a robot. Children with autism exhibit a diverse level of deficits, including ones in social interaction and emotional expression. The aim of the study was to explore the possibility...
-
Identification of Emotions Based on Human Facial Expressions Using a Color-Space Approach
PublicationHCI technology improves human-computer interaction. Such communication can be carried out with the use of emotions that are visible on the human face since birth. In this paper the Emotion system for detecting and recognizing facial expressions, developed in the MSc work, is presented. The system recognizes emotion from webcam video in real time. It is based on color segmentation and morphological operations. The system uses a...
-
Enhancing Facial Palsy Treatment through Artificial Intelligence: From Diagnosis to Recovery Monitoring
PublicationThe objective of this study is to develop and assess a mobile application that leverages artificial intelligence (AI) to support the rehabilitation of individuals with facial nerve paralysis. The application features two primary functionalities: assessing the paralysis severity and facilitating the monitoring of rehabilitation exercises. The AI algorithm employed for this purpose was Google's ML Kit “face-detection”. The classification...
-
NEW DESIGNS OF MAGNETIC FLUID SEALS FOR RECIPROCATING MOTION
PublicationT he operating conditions of magnetic fluid seals during reciprocating motion are so different from those observed in rotating motion that the use of their conventional structures for reciprocating motion seals yields no good results. The analysis of the sealing mechanism of magnetic fluid seals in reciprocating motion shows that the operation of these seals is affected by the carry-over phenomenon and magnetic fluid...
-
Longitudinal Motion Due to Action of Tunnel Thrusters
PublicationTunnel thrusters are propulsion and active control devises that provide a side force, or transverse thrust, to support mooring operations or position keeping. They shorten the time of manoeuvring, reduce the cost of towage and since inception, manoeuvrability specifically in ports has become a lot easier. Tunnel thrusters can either be operated manually or with the help of Dynamic Positioning systems which makes it even more efficient. Theoretically,...
-
Identification of hydroacoustic wave sources of ship in motion
PublicationThis paper deals with results of identification tests of acoustic field spectrum of underwater noise generated by ship in motion. The field is connected with acoustic activity of ship mechanisms and devices in operation. Vibration energy generated by the mechanisms and devices is transferred through ship structural elements to surrounding water where it propagates in the form of acoustic waves of a broad band of frequencies. In...
-
A new relevant membrane application: CO2 direct air capture (DAC)
PublicationSince carbon dioxide (CO2) is the primary greenhouse gas emitted into the atmosphere due to human activities, strong research efforts have been developed towards capturing and decreasing its production. Unfortunately, specific processes and activities make it impossible to avoid CO2 emissions. Among the different strategies scientists propose for CO2 reduction, direct CO2 capture from the atmosphere, also known as direct air capture...
-
Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions
PublicationThe paper concerns accuracy of emotion recognition from facial expressions. As there are a couple of ready off-the-shelf solutions available in the market today, this study aims at practical evaluation of selected solutions in order to provide some insight into what potential buyers might expect. Two solutions were compared: FaceReader by Noldus and Xpress Engine by QuantumLab. The performed evaluation revealed that the recognition...
-
Analysis of activity of people using motion sensors
PublicationThe article presents the designed and implemented system for activity monitoring of people using passive motion sensors and methods for activity maps generation. In the paper he method is presented and results obtained for simulated data and for data from observations with the participation of people.
-
Thermodynamic analysis of the double Brayton cycle with the use of oxy combustion and capture of CO2
PublicationIn this paper, thermodynamic analysis of a proposed innovative double Brayton cycle with the use of oxy combustion and capture of CO2, is presented. For that purpose, the computation flow mechanics (CFM) approach has been developed. The double Brayton cycle (DBC) consists of primary Brayton and secondary inverse Brayton cycle. Inversion means that the role of the compressor and the gas turbine is changed and firstly we have expansion...
-
Motion analysis and classification with motion history imaging
Publication -
Super-resolved Thermal Imagery for High-accuracy Facial Areas Detection and Analysis
PublicationIn this study, we evaluate various Convolutional Neural Networks based Super-Resolution (SR) models to improve facial areas detection in thermal images. In particular, we analyze the influence of selected spatiotemporal properties of thermal image sequences on detection accuracy. For this purpose, a thermal face database was acquired for 40 volunteers. Contrary to most of existing thermal databases of faces, we publish our dataset...
-
Comparison of Classification Methods for EEG Signals of Real and Imaginary Motion
PublicationThe classification of EEG signals provides an important element of brain-computer interface (BCI) applications, underlying an efficient interaction between a human and a computer application. The BCI applications can be especially useful for people with disabilities. Numerous experiments aim at recognition of motion intent of left or right hand being useful for locked-in-state or paralyzed subjects in controlling computer applications....
-
Practical application of in motion charging: Trolleybuses service on bus lines
PublicationNight charging and fast charging are currently the two most common systems for charging electric buses. Despite the fact that numerous trial installations were started, neither of these two systems has obtained unqualified approval of the users. The alternative is to charge vehicles in motion (the so-called In Motion Charging), which combines the advantages of trolleybus transport and of electric buses: the main supply source are...
-
Comparison of Methods for Real and Imaginary Motion Classification from EEG Signals
PublicationA method for feature extraction and results of classification of EEG signals obtained from performed and imagined motion are presented. A set of 615 features was obtained to serve for the recognition of type and laterality of motion using 8 different classifications approaches. A comparison of achieved classifiers accuracy is presented in the paper, and then conclusions and discussion are provided. Among applied algorithms the...
-
The Motion Analysis of Attacus Atlas Rigid Wing
PublicationThe remarkable aerodynamic efficiency of flapping insect wings has fascinated researchers for many years. Butterfly wings are distinguished by a much larger lifting surface, and thus, a different style of flapping flight. The considerations described in the article are an introduction to a fully flexible analysis of the wing in motion. The study of the rigid wing gives the basic knowledge necessary in the further process. The yaw,...
-
Enhancing capabilities of Atomic Force Microscopy by tip motion harmonics analysis
PublicationMotion of a tip used in an atomic force microscope can be described by the Lennard-Jones potential, approximated by the van der Waals force in a long-range interaction. Here we present a general framework of approximation of the tip motion by adding three terms of Taylor series what results in non-zero harmonics in an output signal. We have worked out a measurement system which allows recording of an excitation tip signal and its...
-
IMAGE CORRELATION AS A TOLL FOR TRACKING FACIAL CHANGES CAUSING BY EXTERNAL STIMULI
PublicationExpressions of the human face bring a lot of information, which are a valuable source in the areas of computer vision, remote sensing and affective computing. For years, by analyzing the movement of the skin and facial muscles scientists are trying to create the perfect tool, based on image analysis, allowing the recognition of emotional states of human beings. To create a reliable algorithm, it is necessary to explore and examine...
-
Investigation of Weigh-in-Motion Measurement Accuracy on the Basis of Steering Axle Load Spectra
PublicationWeigh-in-motion systems are installed in pavements or on bridges to identify and reduce the number of overloaded vehicles and minimise their adverse eect on road infrastructure. Moreover, the collected trac data are used to obtain axle load characteristics, which are very useful in road infrastructure design. Practical application of data from weigh-in-motion has become more common recently, which calls for adequate attention to...
-
Calculation of motion trajectory and geometric parameters of the trawl during pelagic fishing
PublicationThis paper presents a mathematical model of the mass centre motion trajectory of the trawl, its main geometrical parameters, way of solving the model as well as its example results. It could be useful to define optimum parameters of safe, effective and environmentally friendly pelagic fishing.
-
Correlated Particle Motion and THz Spectral Response of Supercritical Water
PublicationMolecular dynamics simulations of supercritical water reveal distinctly different distance-dependent modulations of dipolar response and correlations in particle motion compared to ambient conditions. The strongly perturbed H-bond network of water at supercritical conditions allows for considerable translationaland rotational freedom of individual molecules. These changes give rise to substantially different infrared spectra and...
-
Deformable model of a butterfly in motion on the example of Attacus atlas
PublicationInsect wings can undergo significant chordwise (camber) as well as spanwise (twist) deformation during flapping flight but the effect of these deformations is not well understood. The shape and size of butterfly wings leads to particularly large wing deformations, making them an ideal test case for investigation of these effects. High-speed videogrammetry was used to capture the wing kinematics and deformations. The movements of...
-
Motion Trajectory Prediction in Warehouse Management Systems: A Systematic Literature Review
PublicationBackground: In the context of Warehouse Management Systems, knowledge related to motion trajectory prediction methods utilizing machine learning techniques seems to be scattered and fragmented. Objective: This study seeks to fill this research gap by using a systematic literature review approach. Methods: Based on the data collected from Google Scholar, a systematic literature review was performed, covering the period from 2016...
-
Real-Time Facial Features Detection from Low Resolution Thermal Images with Deep Classification Models
PublicationDeep networks have already shown a spectacular success for object classification and detection for various applications from everyday use cases to advanced medical problems. The main advantage of the classification models over the detection models is less time and effort needed for dataset preparation, because classification networks do not require bounding box annotations, but labels at the image level only. Yet, after passing...