Search
Filters
total: 25
Search results for: LIP TRACKING
-
Human-Computer Interface Based on Visual Lip Movement and Gesture Recognition
PublicationThe multimodal human-computer interface (HCI) called LipMouse is presented, allowing a user to work on a computer using movements and gestures made with his/her mouth only. Algorithms for lip movement tracking and lip gesture recognition are presented in details. User face images are captured with a standard webcam. Face detection is based on a cascade of boosted classifiers using Haar-like features. A mouth region is located in...
-
Bimodal classification of English allophones employing acoustic speech signal and facial motion capture
PublicationA method for automatic transcription of English speech into International Phonetic Alphabet (IPA) system is developed and studied. The principal objective of the study is to evaluate to what extent the visual data related to lip reading can enhance recognition accuracy of the transcription of English consonantal and vocalic allophones. To this end, motion capture markers were placed on the faces of seven speakers to obtain lip...
-
Vocalic Segments Classification Assisted by Mouth Motion Capture
PublicationVisual features convey important information for automatic speech recognition (ASR), especially in noisy environment. The purpose of this study is to evaluate to what extent visual data (i.e. lip reading) can enhance recognition accuracy in the multi-modal approach. For that purpose motion capture markers were placed on speakers' faces to obtain lips tracking data during speaking. Different parameterizations strategies were tested...
-
Multimodal human-computer interfaces based on advanced video and audio analysis
PublicationMultimodal interfaces development history is reviewed briefly in the introduction. Some applications of multimodal interfaces to education software for disabled people are presented. One of them, the LipMouse is a novel, vision-based human-computer interface that tracks user’s lip movements and detect lips gestures. A new approach to diagnosing Parkinson’s disease is also shown. The progression of the disease can be measured employing...
-
Assessment of the activities of private universities in the context of quality management in 2010
Open Research DataIn all universities, the assessment of the quality is made by the supervisor, the opinion of students and the admission of classes have the greatest impact on the assessment of the quality of education. Subsequent tracking of the student's fate has a slightly smaller impact on the grade. Research also shows that only 4 out of 7 respondents monitor the...
-
Data gathered in the course of therapeutic sessions carried out with patients suffering from acquired brain damages
Open Research DataThe dataset contains signals gathered in the course of therapeutic sessions carried out with patients suffering from acquired brain damages. Participants’ actions were monitored with an eye-gaze tracking (EGT) device and with an electroencephalogram EEG monitoring headset.
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0011)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_009)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_004)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_005)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0010)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_002)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0012)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_008)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_003)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_007)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_006)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0017)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0021)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0020)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0019)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0024)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Invasive electrophysiological patient recordings from the human brain during memory tasks with pupilometry (MC_0023)
Open Research DataData comprise intracranial EEG (iEEG) brain activity, including electrocorticography (ECoG) signals, recorded from over 100 electrodes implanted in one patient throughout various brain regions. These iEEG signals were recorded in epilepsy patients undergoing invasive monitoring and localization of seizures when they were performing a battery of four...
-
Very low resolution depth images of 200,000 poses
Open Research DataA dataset represents simulated images of depth sensor seeing a single human pose, performing 200,000 random gestures. The depth images as vectors of pixels are stored with ground truth positions of every relevant joint.
-
EXAMINING INFLUENCE OF VIDEO FRAMERATE AND AUDIO/VIDEO SYNCHRONIZATION ON AUDIO-VISUAL SPEECH RECOGNITION ACCURACY
PublicationThe problem of video framerate and audio/video synchronization in audio-visual speech recognition is considered. The visual features are added to the acoustic parameters in order to improve the accuracy of speech recognition in noisy conditions. The Mel-Frequency Cepstral Coefficients are used on the acoustic side whereas Active Appearance Model features are extracted from the image. The feature fusion approach is employed. The...