Search
Search results for: MULTI-MODALITY
-
Multi-modality imaging in the CIRCULATE-AMI pilot study cohort: a framework for an imaging-based randomized controlled trial of Wharton jelly mesenchymal stem cell use to stimulate myocardial repair/regeneration
Publication -
Improved-Efficacy Optimization of Compact Microwave Passives by Means of Frequency-Related Regularization
PublicationElectromagnetic (EM)-driven optimization is an important part of microwave design, especially for miniaturized components where the cross-coupling effects in tightly arranged layouts make traditional (e.g., equivalent network) representations grossly inaccurate. Efficient parameter tuning requires reasonably good initial designs, which are difficult to be rendered for newly developed structures or when re-design for different operating...
-
Scoreboard Architectural Pattern and Integration of Emotion Recognition Results
PublicationThis paper proposes a new design pattern, named Scoreboard , dedicated for applications solving complex, multi-stage, non-deterministic problems. The pattern provides a computational framework for the design and implementation of systems that integrate a large number of diverse specialized modules that may vary in accuracy, solution level, and modality. The Scoreboard is an extension of Blackboard design pattern and comes under...
-
Generalized Formulation of Response Features for Reliable Optimization of Antenna Input Characteristics
PublicationElectromagnetic (EM)-driven parameter adjustment has become imperative in the design of modern antennas. It is necessary because the initial designs rendered through topology evolution, parameter sweeping, or theoretical models, are often of poor quality and need to be improved to satisfy stringent performance requirements. Given multiple objectives, constraints, and a typically large number of geometry parameters, the design closure...
-
Quantitative Active Dynamic Thermal IR-Imaging and Thermal Tomography in Medical Diagnostic
PublicationPrinciples of Active dynamic thermal (ADT) IR-imaging and Thermal Tomography are described in details. Basic medical applications of this new modality are also discussed.
-
Bimodal Emotion Recognition Based on Vocal and Facial Features
PublicationEmotion recognition is a crucial aspect of human communication, with applications in fields such as psychology, education, and healthcare. Identifying emotions accurately is challenging, as people use a variety of signals to express and perceive emotions. In this study, we address the problem of multimodal emotion recognition using both audio and video signals, to develop a robust and reliable system that can recognize emotions...
-
Intelligent video and audio applications for learning enhancement
PublicationThe role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality....
-
Intelligent multimedia solutions supporting special education needs.
PublicationThe role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality....
-
Using deep learning to increase accuracy of gaze controlled prosthetic arm
PublicationThis paper presents how neural networks can be utilized to improve the accuracy of reach and grab functionality of hybrid prosthetic arm with eye tracing interface. The LSTM based Autoencoder was introduced to overcome the problem of lack of accuracy of the gaze tracking modality in this hybrid interface. The gaze based interaction strongly depends on the eye tracking hardware. In this paper it was presented how the overall the...
-
User Authentication by Eye Movement Features Employing SVM and XGBoost Classifiers
PublicationDevices capable of tracking the user’s gaze have become significantly more affordable over the past few years, thus broadening their application, including in-home and office computers and various customer service equipment. Although such devices have comparatively low operating frequencies and limited resolution, they are sufficient to supplement or replace classic input interfaces, such as the keyboard and mouse. The biometric...
-
Inertial Sensors Applications in Underwater Measurements
PublicationOver the past decades microelectromechanical systems (MEMS) researchers have demonstrated a number of microsensors for almost every possible sensing modality, including attitudes. Current MEMS inertial measurement units (IMU) come in many shapes, sizes, and costs — depending on the application, and performance required. MEMS sensors have proved and demonstrated performance exceeding those of their macroscale counterpart sensors. In...
-
Pursuing Listeners’ Perceptual Response in Audio-Visual Interactions - Headphones vs Loudspeakers: A Case Study
PublicationThis study investigates listeners’ perceptual responses in audio-visual interactions concerning binaural spatial audio. Audio stimuli are coupled with or without visual cues to the listeners. The subjective test participants are tasked to indicate the direction of the incoming sound while listening to the audio stimulus via loudspeakers or headphones with the head-related transfer function (HRTF) plugin. First, the methodology...
-
Milky Sap of Greater Celandine (Chelidonium majus L.) and Anti-Viral Properties
PublicationThe milky juice of the greater celandine herb has been used in folk medicine and in homeopathy for treatment of viral warts for years. However, classical medicine fails to use properties of celandine herbs in treatment of diseases induced by papilloma viruses. Nevertheless, dermatological outpatient clinics are regularly visited by patients reporting efficacy of milky sap isolated from celandine herb in treatment of their own...
-
Methodology and technology for the polymodal allophonic speech transcription
PublicationA method for automatic audiovisual transcription of speech employing: acoustic and visual speech representations is developed. It adopts a combining of audio and visual modalities, which provide a synergy effect in terms of speech recognition accuracy. To establish a robust solution, basic research concerning the relation between the allophonic variation of speech, i.e. the changes in the articulatory setting of speech organs for...
-
Methodology and technology for the polymodal allophonic speech transcription
PublicationA method for automatic audiovisual transcription of speech employing: acoustic, electromagnetical articulography and visual speech representations is developed. It adopts a combining of audio and visual modalities, which provide a synergy effect in terms of speech recognition accuracy. To establish a robust solution, basic research concerning the relation between the allophonic variation of speech, i.e., the changes in the articulatory...
-
Automatic Marking of Allophone Boundaries in Isolated English spoken Words
PublicationThe work presents a method that allows delimiting the borders of allophones in isolated English words. The described method is based on the DTW algorithm combining two signals, a reference signal and an analyzed one. As the reference signal, recordings from the MODALITY database were used, from which the words were extracted. This database was also used for tests, which were described. Test results show that the automatic determination...
-
Usability study of various biometric techniques in bank branches
PublicationThe purpose of the presented research was to evaluate the performance of the prepared biometric algorithms and obtain information on the opinions and preferences of their users in bank branches. The study aimed to determine users' attitudes towards particular modalities and preferences on how to use biometrics after the bank customers had practical experience with the operation of the prototype solutions. The research results...
-
Active Dynamic Infrared Thermal Imaging in Burn Depth Evaluation
PublicationThe aim of this study was to find the relationship between active dynamic thermography (ADT) with cold excitation and burn depth. This new modality of evaluation of burns seems to be an attractive proposal for quantitative classification, allowing proper choice of burn wound treatment: conservative or surgical, especially compared with static thermography. The work was an in vivo experiment on domestic pigs, and a small number...
-
The role of EMG module in hybrid interface of prosthetic arm
PublicationNearly 10% of all upper limb amputations concern the whole arm. It affects the mobility and reduces the productivity of such a person. These two factors can be restored by using prosthetics. However, the complexity of human arm makes restoring its basic functions quite difficult. When the osseointegration and/or targeted muscle reinnervation (TMR) are not possible, different modalities can be used to control the prosthesis. In...
-
Assessment of particular abdominal aorta section extraction from contrast-enhanced computed tomography angiography
PublicationThe aim of this work is to improve the accuracy of extraction of a particular abdominal aorta section and to reduce the distortion in three-dimensional Computed Tomography Angiography (CTA) images. Imaging modality and quality plays crucial role in the medical diagnostic process, thus ensuring high quality of images is essential at every stage of acquisition and processing.Noise is defined as a disturbance of the image quality...
-
Neural Oscillation During Mental Imagery in Sport: An Olympic Sailor Case Study
PublicationThe purpose of the current study was to examine the cortical correlates of imagery depending on instructional modality (guided vs. self-produced) using various sports-related scripts. According to the expert-performance approach, we took an idiosyncratic perspective analyzing the mental imagery of an experienced two-time Olympic athlete to verify whether different instructional modalities of imagery (i.e., guided vs. self-produced)...
-
Comparative study on the effectiveness of various types of road traffic intensity detectors
PublicationVehicle detection and speed measurements are crucial tasks in traffic monitoring systems. In this work, we focus on several types of electronic sensors, operating on different physical principles in order to compare their effectiveness in real traffic conditions. Commercial solutions are based on road tubes, microwave sensors, LiDARs, and video cameras. Distributed traffic monitoring systems require a high number of monitoring...
-
Encapsulation of an anticancer drug Isatin inside a host nano-vehicle SWCNT: a molecular dynamics simulation
PublicationThe use of carbon nanotubes as anticancer drug delivery cargo systems is a promising modality as they are able to perforate cellular membranes and transport the carried therapeutic molecules into the cellular components. Our work describes the encapsulation process of a common anticancer drug, Isatin (1H-indole-2,3-dione) as a guest molecule, in a capped single-walled carbon nanotube (SWCNT) host with chirality of (10,10). The...
-
Application of micellar electrokinetic chromatography for detection of silver nanoparticles released from wound dressing
PublicationThe recent emergence of nanotechnology has provided a new therapeutic modality in case of silver nanoparticles. Dressings containing silver form the basis for the treatment of burns and wounds, either acute or chronic ones. The aim of the study was to examine silver release from the different wound dressings: commercially available (Atrauman Ag, Aqua- cel Ag) and experimental (FKDP-AgNPs) using MEKC. In order to characterize prepared keratin...
-
Emotion Recognition from Physiological Channels Using Graph Neural Network
PublicationIn recent years, a number of new research papers have emerged on the application of neural networks in affective computing. One of the newest trends observed is the utilization of graph neural networks (GNNs) to recognize emotions. The study presented in the paper follows this trend. Within the work, GraphSleepNet (a GNN for classifying the stages of sleep) was adjusted for emotion recognition and validated for this purpose. The...