Search
prof. dr hab. inż. Jacek Rumiński
Employment
- Professor at Department of Biomedical Engineering
- Head of Department at Department of Biomedical Engineering
- Head of the AI Bay Club at Gdańsk University of Technology
Publications
Filters
total: 191
Catalog Publications
Year 2019
-
Using Eye-tracking to get information on the skills acquisition by the radiology residents
PublicationThis paper describes the possibility of monitoring the progress of knowledge and skills acquisition by the students of radiology. It is achieved by an analysis of a visual attention distribution patterns during image-based tasks solving. The concept is to use the eye-tracking data to recognize the way how the radiographic images are read by recognized experts, radiography residents involved in the training program, and untrained...
-
ZINTEGROWANY SYSTEM DOMOWEGO MONITORINGU PARAMETRÓW MEDYCZNYCH OSÓB STARSZYCH I CHORYCH
PublicationProponowane rozwiązania mają na celu wspomaganie osób starszych i chorych, tak by mogły jak najdłużej mieszkać i żyć samodzielnie ze zwiększonym poczuciem bezpieczeństwa, iż są nadzorowane i w razie nagłego zagrożenia życia nie pozostaną bez pomocy. System jednocześnie nie narusza poczucia zachowania prywatności i intymności, gdyż nie są używane do monitoringu kamery wizyjne czy też stały nasłuch audio. Dodatkowo gromadzone informacje...
Year 2018
-
A Meta-Analysis of Pulse Arrival Time Based Blood Pressure Estimation
PublicationThe paper presents a preliminary meta-analysis of the sample correlation between pulse arrival time (PAT) and blood pressure (BP). The aim of the study was to verify sample correlation coefficient between PAT and BP using an affine model BP = a · P AT + b for systolic and diastolic blood pressure. The databases included in the search were the IEEE Xplore Digital Library, Springer Link and Google Scholar. Only papers from 2005 to...
-
Analysis of the Accuracy of Pulse Estimation Using Smart Watches
PublicationThe purpose of this paper is to perform an analysis of the accuracy of the pulse estimation by comparing readings from a smartwatch with readings from medical devices. The study required writing applications that allow continuous pulse measurement. As a result, two applications were created for the smartwatch. The first one is dedicated to Android Wear devices, while the other one is compatible with Tizen watches. The next step...
-
Digits Recognition with Quadrant Photodiode and Convolutional Neural Network
PublicationIn this paper we have investigated the capabilities of a quadrant photodiode based gesture sensor in the recognition of digits drawn in the air. The sensor consisting of 4 active elements, 4 LEDs and a pinhole was considered as input interface for both discrete and continuous gestures. Index finger and a round pointer were used as navigating mediums for the sensor. Experiments performed with 5 volunteers...
-
Gesture Recognition With the Linear Optical Sensor and Recurrent Neural Networks
PublicationIn this paper, the optical linear sensor, a representative of low-resolution sensors, was investigated in the multiclass recognition of near-field hand gestures. The recurrent neural network (RNN) with a gated recurrent unit (GRU) memory cell was utilized as a gestures classifier. A set of 27 gestures was collected from a group of volunteers. The 27 000 sequences obtained were divided into training, validation, and test subsets....
-
Long Distance Vital Signs Monitoring with Person Identification for Smart Home Solutions
PublicationAbstract— Imaging photoplethysmography has already been proved to be successful in short distance (below 1m). However, most of the real-life use cases of measuring vital signs require the system to work at longer distances, to be both more reliable and convenient for the user. The possible scenarios that system designers must have in mind include monitoring of the vital signs of residents in nursing homes, disabled people, who...
-
Optical Sensor Based Gestures Inference Using Recurrent Neural Network in Mobile Conditions
PublicationIn this paper the implementation of recurrent neural network models for hand gesture recognition on edge devices was performed. The models were trained with 27 hand gestures recorded with the use of a linear optical sensor consisting of 8 photodiodes and 4 LEDs. Different models, trained off-line, were tested in terms of different network topologies (different number of neurons and layers) and different effective sampling frequency...
-
Pose-Invariant Face Detection by Replacing Deep Neurons with Capsules for Thermal Imagery in Telemedicine
PublicationAbstract— The aim of this work was to examine the potential of thermal imaging as a cost-effective tool for convenient, non- intrusive remote monitoring of elderly people in different possible head orientations, without imposing specific behavior on users, e.g. looking toward the camera. Illumination and pose invariant head tracking is important for many medical applications as it can provide information, e.g. about vital signs, sensory...
-
Real-Time Facial Features Detection from Low Resolution Thermal Images with Deep Classification Models
PublicationDeep networks have already shown a spectacular success for object classification and detection for various applications from everyday use cases to advanced medical problems. The main advantage of the classification models over the detection models is less time and effort needed for dataset preparation, because classification networks do not require bounding box annotations, but labels at the image level only. Yet, after passing...
-
Remote Estimation of Video-Based Vital Signs in Emotion Invocation Studies
PublicationAbstract— The goal of this study is to examine the influence of various imitated and video invoked emotions on the vital signs (respiratory and pulse rates). We also perform an analysis of the possibility to extract signals from sequences acquired with cost-effective cameras. The preliminary results show that the respiratory rate allows for better separation of some emotions than the pulse rate, yet this relation highly depends...
-
The analysis of temperature changes of the saliva traces left on the fur during laboratory rats social contacts
PublicationAutomatic analysis of complex rodent social be- havior, especially aggressive ones, is of important scientific interest. In this paper we analyze the properties of the data created as a result of aggressive rodent social behavior. Detec- tion of specific aggressive behaviors is based on the event of leaving traces of saliva on the fur of the attacked individual, which are clearly visible in the thermal imaging. The traces change...
-
The passive operating mode of the linear optical gesture sensor
PublicationThe study evaluates the influence of natural light conditions on the effectiveness of the linear optical gesture sensor, working in the presence of ambient light only (passive mode). The orientations of the device in reference to the light source were modified in order to verify the sensitivity of the sensor. A criterion for the differentiation between two states - "possible gesture" and "no gesture" - was proposed. Additionally,...
-
Towards Contactless, Hand Gestures-Based Control of Devices
PublicationGesture-based intuitive interactions with electronic devices can be an important part of smart home systems. In this paper, we adapt the contactless linear gesture sensor for the navigation of smart lighting system. Set of handled gestures allow to propose two methods of active light source selection, continuous dimming, and turning on and off based on discrete gestures. The average gesture recognition accuracy was 97.58% in the...
Year 2017
-
Analysis of Properties of an Active Linear Gesture Sensor
PublicationBasic gesture sensors can play a significant role as input units in mobile smart devices. However, they have to handle a wide variety of gestures while preserving the advantages of basic sensors. In this paper a user-determined approach to the design of a sparse optical gesture sensor is proposed. The statistical research on a study group of individuals includes the measurement of user-related parameters like the speed of a performed...
-
Automatic analysis of the aggressive behavior of laboratory animals using thermal video processing
PublicationThe bite detection is very important but difficult element of the social interaction analysis. Standard observation methods like human observer or a camcorder of visible light frequencies fail in this case. However, it is possible to discern cooler spots on the rodent's body that appear after body contact with another individual, and vanish after short time. These spots are assumed to be a saliva trace left on fur after bite. In...
-
BIG DATA SIGNIFICANCE IN REMOTE MEDICAL DIAGNOSTICS BASED ON DEEP LEARNING TECHNIQUES
PublicationIn this paper we discuss the evaluation of neural networks in accordance with medical image classification and analysis. We also summarize the existing databases with images which could be used for training deep models that can be later utilized in remote home-based health care systems. In particular, we propose methods for remote video-based estimation of patient vital signs and other health-related parameters. Additionally, potential...
-
Deep Features Class Activation Map for Thermal Face Detection and Tracking
PublicationRecently, capabilities of many computer vision tasks have significantly improved due to advances in Convolutional Neural Networks. In our research, we demonstrate that it can be also used for face detection from low resolution thermal images, acquired with a portable camera. The physical size of the camera used in our research allows for embedding it in a wearable device or indoor remote monitoring solution for elderly and disabled...
-
Duże zbiory danych w zdalnej diagnostyce medycznej z wykorzystaniem technik głębokiego uczenia,
PublicationW ostatnim czasie obserwujemy tendencję globalnego starzenia się i znaczących zmian struktur demograficznych na całym świecie. Zgodnie z raportem przedstawionym przez Moody Investors Service, przewiduje się, iż do 2030 roku liczba znacząco-starzejących się krajów wzrośnie z 3 do 34. Światowy proces starzenia się społeczeństw doprowadził do wzrastających oczekiwań wobec starszych osób do pozostania niezależnymi. W związku z tym...
-
Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions
PublicationRespiratory rate is very important vital sign that should be measured and documented in many medical situations. The remote measurement of respiration rate can be especially valuable for medical screening purposes (e.g. severe acute respiratory syndrome (SARS), pandemic influenza, etc.). In this chapter we present a review of many different studies focused on the measurements and estimation of respiration rate using thermal imaging...
-
Extending touch-less interaction with smart glasses by implementing EMG module
PublicationIn this paper we propose to use temporal muscle contraction to perform certain actions. Method: The set of muscle contractions corresponding to one of three actions including “single-click”, “double-click” “click-n-hold” and “non-action” were recorded. After recording certain amount of signals, the set of five parameters was calculated. These parameters served as an input matrix for the neural network. Two-layer feedforward neural...
-
Open smart glasses development platform for AAL applications
PublicationThis paper describes an open platform for multi sensory electronic glasses that supports new and enhanced methods for intelligent interaction with patients, with smart objects, or to be used as new data input modalities like proximity sensor or smart textile interfaces. All the activities have been developed, investigated and evaluated within EU CHIST-ERA eGlasses project...
-
Playback detection using machine learning with spectrogram features approach
PublicationThis paper presents 2D image processing approach to playback detection in automatic speaker verification (ASV) systems using spectrograms as speech signal representation. Three feature extraction and classification methods: histograms of oriented gradients (HOG) with support vector machines (SVM), HAAR wavelets with AdaBoost classifier and deep convolutional neural networks (CNN) were compared on different data partitions in respect...
-
Pose classification in the gesture recognition using the linear optical sensor
PublicationGesture sensors for mobile devices, which have a capability of distinguishing hand poses, require efficient and accurate classifiers in order to recognize gestures based on the sequences of primitives. Two methods of poses recognition for the optical linear sensor were proposed and validated. The Gaussian distribution fitting and Artificial Neural Network based methods represent two kinds of classification approaches. Three types...
-
The motion influence on respiration rate estimation from low-resolution thermal sequences during attention focusing tasks
PublicationGlobal aging has led to a growing expectancy for creating home-based platforms for indoor monitoring of elderly people. A motivation is to provide a non-intrusive technique, which does not require special activities of a patient but allows for remote monitoring of elderly people while assisting them with their daily activities. The goal of our study was to evaluate motion performed by a person focused on a specific task and check...
-
The role of EMG module in hybrid interface of prosthetic arm
PublicationNearly 10% of all upper limb amputations concern the whole arm. It affects the mobility and reduces the productivity of such a person. These two factors can be restored by using prosthetics. However, the complexity of human arm makes restoring its basic functions quite difficult. When the osseointegration and/or targeted muscle reinnervation (TMR) are not possible, different modalities can be used to control the prosthesis. In...
-
Virtual designs and reconstructions of amber works: Amber craftsman simulator
PublicationThis paper presents the concept of visualization of amber works in a virtual reality cave. It describes problems encountered during the acquisition, modeling and rendering of geometrical objects distinguished by heterogeneous transparency.
Year 2016
-
Accuracy analysis of the RSSI BLE SensorTag signal for indoor localization purposes
PublicationIn this paper we describe possibility of use the RSSI signal (Radio Signal Strength Indication) from Texas Instruments SensorTag CC2650 for indoor positioning purposes. This idea is not a new but in our opinion it is possible to use SensorTags with Bluetooth LE wireless interface for positioning inside buildings in such applications as people findings in hospitals, senior come care, etc. RSSI is mostly selected as the sensor localization...
-
Analysis of the parameters of respiration patterns extracted from thermal image sequences
PublicationRemote estimation of vital signs is an important and active area of research. The goal of this work was to analyze the feasibility of estimating respiration parameters from video sequences of faces recorded using a mobile thermal camera. Different estimators were analyzed and experimentally verified. It was demonstrated that the respiration rate, periodicity of respiration, and presence and length of apnea periods could be reliably...
-
Cardiovascular data analysis using electronic wearable eyeglasses-preliminary study
Publicationhe paper presents an alternative approach to the monitoring of the cardiovascular system. The study depicts configurations of the utilized system and preliminary results of electrical and mechanical parameters of the cardiac system which can be measured using a head-worn device.
-
EMG and gaze based interaction with graphic interface of smart glasses application
PublicationIn this paper we investigate the effectiveness of the interaction using eye tracking and electromyography. Smart glasses requires reliable interfaces for controlling the graphic content displayed directly in front of the user's eye. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of...
-
Enhanced Eye-Tracking Data: a Dual Sensor System for Smart Glasses Applications
PublicationA technique for the acquisition of an increased number of pupil positions, using a combined sensor consisting of a low-rate camera and a high-rate optical sensor, is presented in this paper. The additional data are provided by the optical movement-detection sensor mounted in close proximity to the eyeball. This proposed solution enables a significant increase in the number of registered fixation points and saccades and can be used...
-
Estimation of respiration rate using an accelerometer and thermal camera in eGlasses
PublicationRespiration rate is a very important vital sign. Different methods of respiration rate measurement or estimation have been developed. However, especially interesting are those that enable remote and unobtrusive monitoring. In this study, we investigated the use of smart glasses for the estimation of respiration rate especially useful for indoors applications. Two methods were analyzed. The first one is based on measurements of...
-
Estimation of the amplitude of the signal for the active optical gesture sensor with sparse detectors
PublicationIn this paper we deal with the problem of precise gesture recognition for the active optical proximity sensor with sparse 8 photodiodes. We particularly focus on developing the method of estimating the real, usually not observable, maximum signal value representing maximum intensity of light reflected from an obstacle present in the front of the sensor. Different configurations of the fingers were used as an obstacle. The Monte Carlo...
-
Evaluation of respiration rate and pattern using a portable thermal camera
PublicationThe goal of this paper was to analyze the accuracy of the proposed method for the evaluation of respiration rate and respiration rhythm patterns (e.g. inspiration slope) using the portable and mobile thermal camera module that could be a part of smart glasses. Parameters were analyzed for 12 volunteers in two experiments, when subjects speak and do not speak. The pressure, chest belt was used as a reference measurement method....
-
Face detection in image sequences using a portable thermal camera
PublicationFace detection is often a first step in quantitative analysis of face images. It is an important research area for visible images and recently also for thermography. Due to technological developments thermal cameras may be embedded into wearable devices to provide remote healthcare. In this paper, we compared three algorithms for face detection in thermal images by testing execution time, accuracy, symmetry ratio and false-positives....
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublicationW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublicationW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Performance Analysis of Interaction between Smart Glasses and Smart Objects Using Image-Based Object Identification
PublicationWe propose the use of smart glasses to collaborate with smart objects in the Internet of Things environment. Particularly we are focusing on new interaction methods and the analysis of acceptable reaction times in the process of object recognition using smart glasses. We evaluated the proposed method using user studies and experiments with three different smart glasses: Google Glass, Epson Moverio, and the developed eGlasses platform....
-
Real-time facial feature tracking in poor quality thermal imagery
PublicationRecently, facial feature tracking systems have become more and more popular because of many possible use cases. Especially in medical applications location of the face and facial features are very useful. Many researches have presented methods to detect and track facial features in visible light. However, facial feature analysis in thermography may also be very advantageous. Some examples of using infrared imagery in medicine include...
-
Reliability of Pulse Measurements in Videoplethysmography
PublicationReliable, remote pulse rate measurement is potentially very important for medical diagnostics and screening. In this paper the Videoplethysmography was analyzed especially to verify the possible use of signals obtained for the YUV color model in order to estimate the pulse rate, to examine what is the best pulse estimation method for short video sequences and finally, to analyze how potential PPG-signals can be distinguished from...
-
Self diagnostics using smart glasses - preliminary study
Publicationn this preliminary study we analyzed the possibility of the reliable measurement of biomedical signals with some potential hardware extensions of smart glasses. Using specially designed experimental prototypes four category of biomedical signals were measured: electrocardiograms, electromyograms, electroencephalograms and respiration waveforms. Experi- ments with volunteers proved that using even simple construc- tion of sensors...
-
Semi complex navigation with an active optical gesture sensor
PublicationThis paper presents the methods of diversified touchless interactions between a user and a mobile platform utilizing the optical gesture sensor. The sensor uses 8 photodiodes to measure the reflected light in the active mode (using embedded LEDs) or it measures shadows caused by fingers in the passive mode. Several algorithms were implemented: automatic mode switching, adaptive illumination level compensation, resolution improvements...
-
The accuracy of pulse rate estimation from the sequence of face images
PublicationThe goal of this paper is to analyze the accuracy of pulse rate estimation from the sequence of face images. Simulated and real signals were used to evaluate two pulse rate estimators; one for frequency domain and the second one for time domain using the autocorrelation function. The results show that the mean difference between the reference measurements and estimated pulse rate values are about 2bpm. In the analysis of short...
-
The data exchange between smart glasses and healthcare information systems using the HL7 FHIR standard
PublicationIn this study we evaluated system architecture for the use of smart glasses as a viewer of information, as a source of medical data (vital sign measurements: temperature, pulse rate, and respiration rate), and as a filter of healthcare information. All activities were based on patient/device identification procedures using graphical markers or features based on visual appearance. The architecture and particular use cases were implemented...
-
The evaluation of eGlasses eye tracking module as an extension for Scratch
PublicationIn this paper we present the possibility of using eGlasses eye tracking module as an extension for Scratch programming tool which is a visual programming language supporting computer skills learning. The main concept behind this project is to setup the interface for rapid interaction design. Eye tracking is a powerful tool for hands free communication but for that requires a dedicated software. This software is rarely tailored...
-
The Evaluation of Use of Colors in Graphical User-Interfaces in Healthcare
PublicationIn this paper, color difference/contrast measures are investigated in reference to results of experiments with the participation of average, color-normal observers and with individuals with deuteranopia. Additionally, a new method for the automatic analysis of color contrast is proposed, which supports designers of graphical user- interfaces in healthcare. The method was verified using the GUI phantom of a vital signs monitor (the...
Year 2015
-
Active and Dynamic Graphical Code for Object Identification in Healthcare
PublicationA new approach for item marking using two dimensional discrete graphics markers. Proposed solution allow o change the code rapidly, upon request and in the case of thermal markers make the code invisible for unauthorized observers. Connecting the proposed codes with wearable multmedial platform such as eGlasses can create new possibilities in human-environment interaction.
-
Application of smart glasses for fast and automatic color correction in health care
PublicationIn recent years different applications of smart glasses in health care have been proposed. In this paper we present the experiments related to automatic color correction using smart glasses platform developed within the eGlasses project. The color pattern is proposed and tested enabling the automatic detection of the pattern and automatic correction of colors. Additionally, the method for encoding and decoding of patient ID in...
-
Color Processing for Color-Blind Individuals Using Smart Glasses
PublicationIn this paper we investigated image processing methods for color-blind individuals. In particular we experimentally verified color naming procedure, generation of maps with color perception differences for average observers and for dichromats, and two color transformation methods. In experiments 7 mobile devices were used: 3 smart glasses and 4 smartphones. User studies were performed with 38 average observers and 9 dichromats....
seen 9937 times