prof. dr hab. inż. Jacek Rumiński
Zatrudnienie
- Profesor w Katedra Inżynierii Biomedycznej
- Kierownik katedry w Katedra Inżynierii Biomedycznej
- Prezes klubu Zatoka Sztucznej Inteligencji AI Bay w Politechnika Gdańska
Publikacje
Filtry
wszystkich: 185
Katalog Publikacji
Rok 2018
-
Long Distance Vital Signs Monitoring with Person Identification for Smart Home Solutions
PublikacjaAbstract— Imaging photoplethysmography has already been proved to be successful in short distance (below 1m). However, most of the real-life use cases of measuring vital signs require the system to work at longer distances, to be both more reliable and convenient for the user. The possible scenarios that system designers must have in mind include monitoring of the vital signs of residents in nursing homes, disabled people, who...
-
Optical Sensor Based Gestures Inference Using Recurrent Neural Network in Mobile Conditions
PublikacjaIn this paper the implementation of recurrent neural network models for hand gesture recognition on edge devices was performed. The models were trained with 27 hand gestures recorded with the use of a linear optical sensor consisting of 8 photodiodes and 4 LEDs. Different models, trained off-line, were tested in terms of different network topologies (different number of neurons and layers) and different effective sampling frequency...
-
Pose-Invariant Face Detection by Replacing Deep Neurons with Capsules for Thermal Imagery in Telemedicine
PublikacjaAbstract— The aim of this work was to examine the potential of thermal imaging as a cost-effective tool for convenient, non- intrusive remote monitoring of elderly people in different possible head orientations, without imposing specific behavior on users, e.g. looking toward the camera. Illumination and pose invariant head tracking is important for many medical applications as it can provide information, e.g. about vital signs, sensory...
-
Real-Time Facial Features Detection from Low Resolution Thermal Images with Deep Classification Models
PublikacjaDeep networks have already shown a spectacular success for object classification and detection for various applications from everyday use cases to advanced medical problems. The main advantage of the classification models over the detection models is less time and effort needed for dataset preparation, because classification networks do not require bounding box annotations, but labels at the image level only. Yet, after passing...
-
Remote Estimation of Video-Based Vital Signs in Emotion Invocation Studies
PublikacjaAbstract— The goal of this study is to examine the influence of various imitated and video invoked emotions on the vital signs (respiratory and pulse rates). We also perform an analysis of the possibility to extract signals from sequences acquired with cost-effective cameras. The preliminary results show that the respiratory rate allows for better separation of some emotions than the pulse rate, yet this relation highly depends...
-
The analysis of temperature changes of the saliva traces left on the fur during laboratory rats social contacts
PublikacjaAutomatic analysis of complex rodent social be- havior, especially aggressive ones, is of important scientific interest. In this paper we analyze the properties of the data created as a result of aggressive rodent social behavior. Detec- tion of specific aggressive behaviors is based on the event of leaving traces of saliva on the fur of the attacked individual, which are clearly visible in the thermal imaging. The traces change...
-
The passive operating mode of the linear optical gesture sensor
PublikacjaThe study evaluates the influence of natural light conditions on the effectiveness of the linear optical gesture sensor, working in the presence of ambient light only (passive mode). The orientations of the device in reference to the light source were modified in order to verify the sensitivity of the sensor. A criterion for the differentiation between two states - "possible gesture" and "no gesture" - was proposed. Additionally,...
-
Towards Contactless, Hand Gestures-Based Control of Devices
PublikacjaGesture-based intuitive interactions with electronic devices can be an important part of smart home systems. In this paper, we adapt the contactless linear gesture sensor for the navigation of smart lighting system. Set of handled gestures allow to propose two methods of active light source selection, continuous dimming, and turning on and off based on discrete gestures. The average gesture recognition accuracy was 97.58% in the...
Rok 2017
-
Analysis of Properties of an Active Linear Gesture Sensor
PublikacjaBasic gesture sensors can play a significant role as input units in mobile smart devices. However, they have to handle a wide variety of gestures while preserving the advantages of basic sensors. In this paper a user-determined approach to the design of a sparse optical gesture sensor is proposed. The statistical research on a study group of individuals includes the measurement of user-related parameters like the speed of a performed...
-
Automatic analysis of the aggressive behavior of laboratory animals using thermal video processing
PublikacjaThe bite detection is very important but difficult element of the social interaction analysis. Standard observation methods like human observer or a camcorder of visible light frequencies fail in this case. However, it is possible to discern cooler spots on the rodent's body that appear after body contact with another individual, and vanish after short time. These spots are assumed to be a saliva trace left on fur after bite. In...
-
BIG DATA SIGNIFICANCE IN REMOTE MEDICAL DIAGNOSTICS BASED ON DEEP LEARNING TECHNIQUES
PublikacjaIn this paper we discuss the evaluation of neural networks in accordance with medical image classification and analysis. We also summarize the existing databases with images which could be used for training deep models that can be later utilized in remote home-based health care systems. In particular, we propose methods for remote video-based estimation of patient vital signs and other health-related parameters. Additionally, potential...
-
Deep Features Class Activation Map for Thermal Face Detection and Tracking
PublikacjaRecently, capabilities of many computer vision tasks have significantly improved due to advances in Convolutional Neural Networks. In our research, we demonstrate that it can be also used for face detection from low resolution thermal images, acquired with a portable camera. The physical size of the camera used in our research allows for embedding it in a wearable device or indoor remote monitoring solution for elderly and disabled...
-
Duże zbiory danych w zdalnej diagnostyce medycznej z wykorzystaniem technik głębokiego uczenia,
PublikacjaW ostatnim czasie obserwujemy tendencję globalnego starzenia się i znaczących zmian struktur demograficznych na całym świecie. Zgodnie z raportem przedstawionym przez Moody Investors Service, przewiduje się, iż do 2030 roku liczba znacząco-starzejących się krajów wzrośnie z 3 do 34. Światowy proces starzenia się społeczeństw doprowadził do wzrastających oczekiwań wobec starszych osób do pozostania niezależnymi. W związku z tym...
-
Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions
PublikacjaRespiratory rate is very important vital sign that should be measured and documented in many medical situations. The remote measurement of respiration rate can be especially valuable for medical screening purposes (e.g. severe acute respiratory syndrome (SARS), pandemic influenza, etc.). In this chapter we present a review of many different studies focused on the measurements and estimation of respiration rate using thermal imaging...
-
Extending touch-less interaction with smart glasses by implementing EMG module
PublikacjaIn this paper we propose to use temporal muscle contraction to perform certain actions. Method: The set of muscle contractions corresponding to one of three actions including “single-click”, “double-click” “click-n-hold” and “non-action” were recorded. After recording certain amount of signals, the set of five parameters was calculated. These parameters served as an input matrix for the neural network. Two-layer feedforward neural...
-
Open smart glasses development platform for AAL applications
PublikacjaThis paper describes an open platform for multi sensory electronic glasses that supports new and enhanced methods for intelligent interaction with patients, with smart objects, or to be used as new data input modalities like proximity sensor or smart textile interfaces. All the activities have been developed, investigated and evaluated within EU CHIST-ERA eGlasses project...
-
Playback detection using machine learning with spectrogram features approach
PublikacjaThis paper presents 2D image processing approach to playback detection in automatic speaker verification (ASV) systems using spectrograms as speech signal representation. Three feature extraction and classification methods: histograms of oriented gradients (HOG) with support vector machines (SVM), HAAR wavelets with AdaBoost classifier and deep convolutional neural networks (CNN) were compared on different data partitions in respect...
-
Pose classification in the gesture recognition using the linear optical sensor
PublikacjaGesture sensors for mobile devices, which have a capability of distinguishing hand poses, require efficient and accurate classifiers in order to recognize gestures based on the sequences of primitives. Two methods of poses recognition for the optical linear sensor were proposed and validated. The Gaussian distribution fitting and Artificial Neural Network based methods represent two kinds of classification approaches. Three types...
-
The motion influence on respiration rate estimation from low-resolution thermal sequences during attention focusing tasks
PublikacjaGlobal aging has led to a growing expectancy for creating home-based platforms for indoor monitoring of elderly people. A motivation is to provide a non-intrusive technique, which does not require special activities of a patient but allows for remote monitoring of elderly people while assisting them with their daily activities. The goal of our study was to evaluate motion performed by a person focused on a specific task and check...
-
The role of EMG module in hybrid interface of prosthetic arm
PublikacjaNearly 10% of all upper limb amputations concern the whole arm. It affects the mobility and reduces the productivity of such a person. These two factors can be restored by using prosthetics. However, the complexity of human arm makes restoring its basic functions quite difficult. When the osseointegration and/or targeted muscle reinnervation (TMR) are not possible, different modalities can be used to control the prosthesis. In...
-
Virtual designs and reconstructions of amber works: Amber craftsman simulator
PublikacjaThis paper presents the concept of visualization of amber works in a virtual reality cave. It describes problems encountered during the acquisition, modeling and rendering of geometrical objects distinguished by heterogeneous transparency.
Rok 2016
-
Accuracy analysis of the RSSI BLE SensorTag signal for indoor localization purposes
PublikacjaIn this paper we describe possibility of use the RSSI signal (Radio Signal Strength Indication) from Texas Instruments SensorTag CC2650 for indoor positioning purposes. This idea is not a new but in our opinion it is possible to use SensorTags with Bluetooth LE wireless interface for positioning inside buildings in such applications as people findings in hospitals, senior come care, etc. RSSI is mostly selected as the sensor localization...
-
Analysis of the parameters of respiration patterns extracted from thermal image sequences
PublikacjaRemote estimation of vital signs is an important and active area of research. The goal of this work was to analyze the feasibility of estimating respiration parameters from video sequences of faces recorded using a mobile thermal camera. Different estimators were analyzed and experimentally verified. It was demonstrated that the respiration rate, periodicity of respiration, and presence and length of apnea periods could be reliably...
-
Cardiovascular data analysis using electronic wearable eyeglasses-preliminary study
Publikacjahe paper presents an alternative approach to the monitoring of the cardiovascular system. The study depicts configurations of the utilized system and preliminary results of electrical and mechanical parameters of the cardiac system which can be measured using a head-worn device.
-
EMG and gaze based interaction with graphic interface of smart glasses application
PublikacjaIn this paper we investigate the effectiveness of the interaction using eye tracking and electromyography. Smart glasses requires reliable interfaces for controlling the graphic content displayed directly in front of the user's eye. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of...
-
Enhanced Eye-Tracking Data: a Dual Sensor System for Smart Glasses Applications
PublikacjaA technique for the acquisition of an increased number of pupil positions, using a combined sensor consisting of a low-rate camera and a high-rate optical sensor, is presented in this paper. The additional data are provided by the optical movement-detection sensor mounted in close proximity to the eyeball. This proposed solution enables a significant increase in the number of registered fixation points and saccades and can be used...
-
Estimation of respiration rate using an accelerometer and thermal camera in eGlasses
PublikacjaRespiration rate is a very important vital sign. Different methods of respiration rate measurement or estimation have been developed. However, especially interesting are those that enable remote and unobtrusive monitoring. In this study, we investigated the use of smart glasses for the estimation of respiration rate especially useful for indoors applications. Two methods were analyzed. The first one is based on measurements of...
-
Estimation of the amplitude of the signal for the active optical gesture sensor with sparse detectors
PublikacjaIn this paper we deal with the problem of precise gesture recognition for the active optical proximity sensor with sparse 8 photodiodes. We particularly focus on developing the method of estimating the real, usually not observable, maximum signal value representing maximum intensity of light reflected from an obstacle present in the front of the sensor. Different configurations of the fingers were used as an obstacle. The Monte Carlo...
-
Evaluation of respiration rate and pattern using a portable thermal camera
PublikacjaThe goal of this paper was to analyze the accuracy of the proposed method for the evaluation of respiration rate and respiration rhythm patterns (e.g. inspiration slope) using the portable and mobile thermal camera module that could be a part of smart glasses. Parameters were analyzed for 12 volunteers in two experiments, when subjects speak and do not speak. The pressure, chest belt was used as a reference measurement method....
-
Face detection in image sequences using a portable thermal camera
PublikacjaFace detection is often a first step in quantitative analysis of face images. It is an important research area for visible images and recently also for thermography. Due to technological developments thermal cameras may be embedded into wearable devices to provide remote healthcare. In this paper, we compared three algorithms for face detection in thermal images by testing execution time, accuracy, symmetry ratio and false-positives....
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublikacjaW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublikacjaW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Performance Analysis of Interaction between Smart Glasses and Smart Objects Using Image-Based Object Identification
PublikacjaWe propose the use of smart glasses to collaborate with smart objects in the Internet of Things environment. Particularly we are focusing on new interaction methods and the analysis of acceptable reaction times in the process of object recognition using smart glasses. We evaluated the proposed method using user studies and experiments with three different smart glasses: Google Glass, Epson Moverio, and the developed eGlasses platform....
-
Real-time facial feature tracking in poor quality thermal imagery
PublikacjaRecently, facial feature tracking systems have become more and more popular because of many possible use cases. Especially in medical applications location of the face and facial features are very useful. Many researches have presented methods to detect and track facial features in visible light. However, facial feature analysis in thermography may also be very advantageous. Some examples of using infrared imagery in medicine include...
-
Reliability of Pulse Measurements in Videoplethysmography
PublikacjaReliable, remote pulse rate measurement is potentially very important for medical diagnostics and screening. In this paper the Videoplethysmography was analyzed especially to verify the possible use of signals obtained for the YUV color model in order to estimate the pulse rate, to examine what is the best pulse estimation method for short video sequences and finally, to analyze how potential PPG-signals can be distinguished from...
-
Self diagnostics using smart glasses - preliminary study
Publikacjan this preliminary study we analyzed the possibility of the reliable measurement of biomedical signals with some potential hardware extensions of smart glasses. Using specially designed experimental prototypes four category of biomedical signals were measured: electrocardiograms, electromyograms, electroencephalograms and respiration waveforms. Experi- ments with volunteers proved that using even simple construc- tion of sensors...
-
Semi complex navigation with an active optical gesture sensor
PublikacjaThis paper presents the methods of diversified touchless interactions between a user and a mobile platform utilizing the optical gesture sensor. The sensor uses 8 photodiodes to measure the reflected light in the active mode (using embedded LEDs) or it measures shadows caused by fingers in the passive mode. Several algorithms were implemented: automatic mode switching, adaptive illumination level compensation, resolution improvements...
-
The accuracy of pulse rate estimation from the sequence of face images
PublikacjaThe goal of this paper is to analyze the accuracy of pulse rate estimation from the sequence of face images. Simulated and real signals were used to evaluate two pulse rate estimators; one for frequency domain and the second one for time domain using the autocorrelation function. The results show that the mean difference between the reference measurements and estimated pulse rate values are about 2bpm. In the analysis of short...
-
The data exchange between smart glasses and healthcare information systems using the HL7 FHIR standard
PublikacjaIn this study we evaluated system architecture for the use of smart glasses as a viewer of information, as a source of medical data (vital sign measurements: temperature, pulse rate, and respiration rate), and as a filter of healthcare information. All activities were based on patient/device identification procedures using graphical markers or features based on visual appearance. The architecture and particular use cases were implemented...
-
The evaluation of eGlasses eye tracking module as an extension for Scratch
PublikacjaIn this paper we present the possibility of using eGlasses eye tracking module as an extension for Scratch programming tool which is a visual programming language supporting computer skills learning. The main concept behind this project is to setup the interface for rapid interaction design. Eye tracking is a powerful tool for hands free communication but for that requires a dedicated software. This software is rarely tailored...
-
The Evaluation of Use of Colors in Graphical User-Interfaces in Healthcare
PublikacjaIn this paper, color difference/contrast measures are investigated in reference to results of experiments with the participation of average, color-normal observers and with individuals with deuteranopia. Additionally, a new method for the automatic analysis of color contrast is proposed, which supports designers of graphical user- interfaces in healthcare. The method was verified using the GUI phantom of a vital signs monitor (the...
Rok 2015
-
Active and Dynamic Graphical Code for Object Identification in Healthcare
PublikacjaA new approach for item marking using two dimensional discrete graphics markers. Proposed solution allow o change the code rapidly, upon request and in the case of thermal markers make the code invisible for unauthorized observers. Connecting the proposed codes with wearable multmedial platform such as eGlasses can create new possibilities in human-environment interaction.
-
Application of smart glasses for fast and automatic color correction in health care
PublikacjaIn recent years different applications of smart glasses in health care have been proposed. In this paper we present the experiments related to automatic color correction using smart glasses platform developed within the eGlasses project. The color pattern is proposed and tested enabling the automatic detection of the pattern and automatic correction of colors. Additionally, the method for encoding and decoding of patient ID in...
-
Color Processing for Color-Blind Individuals Using Smart Glasses
PublikacjaIn this paper we investigated image processing methods for color-blind individuals. In particular we experimentally verified color naming procedure, generation of maps with color perception differences for average observers and for dichromats, and two color transformation methods. In experiments 7 mobile devices were used: 3 smart glasses and 4 smartphones. User studies were performed with 38 average observers and 9 dichromats....
-
Comparison of active proximity radars for the wearable devices
PublikacjaTwo methods of object position and movement estimation in relation to the user of smart glasses were investigated. An active infrared and ultrasonic methods of the obstacle detection were presented and compared. Application of these methods depend on active transducers type (physical medium used), geometry and surface properties of detected objects and their movement direction and speed. In the article properties of both detectors...
-
Eye tracking within near-to-eye display
PublikacjaIn this paper we investigate the effectiveness of the gaze interaction within near-to-eye display. The practical aspect of the paper is about combining an eye tracker with smart glasses. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of the implemented interaction methods is the one...
-
Interactions using passive optical proximity detector
PublikacjaIn this paper we evaluated the possible application of a passive, optical sensor as an interface for human-smart glasses interactions. The designed proximity sensor is composed of set of photodiodes and the appropriate hardware and software components. First, experiments were performed for the estimations of such parameters as distance to an object, its width and velocity. Achieved results were satisfactory. Therefore, next, a...
-
Interactions with recognized patients using smart glasses
PublikacjaRecently, different smart glasses solutions have been proposed on the market. The rapid development of this wearable technology has led to several research projects related to applications of smart glasses in healthcare. In this paper we propose a general architecture of the system enabling data integration for the recognized person. In the proposed system smart glasses integrates data obtained for the recognized patient from health...
-
Local Texture Pattern Selection for Efficient Face Recognition and Tracking
PublikacjaThis paper describes the research aimed at finding the optimal configuration of the face recognition algorithm based on local texture descriptors (binary and ternary patterns). Since the identification module was supposed to be a part of the face tracking system developed for interactive wearable computer, proper feature selection, allowing for real-time operation, became particularly important. Our experiments showed that it is...
-
Quality of graphical markers for the needs of eyewear devices
Publikacjain this paper we propose to cast the problem of identification of people, objects or places into an application for smart glasses that decodes information from graphical markers. We focus on analyzing different factors that can have influence on the processes of the automatic recognition of information from a code. The research we present aims at reviewing recognition performances in function of: size of a marker, distance from/to...
wyświetlono 9051 razy