Wyszukiwarka
prof. dr hab. inż. Jacek Rumiński
Zatrudnienie
- Profesor w Katedra Inżynierii Biomedycznej
- Kierownik katedry w Katedra Inżynierii Biomedycznej
- Prezes klubu Zatoka Sztucznej Inteligencji AI Bay w Politechnika Gdańska
Publikacje
Filtry
wszystkich: 183
Katalog Publikacji
Rok 2018
-
Optical Sensor Based Gestures Inference Using Recurrent Neural Network in Mobile Conditions
PublikacjaIn this paper the implementation of recurrent neural network models for hand gesture recognition on edge devices was performed. The models were trained with 27 hand gestures recorded with the use of a linear optical sensor consisting of 8 photodiodes and 4 LEDs. Different models, trained off-line, were tested in terms of different network topologies (different number of neurons and layers) and different effective sampling frequency...
-
Long Distance Vital Signs Monitoring with Person Identification for Smart Home Solutions
PublikacjaAbstract— Imaging photoplethysmography has already been proved to be successful in short distance (below 1m). However, most of the real-life use cases of measuring vital signs require the system to work at longer distances, to be both more reliable and convenient for the user. The possible scenarios that system designers must have in mind include monitoring of the vital signs of residents in nursing homes, disabled people, who...
-
Gesture Recognition With the Linear Optical Sensor and Recurrent Neural Networks
PublikacjaIn this paper, the optical linear sensor, a representative of low-resolution sensors, was investigated in the multiclass recognition of near-field hand gestures. The recurrent neural network (RNN) with a gated recurrent unit (GRU) memory cell was utilized as a gestures classifier. A set of 27 gestures was collected from a group of volunteers. The 27 000 sequences obtained were divided into training, validation, and test subsets....
-
Digits Recognition with Quadrant Photodiode and Convolutional Neural Network
PublikacjaIn this paper we have investigated the capabilities of a quadrant photodiode based gesture sensor in the recognition of digits drawn in the air. The sensor consisting of 4 active elements, 4 LEDs and a pinhole was considered as input interface for both discrete and continuous gestures. Index finger and a round pointer were used as navigating mediums for the sensor. Experiments performed with 5 volunteers...
-
Analysis of the Accuracy of Pulse Estimation Using Smart Watches
PublikacjaThe purpose of this paper is to perform an analysis of the accuracy of the pulse estimation by comparing readings from a smartwatch with readings from medical devices. The study required writing applications that allow continuous pulse measurement. As a result, two applications were created for the smartwatch. The first one is dedicated to Android Wear devices, while the other one is compatible with Tizen watches. The next step...
-
A Meta-Analysis of Pulse Arrival Time Based Blood Pressure Estimation
PublikacjaThe paper presents a preliminary meta-analysis of the sample correlation between pulse arrival time (PAT) and blood pressure (BP). The aim of the study was to verify sample correlation coefficient between PAT and BP using an affine model BP = a · P AT + b for systolic and diastolic blood pressure. The databases included in the search were the IEEE Xplore Digital Library, Springer Link and Google Scholar. Only papers from 2005 to...
Rok 2017
-
Virtual designs and reconstructions of amber works: Amber craftsman simulator
PublikacjaThis paper presents the concept of visualization of amber works in a virtual reality cave. It describes problems encountered during the acquisition, modeling and rendering of geometrical objects distinguished by heterogeneous transparency.
-
The role of EMG module in hybrid interface of prosthetic arm
PublikacjaNearly 10% of all upper limb amputations concern the whole arm. It affects the mobility and reduces the productivity of such a person. These two factors can be restored by using prosthetics. However, the complexity of human arm makes restoring its basic functions quite difficult. When the osseointegration and/or targeted muscle reinnervation (TMR) are not possible, different modalities can be used to control the prosthesis. In...
-
The motion influence on respiration rate estimation from low-resolution thermal sequences during attention focusing tasks
PublikacjaGlobal aging has led to a growing expectancy for creating home-based platforms for indoor monitoring of elderly people. A motivation is to provide a non-intrusive technique, which does not require special activities of a patient but allows for remote monitoring of elderly people while assisting them with their daily activities. The goal of our study was to evaluate motion performed by a person focused on a specific task and check...
-
Pose classification in the gesture recognition using the linear optical sensor
PublikacjaGesture sensors for mobile devices, which have a capability of distinguishing hand poses, require efficient and accurate classifiers in order to recognize gestures based on the sequences of primitives. Two methods of poses recognition for the optical linear sensor were proposed and validated. The Gaussian distribution fitting and Artificial Neural Network based methods represent two kinds of classification approaches. Three types...
-
Playback detection using machine learning with spectrogram features approach
PublikacjaThis paper presents 2D image processing approach to playback detection in automatic speaker verification (ASV) systems using spectrograms as speech signal representation. Three feature extraction and classification methods: histograms of oriented gradients (HOG) with support vector machines (SVM), HAAR wavelets with AdaBoost classifier and deep convolutional neural networks (CNN) were compared on different data partitions in respect...
-
Open smart glasses development platform for AAL applications
PublikacjaThis paper describes an open platform for multi sensory electronic glasses that supports new and enhanced methods for intelligent interaction with patients, with smart objects, or to be used as new data input modalities like proximity sensor or smart textile interfaces. All the activities have been developed, investigated and evaluated within EU CHIST-ERA eGlasses project...
-
Extending touch-less interaction with smart glasses by implementing EMG module
PublikacjaIn this paper we propose to use temporal muscle contraction to perform certain actions. Method: The set of muscle contractions corresponding to one of three actions including “single-click”, “double-click” “click-n-hold” and “non-action” were recorded. After recording certain amount of signals, the set of five parameters was calculated. These parameters served as an input matrix for the neural network. Two-layer feedforward neural...
-
Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions
PublikacjaRespiratory rate is very important vital sign that should be measured and documented in many medical situations. The remote measurement of respiration rate can be especially valuable for medical screening purposes (e.g. severe acute respiratory syndrome (SARS), pandemic influenza, etc.). In this chapter we present a review of many different studies focused on the measurements and estimation of respiration rate using thermal imaging...
-
Duże zbiory danych w zdalnej diagnostyce medycznej z wykorzystaniem technik głębokiego uczenia,
PublikacjaW ostatnim czasie obserwujemy tendencję globalnego starzenia się i znaczących zmian struktur demograficznych na całym świecie. Zgodnie z raportem przedstawionym przez Moody Investors Service, przewiduje się, iż do 2030 roku liczba znacząco-starzejących się krajów wzrośnie z 3 do 34. Światowy proces starzenia się społeczeństw doprowadził do wzrastających oczekiwań wobec starszych osób do pozostania niezależnymi. W związku z tym...
-
Deep Features Class Activation Map for Thermal Face Detection and Tracking
PublikacjaRecently, capabilities of many computer vision tasks have significantly improved due to advances in Convolutional Neural Networks. In our research, we demonstrate that it can be also used for face detection from low resolution thermal images, acquired with a portable camera. The physical size of the camera used in our research allows for embedding it in a wearable device or indoor remote monitoring solution for elderly and disabled...
-
BIG DATA SIGNIFICANCE IN REMOTE MEDICAL DIAGNOSTICS BASED ON DEEP LEARNING TECHNIQUES
PublikacjaIn this paper we discuss the evaluation of neural networks in accordance with medical image classification and analysis. We also summarize the existing databases with images which could be used for training deep models that can be later utilized in remote home-based health care systems. In particular, we propose methods for remote video-based estimation of patient vital signs and other health-related parameters. Additionally, potential...
-
Automatic analysis of the aggressive behavior of laboratory animals using thermal video processing
PublikacjaThe bite detection is very important but difficult element of the social interaction analysis. Standard observation methods like human observer or a camcorder of visible light frequencies fail in this case. However, it is possible to discern cooler spots on the rodent's body that appear after body contact with another individual, and vanish after short time. These spots are assumed to be a saliva trace left on fur after bite. In...
-
Analysis of Properties of an Active Linear Gesture Sensor
PublikacjaBasic gesture sensors can play a significant role as input units in mobile smart devices. However, they have to handle a wide variety of gestures while preserving the advantages of basic sensors. In this paper a user-determined approach to the design of a sparse optical gesture sensor is proposed. The statistical research on a study group of individuals includes the measurement of user-related parameters like the speed of a performed...
Rok 2016
-
The Evaluation of Use of Colors in Graphical User-Interfaces in Healthcare
PublikacjaIn this paper, color difference/contrast measures are investigated in reference to results of experiments with the participation of average, color-normal observers and with individuals with deuteranopia. Additionally, a new method for the automatic analysis of color contrast is proposed, which supports designers of graphical user- interfaces in healthcare. The method was verified using the GUI phantom of a vital signs monitor (the...
-
The evaluation of eGlasses eye tracking module as an extension for Scratch
PublikacjaIn this paper we present the possibility of using eGlasses eye tracking module as an extension for Scratch programming tool which is a visual programming language supporting computer skills learning. The main concept behind this project is to setup the interface for rapid interaction design. Eye tracking is a powerful tool for hands free communication but for that requires a dedicated software. This software is rarely tailored...
-
The data exchange between smart glasses and healthcare information systems using the HL7 FHIR standard
PublikacjaIn this study we evaluated system architecture for the use of smart glasses as a viewer of information, as a source of medical data (vital sign measurements: temperature, pulse rate, and respiration rate), and as a filter of healthcare information. All activities were based on patient/device identification procedures using graphical markers or features based on visual appearance. The architecture and particular use cases were implemented...
-
The accuracy of pulse rate estimation from the sequence of face images
PublikacjaThe goal of this paper is to analyze the accuracy of pulse rate estimation from the sequence of face images. Simulated and real signals were used to evaluate two pulse rate estimators; one for frequency domain and the second one for time domain using the autocorrelation function. The results show that the mean difference between the reference measurements and estimated pulse rate values are about 2bpm. In the analysis of short...
-
Semi complex navigation with an active optical gesture sensor
PublikacjaThis paper presents the methods of diversified touchless interactions between a user and a mobile platform utilizing the optical gesture sensor. The sensor uses 8 photodiodes to measure the reflected light in the active mode (using embedded LEDs) or it measures shadows caused by fingers in the passive mode. Several algorithms were implemented: automatic mode switching, adaptive illumination level compensation, resolution improvements...
-
Self diagnostics using smart glasses - preliminary study
Publikacjan this preliminary study we analyzed the possibility of the reliable measurement of biomedical signals with some potential hardware extensions of smart glasses. Using specially designed experimental prototypes four category of biomedical signals were measured: electrocardiograms, electromyograms, electroencephalograms and respiration waveforms. Experi- ments with volunteers proved that using even simple construc- tion of sensors...
-
Reliability of Pulse Measurements in Videoplethysmography
PublikacjaReliable, remote pulse rate measurement is potentially very important for medical diagnostics and screening. In this paper the Videoplethysmography was analyzed especially to verify the possible use of signals obtained for the YUV color model in order to estimate the pulse rate, to examine what is the best pulse estimation method for short video sequences and finally, to analyze how potential PPG-signals can be distinguished from...
-
Real-time facial feature tracking in poor quality thermal imagery
PublikacjaRecently, facial feature tracking systems have become more and more popular because of many possible use cases. Especially in medical applications location of the face and facial features are very useful. Many researches have presented methods to detect and track facial features in visible light. However, facial feature analysis in thermography may also be very advantageous. Some examples of using infrared imagery in medicine include...
-
Performance Analysis of Interaction between Smart Glasses and Smart Objects Using Image-Based Object Identification
PublikacjaWe propose the use of smart glasses to collaborate with smart objects in the Internet of Things environment. Particularly we are focusing on new interaction methods and the analysis of acceptable reaction times in the process of object recognition using smart glasses. We evaluated the proposed method using user studies and experiments with three different smart glasses: Google Glass, Epson Moverio, and the developed eGlasses platform....
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublikacjaW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Inteligentne otoczenie w aplikacjach prozdrowotnych - przykłady rozwiązań
PublikacjaW artykule przedstawiono koncepcję inteligentnego otoczenia jako wyposażenia tzw inteligentnego budynku ukieunkowanego na wspomaganie diagnostyki medycznej osób zagrożonych określonymi chorobami. Przedstawiono bliżej dwa rozwiązania – układ inteligentnej wagi i krzesła kardiologicznego.
-
Face detection in image sequences using a portable thermal camera
PublikacjaFace detection is often a first step in quantitative analysis of face images. It is an important research area for visible images and recently also for thermography. Due to technological developments thermal cameras may be embedded into wearable devices to provide remote healthcare. In this paper, we compared three algorithms for face detection in thermal images by testing execution time, accuracy, symmetry ratio and false-positives....
-
Evaluation of respiration rate and pattern using a portable thermal camera
PublikacjaThe goal of this paper was to analyze the accuracy of the proposed method for the evaluation of respiration rate and respiration rhythm patterns (e.g. inspiration slope) using the portable and mobile thermal camera module that could be a part of smart glasses. Parameters were analyzed for 12 volunteers in two experiments, when subjects speak and do not speak. The pressure, chest belt was used as a reference measurement method....
-
Estimation of the amplitude of the signal for the active optical gesture sensor with sparse detectors
PublikacjaIn this paper we deal with the problem of precise gesture recognition for the active optical proximity sensor with sparse 8 photodiodes. We particularly focus on developing the method of estimating the real, usually not observable, maximum signal value representing maximum intensity of light reflected from an obstacle present in the front of the sensor. Different configurations of the fingers were used as an obstacle. The Monte Carlo...
-
Estimation of respiration rate using an accelerometer and thermal camera in eGlasses
PublikacjaRespiration rate is a very important vital sign. Different methods of respiration rate measurement or estimation have been developed. However, especially interesting are those that enable remote and unobtrusive monitoring. In this study, we investigated the use of smart glasses for the estimation of respiration rate especially useful for indoors applications. Two methods were analyzed. The first one is based on measurements of...
-
Enhanced Eye-Tracking Data: a Dual Sensor System for Smart Glasses Applications
PublikacjaA technique for the acquisition of an increased number of pupil positions, using a combined sensor consisting of a low-rate camera and a high-rate optical sensor, is presented in this paper. The additional data are provided by the optical movement-detection sensor mounted in close proximity to the eyeball. This proposed solution enables a significant increase in the number of registered fixation points and saccades and can be used...
-
EMG and gaze based interaction with graphic interface of smart glasses application
PublikacjaIn this paper we investigate the effectiveness of the interaction using eye tracking and electromyography. Smart glasses requires reliable interfaces for controlling the graphic content displayed directly in front of the user's eye. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of...
-
Cardiovascular data analysis using electronic wearable eyeglasses-preliminary study
Publikacjahe paper presents an alternative approach to the monitoring of the cardiovascular system. The study depicts configurations of the utilized system and preliminary results of electrical and mechanical parameters of the cardiac system which can be measured using a head-worn device.
-
Analysis of the parameters of respiration patterns extracted from thermal image sequences
PublikacjaRemote estimation of vital signs is an important and active area of research. The goal of this work was to analyze the feasibility of estimating respiration parameters from video sequences of faces recorded using a mobile thermal camera. Different estimators were analyzed and experimentally verified. It was demonstrated that the respiration rate, periodicity of respiration, and presence and length of apnea periods could be reliably...
-
Accuracy analysis of the RSSI BLE SensorTag signal for indoor localization purposes
PublikacjaIn this paper we describe possibility of use the RSSI signal (Radio Signal Strength Indication) from Texas Instruments SensorTag CC2650 for indoor positioning purposes. This idea is not a new but in our opinion it is possible to use SensorTags with Bluetooth LE wireless interface for positioning inside buildings in such applications as people findings in hospitals, senior come care, etc. RSSI is mostly selected as the sensor localization...
Rok 2015
-
Septic safe interactions with smart glasses in health care
PublikacjaIn this paper, septic safe methods of interaction with smart glasses, due to the health care environment applications consideration, are presented. The main focus is on capabilities of an optical, proximity-based gesture sensor and eye-tracker input systems. The design of both interfaces is being adapted to the open smart glasses platform that is being developed under the eGlasses project. Preliminary results obtained from the...
-
Quality of graphical markers for the needs of eyewear devices
Publikacjain this paper we propose to cast the problem of identification of people, objects or places into an application for smart glasses that decodes information from graphical markers. We focus on analyzing different factors that can have influence on the processes of the automatic recognition of information from a code. The research we present aims at reviewing recognition performances in function of: size of a marker, distance from/to...
-
Local Texture Pattern Selection for Efficient Face Recognition and Tracking
PublikacjaThis paper describes the research aimed at finding the optimal configuration of the face recognition algorithm based on local texture descriptors (binary and ternary patterns). Since the identification module was supposed to be a part of the face tracking system developed for interactive wearable computer, proper feature selection, allowing for real-time operation, became particularly important. Our experiments showed that it is...
-
Interactions with recognized patients using smart glasses
PublikacjaRecently, different smart glasses solutions have been proposed on the market. The rapid development of this wearable technology has led to several research projects related to applications of smart glasses in healthcare. In this paper we propose a general architecture of the system enabling data integration for the recognized person. In the proposed system smart glasses integrates data obtained for the recognized patient from health...
-
Interactions using passive optical proximity detector
PublikacjaIn this paper we evaluated the possible application of a passive, optical sensor as an interface for human-smart glasses interactions. The designed proximity sensor is composed of set of photodiodes and the appropriate hardware and software components. First, experiments were performed for the estimations of such parameters as distance to an object, its width and velocity. Achieved results were satisfactory. Therefore, next, a...
-
Eye tracking within near-to-eye display
PublikacjaIn this paper we investigate the effectiveness of the gaze interaction within near-to-eye display. The practical aspect of the paper is about combining an eye tracker with smart glasses. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of the implemented interaction methods is the one...
-
Comparison of active proximity radars for the wearable devices
PublikacjaTwo methods of object position and movement estimation in relation to the user of smart glasses were investigated. An active infrared and ultrasonic methods of the obstacle detection were presented and compared. Application of these methods depend on active transducers type (physical medium used), geometry and surface properties of detected objects and their movement direction and speed. In the article properties of both detectors...
-
Color Processing for Color-Blind Individuals Using Smart Glasses
PublikacjaIn this paper we investigated image processing methods for color-blind individuals. In particular we experimentally verified color naming procedure, generation of maps with color perception differences for average observers and for dichromats, and two color transformation methods. In experiments 7 mobile devices were used: 3 smart glasses and 4 smartphones. User studies were performed with 38 average observers and 9 dichromats....
-
Application of smart glasses for fast and automatic color correction in health care
PublikacjaIn recent years different applications of smart glasses in health care have been proposed. In this paper we present the experiments related to automatic color correction using smart glasses platform developed within the eGlasses project. The color pattern is proposed and tested enabling the automatic detection of the pattern and automatic correction of colors. Additionally, the method for encoding and decoding of patient ID in...
-
Active and Dynamic Graphical Code for Object Identification in Healthcare
PublikacjaA new approach for item marking using two dimensional discrete graphics markers. Proposed solution allow o change the code rapidly, upon request and in the case of thermal markers make the code invisible for unauthorized observers. Connecting the proposed codes with wearable multmedial platform such as eGlasses can create new possibilities in human-environment interaction.
Rok 2014
-
Sleep Apnea Detection by Means of Analyzing Electrocardiographic Signal
PublikacjaObstructive sleep apnea (OSA) is a condition of cyclic, periodic ob-struction (stenosis) of the upper respiratory tract. OSA could be associated with serious cardiovascular problems, such as hypertension, arrhythmias, hearth failure or peripheral vascular disease. Understanding the way of connection between OSA and cardiovascular diseases is important to choose proper treatment strategy. In this paper, we present a method for integrated...
wyświetlono 7611 razy