Search
displaying 1000 best results Help
Search results for: MULTI-CAMERA TRACKING
-
Hierarchical Estimation of Human Upper Body Based on 2D Observation Utilizing Evolutionary Programming and 'Genetic Memory'
PublicationNew method of the human body pose estimation based on single camera 2D observation is presented. It employs 3D model of the human body, and genetic algorithm combined with annealed particle filter for searching the global optimum of model state, best matching the object's 2D observation. Additionally, motion cost metric is employed, considering current pose and history of the body movement, favouring the estimates with the lowest...
-
Automatic sound source localization in disturbing conditions using acoustic vector sensors
PublicationA concept, practical realization and applications of a passive acoustic radar to automatic localization and tracking of sound sources in disturbing conditions were presented in the paper. The device consists of the new kind of multichannel miniature sound intensity sensors and a group of digital signal processing algorithms. The sensitivity of the realized acoustic radar was examined in free sound field. Several kinds of sound...
-
Hand gesture recognition supported by fuzzy rules and Kalman filters
PublicationThe paper presents a system based on camera and multimediaprojector enabling a user to control computer applications by dynamic hand gestures. Gesture recognition methodology based on representing hand movement trajectory by motion vectors analysed using fuzzy rule-based inference is first given. For effective hand position tracking Kalman filters are employed. The system engineered is developed using J2SE and C++/OpenCV technology....
-
Assessment of image processing methods for the determination of propagation of squat-type defects in rails
PublicationWe demonstrate the idea of squat-type defect measurement in the rail and the concept of tracking of the defect development using the techniques of image acquisition and image processing as well as the methods of metric spaces. We introduce the concepts of a set diameter δ(A) and the metric ρ1, which come from the properties of plane figures, to compare and to observe the development of the defects. We characterize the feasibility...
-
Acoustic radar employing particle velocity sensors
PublicationA concept, practical realization and applications of a passive acoustic radar to automatic localization, tracking of sound sources were presented in the paper. The device consist of the new kind of multichannel miniature sound intensity sensors and a group of digital signal processing algorithms. Contrary to active radars, it does not emit the scanning beam but after receiving surroundings sounds it provide information about the...
-
A VISION-BASED UNMANNED AERIAL VEHICLE NAVIGATION METHOD
PublicationThe satellite navigation systems are the main position sources for unmanned aerial vehicles (UAVs). This fact limits the area of UAVs operation to the places where radio signals is visible for a satellite navigation system receiver, mounted on the vehicle-outdoor navigation. Closed spaced are unavailable for vehicles which navigation is based on global satellite navigation systems (GNSS). Miniature UAV (MiniUAV) is able to operate...
-
Pose-Invariant Face Detection by Replacing Deep Neurons with Capsules for Thermal Imagery in Telemedicine
PublicationAbstract— The aim of this work was to examine the potential of thermal imaging as a cost-effective tool for convenient, non- intrusive remote monitoring of elderly people in different possible head orientations, without imposing specific behavior on users, e.g. looking toward the camera. Illumination and pose invariant head tracking is important for many medical applications as it can provide information, e.g. about vital signs, sensory...
-
Employing flowgraphs for forward route reconstruction in video surveillance system
PublicationPawlak’s flowgraphs were utilized as a base idea and knowledge container for prediction and decision making algorithms applied to experimental video surveillance system. The system is used for tracking people inside buildings in order to obtain information about their appearance and movement. The fields of view of the cameras did not overlap. Therefore, when an object was moving through unsupervised areas, prediction was needed...
-
Genetic programming extension to APF-based monocular human body pose estimation
PublicationNew method of the human body pose estimation based on a single camera 2D observation is presented, aimed at smart surveillance related video analysis and action recognition. It employs 3D model of the human body, and genetic algorithm combined with annealed particle filter for searching the global optimum of model state, best matching the object's 2D observation. Additionally, new motion cost metric is employed, considering current...
-
Stereo Camera Upgraded to Equal Baseline Multiple Camera Set (EBMCS)
PublicationThe paper presents the results of using a set of five cameras called Equal Baseline Multiple Camera Set (EBMCS) for making 3D images, disparity maps and depth maps. Cameras in the set are located in the vicinity of each other and therefore the set can be used for the purpose of stereoscopy similarly as a stereo camera.EBMCS provides disparity maps and depth maps which have a better quality than these maps obtained with the use...
-
Camera sabotage detection for surveillance systems
PublicationCamera dysfunction detection algorithms and their utilization in realtime video surveillance systems are described. The purpose of using the proposed analysis is explained. Regarding image tampering three algorithms for focus loss, scene obstruction and camera displacement detection are implemented and presented. Features of each module are described and certain scenarios for best performance are depicted. Implemented solutions...
-
Style Transfer for Detecting Vehicles with Thermal Camera
PublicationIn this work we focus on nighttime vehicle detection for intelligent traffic monitoring from the thermal camera. To train a Convolutional Neural Network (CNN) detector we create a stylized version of COCO (Common Objects in Context) dataset using Style Transfer technique that imitates images obtained from thermal cameras. This new dataset is further used for fine-tuning of the model and as a result detection accuracy on images...
-
Equal Baseline Camera Array—Calibration, Testbed and Applications
PublicationThis paper presents research on 3D scanning by taking advantage of a camera array consisting of up to five adjacent cameras. Such an array makes it possible to make a disparity map with a higher precision than a stereo camera, however it preserves the advantages of a stereo camera such as a possibility to operate in wide range of distances and in highly illuminated areas. In an outdoor environment, the array is a competitive alternative...
-
Black Camera
Journals -
The Usage of the BP-Layers Stereo Matching Algorithm with the EBCA Camera Set
PublicationThis paper is concerned with applying a stereo matching algorithm called BP-Layers to a set of many cameras. BP Layers is designed for obtaining disparity maps from stereo cameras. The algorithm takes advantage of convolutional natural networks. This paper presents using this algorithm with a set called Equal Baseline Camera Array. This set consists of up to five cameras with one central camera and other ones aground it. Such a...
-
Testing of Technical Fabrics under Fast Camera Control
PublicationThe dynamic development of measurement and recording techniques has been changing the way one conceives material strength. In this study, two different methods of evaluating the strength of fabrics are compared. The first is the typical and commonly used technique based on the use of a testing machine. The second method uses the so-called “fast camera” to monitor the entire process of the destruction of a fabric sample and analyse...
-
Non-intrusive infrared-free eye tracking method
PublicationIn the paper a technique of eye tracking based on visible light is presented. The approach described does not require an additional hardware equipment used in the infrared eye tracking system. First, examples of existing eye tracking techniques were presented. Then, the proposed algorithm of image processing and the process of determining the eye position are described. The engineered eye tracking application was tested and the...
-
Estimation of DC motor parameters using a simple CMOS camera
PublicationDifferent components of control systems for mobile robots are based on dynamic models. In low-cost solutions such a robot is wheeled and equipped with DC motors, which have to be included in the model of the robot. The model is fairly simple but determination of its parameters needs not to be easy. For instance, DC motor parameters are typically identified indirectly using suitable measurements, concerning engine voltage, current,...
-
Objects classification based on their physical sizes for detection of events in camera images
PublicationIn the paper, a method of estimation of the physical sizes of the objects tracked in the video surveillance system, and a simple module for object classification based on the estimated physical sizes, are presented. The results of object classification are then used for automatic detection of various types of events in the camera image.
-
Evaluation of respiration rate and pattern using a portable thermal camera
PublicationThe goal of this paper was to analyze the accuracy of the proposed method for the evaluation of respiration rate and respiration rhythm patterns (e.g. inspiration slope) using the portable and mobile thermal camera module that could be a part of smart glasses. Parameters were analyzed for 12 volunteers in two experiments, when subjects speak and do not speak. The pressure, chest belt was used as a reference measurement method....
-
Eye-tracking Web Usability Research
PublicationIn this paper we present the results of a study that aims to evaluate the usability of three selected web services, based on eye–tracking and thinking aloud techniques. The gathered comments and observations, recapitulated and supported by particular measures, allow us to discover and describe typical user behavior pertaining to given tasks to solve.
-
The Influence of Camera and Optical System Parameters on the Uncertainty of Object Location Measurement in Vision Systems
PublicationThe article presents the influence of the camera and its optical system on the uncertainty of object position measurement in vision systems. The aim of the article is to present the methodology for estimating the combined standard uncertainty of measuring the object position with a vision camera treated as a measuring device. The identification of factors affecting the location measurement uncertainty and the determination of their...
-
Pose-Configurable Generic Tracking of Elongated Objects
PublicationElongated objects have various shapes and can shift, rotate, change scale, and be rigid or deform by flexing, articulating, and vibrating, with examples as varied as a glass bottle, a robotic arm, a surgical suture, a finger pair, a tram, and a guitar string. This generally makes tracking of poses of elongated objects very challenging. We describe a unified, configurable framework for tracking the pose of elongated objects, which...
-
3D Vision System for a Robotic Arm Based on Equal Baseline Camera Array
PublicationThis paper presents a lightweight 3D vision system called Equal Baseline Camera Array (EBCA). EBCA can work in different light conditions and it can be applied for measuring large range of distances. The system is a useful alternative to other known distance measuring devices such as structured-light 3D scanners, time-of-flight cameras, Light Detection and Ranging (LIDAR) devices and structure from motion techniques. EBCA can be...
-
Application of gaze tracking technology to quality of experience domain
PublicationA new methodological approach to study subjective assessment results employing gaze tracking technology is shown. Notions of Human-Computer Interaction (HCI) and Quality of Experience (QoE) are shortly introduced in the context of their common application. Then, the gaze tracking system developed at the Multimedia Systems Department (MSD) of Gdansk University of Technology (GUT) is presented. A series of audio-visual subjective...
-
Camera Austria International
Journals -
Multiple Cues-Based Robust Visual Object Tracking Method
PublicationVisual object tracking is still considered a challenging task in computer vision research society. The object of interest undergoes significant appearance changes because of illumination variation, deformation, motion blur, background clutter, and occlusion. Kernelized correlation filter- (KCF) based tracking schemes have shown good performance in recent years. The accuracy and robustness of these trackers can be further enhanced...
-
Using Disparity Map for Moving Object Position Estimation in Pan Tilt Camera Images
PublicationIn this paper we present the algorithm for rapid moving object position estimation in an images acquired from pan tilt camera. Detection of a moving object in a image acquired from a moving camera might be quite challenging. Standard methods that relay on analyzing two consecutive frames are not applicable due to the changing background. To overtake this problem we decided to evaluate the possibility of calculating a disparity...
-
Multi-task Video Enhancement for Dental Interventions
PublicationA microcamera firmly attached to a dental handpiece allows dentists to continuously monitor the progress of conservative dental procedures. Video enhancement in video-assisted dental interventions alleviates low-light, noise, blur, and camera handshakes that collectively degrade visual comfort. To this end, we introduce a novel deep network for multi-task video enhancement that enables macro-visualization of dental scenes. In particular,...
-
The evaluation of eGlasses eye tracking module as an extension for Scratch
PublicationIn this paper we present the possibility of using eGlasses eye tracking module as an extension for Scratch programming tool which is a visual programming language supporting computer skills learning. The main concept behind this project is to setup the interface for rapid interaction design. Eye tracking is a powerful tool for hands free communication but for that requires a dedicated software. This software is rarely tailored...
-
Estimation of respiration rate using an accelerometer and thermal camera in eGlasses
PublicationRespiration rate is a very important vital sign. Different methods of respiration rate measurement or estimation have been developed. However, especially interesting are those that enable remote and unobtrusive monitoring. In this study, we investigated the use of smart glasses for the estimation of respiration rate especially useful for indoors applications. Two methods were analyzed. The first one is based on measurements of...
-
Estimation of object size in the calibrated camera image = Estymacja rozmiaru obiektów w obrazach ze skalibrowanej kamery
PublicationIn the paper, a method of estimation of the physical sizes of the objects tracked by the camera is presented. First, the camera is calibrated, then the proposed algorithm is used to estimate the real width and height of the tracked moving objects. The results of size estimation are then used for classification of the moving objects. Two methods of camera calibration are compared, test results are presented and discussed. The proposed...
-
Investigation of tracking systems properties in CAVE-type virtual reality systems
PublicationIn recent years, many scientific and industrial centers in the world developed a virtual reality systems or laboratories. One of the most advanced solutions are Immersive 3D Visualization Lab (I3DVL), a CAVE-type (Cave Automatic Virtual Environment) laboratory. It contains two CAVE-type installations: six-screen installation arranged in a form of a cube, and four-screen installation, a simplified version of the previous one. The...
-
Observing uncertainty in music tagging by automatic gaze tracking
PublicationIn this paper, a new approach to observe music file tagging process by employing a gaze tracking system is proposed. The study was conducted with the participation of twenty subjects having different musical experience. For the purpose of the experiments a website survey based on a musical database was prepared. It allowed to gather information about music experience of subjects along with music characteristics such as genre, tempo,...
-
On tracking properties of real-valued generalized adaptive notch filters
PublicationGeneralized adaptive notch filters (GANFs) are used for identification/tracking of quasi-periodically varying dynamic systems and can be considered an extension, to the system case, of classical adaptive notch filters. The paper presents results of local performance analysis of a real-valued GANF algorithm, i.e., algorithm designed to track parameters of a real-valued system. This is an extension of the previous work which focused...
-
Influence of Aggregating Window Size on Disparity Maps Obtained from Equal Baseline Multiple Camera Set (EBMCS)
PublicationThis paper is concerned with obtaining disparity maps on the basis of images from Equal Baseline Multiple Camera Set (EBMCS). EBMCS consists of a central camera and side cameras. Algorithms for obtaining disparity maps with the use of EBMCS take advantage of aggregating windows similarly to stereo matching algorithms for a stereo camera, a camera matrix or a camera array. The paper analyzes the influence of aggregating window size...
-
On Bayesian Tracking and Prediction of Radar Cross Section
PublicationWe consider the problem of Bayesian tracking of radar cross section. The adopted observation model employs the gamma family, which covers all Swerling cases in a unified framework. State dynamics are modeled using a nonstationary autoregressive gamma process. The principal component of the proposed solution is a nontrivial gamma approximation, applied during the time update recursion. The superior performance of the proposed approach...
-
Exploiting audio-visual correlation by means of gaze tracking
PublicationThis paper presents a novel means for increasing audio-visual correlation analysis reliability. This is done based on gaze tracking technology engineered at the Multimedia Systems Department of the Gdansk University of Technology, Poland. In the paper, the past history and current research in the area of audio-visual perception analysis are shortly reviewed. Then the methodology employing gaze tracking is presented along with the...
-
Surgical tool tracking by on-line selection of structural correlation filters
PublicationIn visual tracking of surgical instruments, correlation filtering finds the best candidate with maximal correlation peak. However, most trackers only consider capturing target appearance but not target structure. In this paper we propose surgical instrument tracking approach that integrates prior knowledge related to rotation of both shaft and tool tips. To this end, we employ rigid parts mixtures model of an instrument. The rigidly...
-
Stereo vision with Equal Baseline Multiple Camera Set (EBMCS) for obtaining depth maps of plants
PublicationThis paper presents a method of improving the estimation of distances between an autonomous harvesting robot and plants with ripe fruits by using the vision system based on five cameras. The system is called Equal Baseline Multiple Camera Set (EBMCS). EBMCS has some features of a camera matrix and a camera array. EBMCS is regarded as a set of stereo cameras for estimating distances by obtaining disparity maps and depth maps. This...
-
ATTEMPTS OF THERMAL IMAGING CAMERA USAGE IN ESTIMATIONS OF THE CONVECTIVE HEAT LOSS FROM A VERTICAL PLATE
PublicationIn this paper a new method for determining heat transfer coefficients using a gradient method has been developed. To verify accuracy of the proposed method vertical isothermal heating plate with natural convection mechanism has been examined. This configuration was deliberately chosen, because of the fact that such case is historically the earliest and most thoroughly studied and its rich scientific documentation - the most reliable....
-
Parallel frequency tracking with built-in performance evaluation
PublicationThe problem of estimation of instantaneous frequency of a nonstationary complex sinusoid (cisoid) buried in wideband noise is considered. The proposed approach employs a bank of adaptive notch filters, extended with a nontrivial performance assessment mechanism which automatically chooses the best performing filter in the bank. Additionally, a computationally attractive method of implementing the bank is proposed. The new structure...
-
Eye tracking within near-to-eye display
PublicationIn this paper we investigate the effectiveness of the gaze interaction within near-to-eye display. The practical aspect of the paper is about combining an eye tracker with smart glasses. Presented research is related with the eGlasses project, which is focused on the development of an open platform in the form of multisensory electronic glasses and related interaction methods. One of the implemented interaction methods is the one...
-
Resolving Conflicts in Object Tracking in Video Stream Employing Key Point Matching
PublicationA novel approach to resolving ambiguous situations in object tracking in video streams is presented. The proposed method combines standard tracking technique employing Kalman filters with global feature matching method. Object detection is performed using a background subtraction algorithm, then Kalman filters are used for object tracking. At the same time, SURF key points are detected only in image sections identified as moving...
-
Comparison of Tracking Methods in Respect of Automation of Animal Behavioral Test
PublicationAutomation in experiments carried out on animals is getting more and more important in research. Computers take over laborious and time-consuming activities like recording and analysing images of experiment scene. The first step in an image analysis is finding and distinguishing between the observed animals, and then tracking all objects during the experiment. In this paper four tracking methods are presented. Quantitative and...
-
Multimedia interface using head movements tracking
PublicationThe presented solution supports innovative ways of manipulating computer multimedia content, such as: static images, videos and music clips and others that can be browsed subsequently. The system requires a standard web camera that captures images of the user face. The core of the system is formed by a head movement analyzing algorithm that finds a user face and tracks head movements in real time. Head movements are tracked with...
-
Eye-tracking everywhere - software supporting disabled people in interaction with computers
PublicationIn this paper we present comprehensive system for communication with computer by gaze. One of the main assumptions behind this work was to provide solution that can be used with standard RGB webcam. The proposed comprehensive system included the eye tracking module and user interface for convenient gaze interaction with computer. As a result a fully functional application was developed. The average accuracy of the eye tracking...
-
Fuzzy rule-based dynamic gesture recognition employing camera & multimedia projector
PublicationIn the paper the system based on camera and multimedia projector enabling a user to control computer applications by dynamic hand gestures is presented. The main objective is to present the gesture recognition methodology which bases on representing hand movement trajectory by motion vectors analyzed using fuzzy rule-based inference. The approach was engineered in the system developed with J2SE and C++ / OpenCV technology. OpenCV...
-
Hybrid System for a Person Tracking in Harsh Indoor Environments
PublicationIn the article, the prototype of a system for a person tracking in a harsh indoor environment, especially when no other commercially available radiolocalization system can be used, was briefly described. The prototype realizes the data fusion, i.e. combines data from inertial and environmental sensors and radio distance measurements to estimate the position of a moving person. It is worth noting that the concept and practical realization...
-
Performance evaulation of video object tracking algorithm in autonomous surveillance system
PublicationResults of performance evaluation of a video object tracking algorithm are presented. The method of moving objects detection and tracking is based on background modelling with mixtures of Gaussians and Kalman filters. An emphasis is put on algorithm's efficiency with regards to its settings. Utilized methods of performance evaluation based on comparison of algorithm output to manually prepared reference data are introduced. The...