Search
Search results for: auditory-visual stimulation
-
An audio-visual corpus for multimodal automatic speech recognition
Publicationreview of available audio-visual speech corpora and a description of a new multimodal corpus of English speech recordings is provided. The new corpus containing 31 hours of recordings was created specifically to assist audio-visual speech recognition systems (AVSR) development. The database related to the corpus includes high-resolution, high-framerate stereoscopic video streams from RGB cameras, depth imaging stream utilizing Time-of-Flight...
-
Visual content representation and retrieval for Cognitive Cyber Physical Systems
PublicationCognitive Cyber Physical Systems have gained significant attention from academia and industry during the past few decade. One of the main reasons behind this interest is the potential of such technologies to revolutionize human life since they intend to work robustly under complex visual scenes, which environmental conditions may vary, adapting to a comprehensive range of unforeseen changes, and exhibiting prospective behavior...
-
Visual perception of vowels from static and dynamic cues
PublicationThe purpose of the study was to analyse human identification of Polish vowels from static and dynamic durationally slowed visual cues. A total of 152 participants identified 6 Polish vowels produced by 4 speakers from static (still images) and dynamic (videos) cues. The results show that 59% of static vowels and 63% of dynamic vowels were successfully identified. There was a strong confusion between vowels within front, central,...
-
Visual Content Representation for Cognitive Systems: Towards Augmented Intelligence
PublicationCognitive Vision Systems have gained significant attention from academia and industry during the past few decades. One of the main reasons behind this interest is the potential of such technologies to revolutionize human life since they intend to work robustly under complex visual scenes (which environmental conditions may vary), adapting to a comprehensive range of unforeseen changes, and exhibiting prospective behavior. The combination...
-
Auditory-model based robust feature selection for speech recognition
Publication -
Hypertension is associated with dysfunction of both peripheral and central auditory system
Publication -
Comparison of Acoustic and Visual Voice Activity Detection for Noisy Speech Recognition
PublicationThe problem of accurate differentiating between the speaker utterance and the noise parts in a speech signal is considered. The influence of utilizing a voice activity detection in speech signals on the accuracy of the automatic speech recognition (ASR) system is presented. The examined methods of voice activity detection are based on acoustic and visual modalities. The problem of detecting the voice activity in clean and noisy...
-
Personalized prediction of the secondary oocytes number after ovarian stimulation: A machine learning model based on clinical and genetic data
PublicationControlled ovarian stimulation is tailored to the patient based on clinical parameters but estimating the number of retrieved metaphase II (MII) oocytes is a challenge. Here, we have developed a model that takes advantage of the patient’s genetic and clinical characteristics simultaneously for predicting the stimulation outcome. Sequence variants in reproduction-related genes identified by next-generation sequencing were matched...
-
Pursuing Listeners’ Perceptual Response in Audio-Visual Interactions - Headphones vs Loudspeakers: A Case Study
PublicationThis study investigates listeners’ perceptual responses in audio-visual interactions concerning binaural spatial audio. Audio stimuli are coupled with or without visual cues to the listeners. The subjective test participants are tasked to indicate the direction of the incoming sound while listening to the audio stimulus via loudspeakers or headphones with the head-related transfer function (HRTF) plugin. First, the methodology...
-
Selected aspects of customization of cognitive dimensions for evaluation of visual modeling languages.
PublicationFor the successful application of diagrams in software engineering, high quality visual modelling languages (VML) are required. There is a need for new effective methodologies of VML evaluation. This paper discusses selected aspects of applying cognitive dimensions as a basis of the evaluation. Then, it briefly presents CD-VML methodology which integrates the cognitive dimensions with a theory of visual modelling languages. Finally,...
-
Audio-visual aspect of the Lombard effect and comparison with recordings depicting emotional states.
PublicationIn this paper an analysis of audio-visual recordings of the Lombard effect is shown. First, audio signal is analyzed indicating the presence of this phenomenon in the recorded sessions. The principal aim, however, was to discuss problems related to extracting differences caused by the Lombard effect, present in the video , i.e. visible as tension and work of facial muscles aligned to an increase in the intensity of the articulated...
-
A Visual Method of Measuring Railway-Track Weed Infestation Level
PublicationThis paper concerns the assessment of railway track surface conditions in relation to the degree of weed infestation. The paper conceptually describes the proposed method using a visual system to analyse weed infestation level. The use of image analysis software for weed detection is also proposed. This new measurement method allows for a mobile assessment of the track’s weed infestation status. Validation of the assessment method...
-
Audio-visual surveillance system for application in bank operating room
PublicationAn audio-visual surveillance system able to detect, classify and to localize acoustic events in a bank operating room is presented. Algorithms for detection and classification of abnormal acoustic events, such as screams or gunshots are introduced. Two types of detectors are employed to detect impulsive sounds and vocal activity. A Support Vector Machine (SVM) classifier is used to discern between the different classes of acoustic...
-
Impact of Visual Image Quality on Lymphocyte Detection Using YOLOv5 and RetinaNet Algorithms
PublicationLymphocytes, a type of leukocytes, play a vital role in the immune system. The precise quantification, spatial arrangement and phenotypic characterization of lymphocytes within haematological or histopathological images can serve as a diagnostic indicator of a particular lesion. Artificial neural networks, employed for the detection of lymphocytes, not only can provide support to the work of histopathologists but also enable better...
-
Visual Capacity Assessment of the Open Landscape in Terms of Protection and Shaping: Case Study of a Village in Poland
PublicationThis article describes the methodology and results of research on landscape visual capacity. The aim of the project was to develop a tool that would support planning and design decisions at the level of communal management in rural areas in Poland through systematic application of visual criteria. Their importance in the protection, management and shaping of space is underlined by the document produced at the European Landscape...
-
Simple gait parameterization and 3D animation for anonymous visual monitoring based on augmented reality
PublicationThe article presents a method for video anonymization and replacing real human silhouettes with virtual 3D figures rendered on a screen. Video stream is processed to detect and to track objects, whereas anonymization stage employs animating avatars accordingly to behavior of detected persons. Location, movement speed, direction, and person height are taken into account during animation and rendering phases. This approach requires...
-
Towards Precise Visual Navigation and Direct Georeferencing for MAV Using ORB-SLAM2
PublicationA low accuracy of positioning using Global Navigation Satellite System (GNSS) are not meet geodetic requirements for direct images georeferencing for Unmanned Aerial Vehicle (UAV) photogrammetry. A majority of UAVs are equipped with a monocular or stereo non-metric cameras for either visual data gathering or live video feed for operator. A cheap positioning techniques used on board commercial UAVs are not that precise as geodetic...
-
UAV Design and Construction for Real Time Photogrammetry and Visual Navigation
PublicationA unmanned aerial vehicles applications in photogrammetry have increased rapidly last years. A fast data gathering and processing in real time in some cases become crucial and desired in some application. In the paper, a real time solution is proposed. A real time photogrammetry from UAV is proposed, where image data are gathered and processed on board UAV and finally reconstructed 3D model and measurements are delivered. The paper...
-
Gaze-tracking based audio-visual correlation analysis employing quality of experience methodology
PublicationThis paper investigates a new approach to audio-visual correlation assessment based on the gaze-tracking system developed at the Multimedia Systems Department (MSD) of Gdansk University of Technology (GUT). The gaze-tracking methodology, having roots in Human-Computer Interaction borrows the relevance feedback through gaze-tracking and applies it to the new area of interests, which is Quality of Experience. Results of subjective...
-
Visual method for detecting critical damage in railway contact strips
PublicationEnsuring an uninterrupted supply of power in the electric traction is vital for the safety of this important transport system. For this purpose, monitoring and diagnostics of the technical condition of the vehicle's power supply elements are becoming increasingly common. This paper presents a new visual method for detecting contact strip damage, based on measurement and analysis of the movement of the overhead contact line (OCL)...
-
EXAMINING INFLUENCE OF VIDEO FRAMERATE AND AUDIO/VIDEO SYNCHRONIZATION ON AUDIO-VISUAL SPEECH RECOGNITION ACCURACY
PublicationThe problem of video framerate and audio/video synchronization in audio-visual speech recogni-tion is considered. The visual features are added to the acoustic parameters in order to improve the accuracy of speech recognition in noisy conditions. The Mel-Frequency Cepstral Coefficients are used on the acoustic side whereas Active Appearance Model features are extracted from the image. The feature fusion approach is employed. The...
-
EXAMINING INFLUENCE OF VIDEO FRAMERATE AND AUDIO/VIDEO SYNCHRONIZATION ON AUDIO-VISUAL SPEECH RECOGNITION ACCURACY
PublicationThe problem of video framerate and audio/video synchronization in audio-visual speech recognition is considered. The visual features are added to the acoustic parameters in order to improve the accuracy of speech recognition in noisy conditions. The Mel-Frequency Cepstral Coefficients are used on the acoustic side whereas Active Appearance Model features are extracted from the image. The feature fusion approach is employed. The...
-
Experimental verification of visual method for measuring displacements of contact line elements
PublicationThe increase of rail vehicles speed, as well as the increase of their power, puts high demands on the power delivery system for traction vehicles The most critical point in the vehicle's power supply circuit is the contact between the current collector and contact wires. Ensuring a reliable co-operation of the current collector and contact line, requires technical development...
-
Economic and clinical evaluation of vagus nerve stimulation therapy
Publication -
Visual Cognition
Journals -
VISUAL NEUROSCIENCE
Journals -
Visual Anthropology
Journals -
Visual communication
Journals -
VISUAL COMPUTER
Journals -
Imaginario Visual
Journals -
Visual Ethnography
Journals -
Visual Studies
Journals -
Visual History
Journals -
Visual Informatics
Journals -
Multiple Cues-Based Robust Visual Object Tracking Method
PublicationVisual object tracking is still considered a challenging task in computer vision research society. The object of interest undergoes significant appearance changes because of illumination variation, deformation, motion blur, background clutter, and occlusion. Kernelized correlation filter- (KCF) based tracking schemes have shown good performance in recent years. The accuracy and robustness of these trackers can be further enhanced...
-
Selection of Visual Descriptors for the Purpose of Multi-camera Object Re-identification
PublicationA comparative analysis of various visual descriptors is presented in this chapter. The descriptors utilize many aspects of image data: colour, texture, gradient, and statistical moments. The descriptor list is supplemented with local features calculated in close vicinity of key points found automatically in the image. The goal of the analysis is to find descriptors that are best suited for particular task, i.e. re-identification...
-
Hostility bias or sadness bias in excluded individuals: Does anodal transcranial direct current stimulation of right VLPFC vs. left DLPFC have a mitigating effect?
PublicationExclusion has multiple adverse effects on individual’s well-being. It induces anger and hostile cognitions leading to aggressive behavior. The purpose of this study was to test whether exclusion would affect recognition of anger on ambivalent faces of the excluders. We hypothesized that exclusion would elicit more anger encoding (hostility bias) than inclusion, but this effect would be mitigated by anodal tDCS of right VLPFC...
-
SZTUKA WIZUALNA W OBIEKTACH MEDYCZNYCH = VISUAL ARTS IN MEDICAL FACILITIES
PublicationWspółczesna architektura obiektów służby zdrowia podlega dynamicznym przeobrażeniom formalnym wynikającym zarówno z rozwoju technologii medycznych, zmian zachodzących w podejściu wobec pacjenta. Narastający w naukach medycznych kierunek holistyczny ustawia pacjenta jako użytkownika w trzech wymiarach: biologicznym, społecznym i psychologicznym. Stąd pojawiające się w procesie projektowym dotyczącym szpitali czy przychodni nowe...
-
Visual impairment and traits of autism in children
Publication -
A methodology of visual modeling language evaluation
PublicationMetody oceny jakości metod modelowania są istotnym elementem inżynierii języków modelowania wizualnego. W referacie zaproponowano metodę oceny języków modelowania wizualnego na podstawie wymiarów poznawczych. Zaprezentowano metodologiczną dyskusję zastosowania nauk psychologicznych do oceny metod modelowania, metodologię CD-VML, powiązaną z nią metodę CD-VML-UC do oceny przypadków użycia oraz weryfikację metodologii.
-
A new approach to visual system testing
PublicationOpisano budowę laboratoryjnego stanowiska prac bawczych nad perymetrią obiektywną. Przedstawiono zasadę działania algorytmu VEPDA oraz wyniki działania VEPDA na danych eksperymentalnych.
-
Dynamic Semantic Visual Information Management
PublicationDominant Internet search engines use keywords and therefore are not suited for exploration of new domains of knowledge, when the user does not know specific vocabulary. Browsing through articles in a large encyclopedia, each presenting a small fragment of knowledge, it is hard to map the whole domain, see relevant concepts and their relations. In Wikipedia for example some highly relevant articles are not linked with each other....
-
Automatic audio-visual threat detection
PublicationThe concept, practical realization and application of a system for detection and classification of hazardous situations based on multimodal sound and vision analysis are presented. The device consists of new kind multichannel miniature sound intensity sensors, digital Pan Tilt Zoom and fixed cameras and a bundle of signal processing algorithms. The simultaneous analysis of multimodal signals can significantly improve the accuracy...
-
Examining Government-Citizen Interactions on Twitter using Visual and Sentiment Analysis
PublicationThe goal of this paper is to propose a methodology comprising a range of visualization techniques to analyze the interactions between government and citizens on the issues of public concern taking place on Twitter, mainly through the official government or ministry accounts. The methodology addresses: 1) the level of government activity in different countries and sectors; 2) the topics that are addressed through such activities;...
-
Visual Features for Improving Endoscopic Bleeding Detection Using Convolutional Neural Networks
PublicationThe presented paper investigates the problem of endoscopic bleeding detection in endoscopic videos in the form of a binary image classification task. A set of definitions of high-level visual features of endoscopic bleeding is introduced, which incorporates domain knowledge from the field. The high-level features are coupled with respective feature descriptors, enabling automatic capture of the features using image processing methods....
-
New technology for hearing stimulation employing the SPS-S method
PublicationIstotnym założeniem metody SPS-S jest możliwość stosowania treningu słuchowego w warunkach życia codziennego, a więc także poza gabinetami placówek terapeutycznych. Mobilne urządzenie - stymulator słuchu jest oparte na najnowszej technologii mikroelektronicznej, Oferuje on możliwość wykorzystywania wielu programów terapii, które przebiegają z zastosowaniem algorytmów cyfrowego przetwarzania dźwięku. Algorytmy te można podzielić...
-
Deep brain stimulation: new possibilities for the treatment of mental disorders
Publication -
Excitonic stimulation of current flowing along thin tetracene layer
PublicationW pracy badane były prądy będące wynikiem oddziaływania ekscytonów tripletowych ze spułapkowanymi nośnikami ładunku w warstwach tetracenu. Badane próbki oświetlane były od strony podłoża oraz od strony przeciwległej podłożu.
-
Visual Attention Distribution Based Assessment of User's Skill in Electronic Medical Record Navigation
PublicationCurrently, the most precise way of reflecting the skills level is an expert’s subjective assessment. In this paper we investigate the possibility of the use of eye tracking data for scalar quantitative and objective assessment of medical staff competency in EMR system navigation. According to the experiment conducted by Yarbus the observation process of particular features is associated with thinking. Moreover, eye tracking is...
-
Place attachment, place identity, and visual pollution sensitivity.
Open Research DataThe data include individual responses on the following scales (1) place attachment, (2) place identity, and (3) visual pollution sensitivity. Each line represents responses obtained from one participant and his or her demographic characteristics. like gender, age, and education level.