Wyniki wyszukiwania dla: MULTIMODAL COMPUTER INTERFACES - MOST Wiedzy

Wyszukiwarka

Wyniki wyszukiwania dla: MULTIMODAL COMPUTER INTERFACES

Wyniki wyszukiwania dla: MULTIMODAL COMPUTER INTERFACES

  • New Applications of Multimodal Human-Computer Interfaces

    Publikacja

    - Rok 2012

    Multimodal computer interfaces and examples of their applications to education software and for the disabled people are presented. The proposed interfaces include the interactive electronic whiteboard based on video image analysis, application for controlling computers with gestures and the audio interface for speech stretching for hearing impaired and stuttering people. Application of the eye-gaze tracking system to awareness...

  • Cross-domain applications of multimodal human-computer interfaces

    Publikacja

    - Rok 2015

    Developed multimodal interfaces for education applications and for disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and audio interface for speech stretching for hearing impaired and stuttering people and intelligent pen allowing for diagnosing and ameliorating developmental dyslexia. The eye-gaze tracking system named...

  • Multimodal human-computer interfaces based on advanced video and audio analysis

    Multimodal interfaces development history is reviewed briefly in the introduction. Some applications of multimodal interfaces to education software for disabled people are presented. One of them, the LipMouse is a novel, vision-based human-computer interface that tracks user’s lip movements and detect lips gestures. A new approach to diagnosing Parkinson’s disease is also shown. The progression of the disease can be measured employing...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Multimodal human-computer interfaces based on advanced video and audio analysis

    Multimodal interfaces development history is reviewed briefly in the introduction. Examples of applications of multimodal interfaces to education software and for the disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and the audio interface for speech stretching for hearing impaired and stuttering people. The Smart...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Journal on Multimodal User Interfaces

    Czasopisma

    ISSN: 1783-7677 , eISSN: 1783-8738

  • Consciousness Study of Subjects with Unresponsive Wakefulness Syndrome Employing Multimodal Interfaces

    Publikacja

    - Rok 2014

    The paper presents a novel multimodal-based methodology for consciousness study of individuals with unresponsive wakefulness syndrome. Two interfaces were employed in the experiments: eye gaze tracking system – CyberEye developed at the Multimedia Systems Department, and EEG device with electrode placement in the international 10-20 standard. It was a pilot study for checking if it is possible to determine objective methods based...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Scent emitting multimodal computer interface for learning enhancement

    Komputerowy interfejs aromatyczny stanowi ważne uzupełnienie procesu stymulacji polisensorycznej. Stymulacja ta odgrywa kluczową rolę w terapii i kształceniu dzieci z zaburzeniami rozwoju (np. w przypadku autyzmu czy ADHD). Opracowany interfejs może stać się elementem wyposażenia tzw. sal doświadczania świata, ale może być także stosowany niezależnie stanowiąc znaczące wzbogacenie komputerowych programów edukacyjnych. Dzięki możliwości...

  • Lip movement and gesture recognition for a multimodal human-computer interface

    Publikacja

    - Rok 2009

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Brain-Computer Interfaces

    Czasopisma

    ISSN: 2326-263X , eISSN: 2326-2621

  • Smart Pen - new multimodal computer control tool for graphomotorical therapy

    W sytuacji, gdy około 15% populacji uczniów wykazuje cechy dyslektyczne, koniecznością staje się wyposażenie szkół w efektywne narzędzia do diagnozy i terapii tego rodzaju zaburzeń. Dzięki wykorzystaniu tabletu i specjalnie skonstruowanego długopisu wyposażonego w czujniki nacisku uzyskano możliwość monitorowania wielu parametrów, które do tej pory były dla terapeutów całkowicie niedostępne (np. pomiar nacisku na podłoże czy ścisku...

    Pełny tekst do pobrania w portalu

  • Multifactor consciousness level assessment of participants with acquired brain injuries employing human–computer interfaces

    Background A lack of communication with people suffering from acquired brain injuries may lead to drawing erroneous conclusions regarding the diagnosis or therapy of patients. Information technology and neuroscience make it possible to enhance the diagnostic and rehabilitation process of patients with traumatic brain injury or post-hypoxia. In this paper, we present a new method for evaluation possibility of communication and the...

    Pełny tekst do pobrania w portalu

  • COMPUTER STANDARDS & INTERFACES

    Czasopisma

    ISSN: 0920-5489 , eISSN: 1872-7018

  • International Conference on Multimodal Interaction (International Conference on Multimodal Interfaces)

    Konferencje

  • SCF - a Framework Supporting Achieving and Assessing Conformity with Standards

    Standards Conformity Framework (SCF) presented in this paper encompasses methods and tools whichprovide support for application of standards and other normative documents. The approach taken focuses ondevelopment, assessment and maintenance of an electronic document which demonstrates conformity. Sucha document contains an argument structure developed in accordance with the Trust-IT methodology. Thepaper discusses details of the...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Cybersecurity and Privacy in Standards for Smart Grids – a Comprehensive Survey

    Resilient information and communications technologies are a prerequisite for reliable operation of smart grid. In recent years, many standards for the new form of electricity network have been proposed, which results in operators and other smart grid stakeholders having difficulties in finding the documents which can be related to their particular problems. The purpose of this paper is to bring in all smart grid standards that...

    Pełny tekst do pobrania w portalu

  • Brain-Computer Interfaces, W, MiBM II st., sem. 03, letni 23/24 (PG_00064472)

    Kursy Online
    • A. Ianosi
    • J. Kropiwnicki

    Podstawy neurologii; Podstawowe struktury mózgu; Funkcje tkanki nerwowej; Anatomia mózgu; Umieszczenie elektrod; Kondycjonowanie sygnału; Przetwarzanie sygnałów; transformata Fouriera; transformacja falkowa; parametry Hjortha; Analiza głównych składowych; Niezależna analiza komponentów; Wspólne wzorce przestrzenne; Podstawowe techniki uczenia maszynowego; Rodzaje BCI; Inwazyjne i półinwazyjne BCI; Przywrócenie zmysłów.

  • Brain-Computer Interfaces, W, TiL II st., sem. 03, letni 23/24 (PG_00064472)

    Kursy Online
    • A. Ianosi
    • J. Kropiwnicki

    Podstawy neurologii; Podstawowe struktury mózgu; Funkcje tkanki nerwowej; Anatomia mózgu; Umieszczenie elektrod; Kondycjonowanie sygnału; Przetwarzanie sygnałów; transformata Fouriera; transformacja falkowa; parametry Hjortha; Analiza głównych składowych; Niezależna analiza komponentów; Wspólne wzorce przestrzenne; Podstawowe techniki uczenia maszynowego; Rodzaje BCI; Inwazyjne i półinwazyjne BCI; Przywrócenie zmysłów.

  • Michał Lech dr inż.

    Osoby

    Michał Lech was born in Gdynia in 1983. In 2007 he graduated from the faculty of Electronics, Telecommunications and Informatics of Gdansk University of Technology. In June 2013, he received his Ph.D. degree. The subject of the dissertation was: “A Method and Algorithms for Controlling the Sound Mixing Processes with Hand Gestures Recognized Using Computer Vision”. The main focus of the thesis was the bias of audio perception caused...

  • Virtual touchpad - video-based multimodal interface

    A new computer interface named Virtual-Touchpad (VTP) is presented. The Virtual-Touchpad provides a multimodal interface which enables controlling computer applications by hand gestures captured with a typical webcam. The video stream is processed in the software layer of the interface. Hitherto existing video-based interfaces analyzing frames of hand gestures are presented. Then, the hardware configuration and software features...

  • Intelligent multimedia solutions supporting special education needs.

    The role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality....

  • Time-domain prosodic modifications for text-to-speech synthesizer

    Publikacja

    - Rok 2010

    An application of prosodic speech processing algorithms to Text-To-Speech synthesis is presented. Prosodic modifications that improve the naturalness of the synthesized signal are discussed. The applied method is based on the TD-PSOLA algorithm. The developed Text-To-Speech Synthesizer is used in applications employing multimodal computer interfaces.

  • New methods for assessment and stimulation of non-communicative patients employing advanced multimodal HCI . Nowe metody oceny i stymulacji pacjentów niekomunikatywnych z wykorzystaniem zaawansowanych interfejsów multimodalnych człowiek-komputer

    Publikacja

    - Rok 2014

    In most cases of patients with locomotor system damage it is possible to find a solution to the medical problems originating from the injury. However, it is much more difficult to prevent cognitive and emotional impairments. Therefore, we believe that the technological support of therapists working with such patients on an everyday basis may be essential. We have acquired experience in designing and providing diagnostic and therapeutic...

  • Krzysztof Kutt dr inż.

    Osoby

    Computer scientist and psychologist trying to combine expertise from both disciplines into something cool. My research activity focuses on the development of affective HCI/BCI interfaces (based on multimodal fusion of signals and contextual data), methods for processing sensory data (including semantization of such data) and the development of knowledge-based systems (in particular knowledge graphs and semantic web systems).

  • Piotr Odya dr inż.

    Piotr Odya urodził się w Gdańsku w 1974. W 1999 roku ukończył z wyróżnieniem studia na Wydziale Elektroniki, Telekomunikacji i Informatyki Politechniki Gdańskiej zdobywając tytuł magistra inżyniera. Praca dyplomowa dotyczyła problemów poprawy jakości dźwięku w studiach emisyjnych współczesnych rozgłośni radiowych.Jego zainteresowania dotyczą montażu wideofonicznego, systemów dźwięku wielokanałowego. W ramach studiów doktoranckich...

  • Intelligent video and audio applications for learning enhancement

    The role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality....

    Pełny tekst do pobrania w portalu

  • A Special Section on Intelligent User Interfaces in Healthcare (IUIH)

    A concept of interface has evolved from the first appearance in the form of a command line interface to the established use of direct manipulation or WIMP (windows, icons, menus and pointing) interfaces in nearly all applications. Intelligent user interfaces (IUI) form a subfield of Human-Computer Interaction research. Optimal human-computer interactions are defined as ones where users are able to perform complex tasks more quickly...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Controlling computer by lip gestures employing neural network

    Publikacja

    - Rok 2010

    Results of experiments regarding lip gesture recognition with an artificial neural network are discussed. The neural network module forms the core element of a multimodal human-computer interface called LipMouse. This solution allows a user to work on a computer using lip movements and gestures. A user face is detected in a video stream from a standard web camera using a cascade of boosted classifiers working with Haar-like features....

    Pełny tekst do pobrania w serwisie zewnętrznym

  • CyberEye: New Eye-Tracking Interfaces for Assessment and Modulation of Cognitive Functions beyond the Brain

    Publikacja

    The emergence of innovative neurotechnologies in global brain projects has accelerated research and clinical applications of BCIs beyond sensory and motor functions. Both invasive and noninvasive sensors are developed to interface with cognitive functions engaged in thinking, communication, or remembering. The detection of eye movements by a camera offers a particularly attractive external sensor for computer interfaces to monitor,...

    Pełny tekst do pobrania w portalu

  • Human-Computer Interface Based on Visual Lip Movement and Gesture Recognition

    The multimodal human-computer interface (HCI) called LipMouse is presented, allowing a user to work on a computer using movements and gestures made with his/her mouth only. Algorithms for lip movement tracking and lip gesture recognition are presented in details. User face images are captured with a standard webcam. Face detection is based on a cascade of boosted classifiers using Haar-like features. A mouth region is located in...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Computer -Aided Local Energy Planning Using ALEP-PL Software

    The issue of energy system planning, including the planning of local energy systems, is critical, since it affects the security of energy supplies in communities, regions, and consequently the security of energy supply within the country. Energy planning is a complex process that requires integration of different goals i.e. improvement of energy efficiency, increase in the share of renewables in the energy balance and CO2} emission...

  • Usability Techniques Possible to Use in Diagnostic Tools Interface Improvement

    Publikacja

    - Rok 2018

    The development of diagnostic tools has caused a rapid increase in the amount of information generated and presented, necessitating the use of computer displays as an interface to data presentation and the use of modern diagnostic tools. The paper presents methods for testing usability that can be used in designing and improving the quality of interfaces of modern diagnostic tools that use communication through graphical user interfaces.

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Multimodal learning application with interactive animated character. [Multimodalna aplikacja edukacyjna wykorzystująca interaktywną animowaną postać]

    Publikacja

    - Rok 2006

    The aim of this study is to design a computer application that may assist teachers and therapists in multimodal manner in their work with impaired or disabled children. The application can be operated in many different ways, giving to a child with special educational needs a possibility to learn and train many skills or treat speech disorders. The main stress in this research is on the creation of animated character that will serve...

  • An audio-visual corpus for multimodal automatic speech recognition

    review of available audio-visual speech corpora and a description of a new multimodal corpus of English speech recordings is provided. The new corpus containing 31 hours of recordings was created specifically to assist audio-visual speech recognition systems (AVSR) development. The database related to the corpus includes high-resolution, high-framerate stereoscopic video streams from RGB cameras, depth imaging stream utilizing Time-of-Flight...

    Pełny tekst do pobrania w portalu

  • Tensor Decomposition for Imagined Speech Discrimination in EEG

    Publikacja

    - LECTURE NOTES IN COMPUTER SCIENCE - Rok 2018

    Most of the researches in Electroencephalogram(EEG)-based Brain-Computer Interfaces (BCI) are focused on the use of motor imagery. As an attempt to improve the control of these interfaces, the use of language instead of movement has been recently explored, in the form of imagined speech. This work aims for the discrimination of imagined words in electroencephalogram signals. For this purpose, the analysis of multiple variables...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Computer controlled systems - 2022/2023

    Kursy Online
    • P. Raczyński

    materiały wspierające wykład na studiach II stopnia na kierunku ACR pod tytułem komputerowe systemy automatyki 1. Computer system – controlled plant interfacing technique; simple interfacing and with both side acknowledgement; ideas, algorithms, acknowledge passing. 2. Methods of acknowledgement passing: software checking and passing, using interrupt techniques, using readiness checking (ready – wait lines). The best solution...

  • Virtual immersive environments

    Publikacja

    - Rok 2022

    Yet a higher level of active systems may be achieved when users are fully immersed in an interface which is a 3D computer generated virtual world and can interact with surrounding objects of that world as they were in a real one. This is the issue covered by Chapter 7. Interaction in such a world is both multidimensional and multimodal, with the possibility of free movement of the user in any direction and the simultaneous stimulation...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • The evaluation of eGlasses eye tracking module as an extension for Scratch

    In this paper we present the possibility of using eGlasses eye tracking module as an extension for Scratch programming tool which is a visual programming language supporting computer skills learning. The main concept behind this project is to setup the interface for rapid interaction design. Eye tracking is a powerful tool for hands free communication but for that requires a dedicated software. This software is rarely tailored...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Pursuing the Deep-Learning-Based Classification of Exposed and Imagined Colors from EEG

    Publikacja

    - LECTURE NOTES IN COMPUTER SCIENCE - Rok 2022

    EEG-based brain-computer interfaces are systems aiming to integrate disabled people into their environments. Nevertheless, their control could not be intuitive or depend on an active external stimulator to generate the responses for interacting with it. Targeting the second issue, a novel paradigm is explored in this paper, which depends on a passive stimulus by measuring the EEG responses of a subject to the primary colors (red,...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Intra-subject class-incremental deep learning approach for EEG-based imagined speech recognition

    Publikacja

    - Biomedical Signal Processing and Control - Rok 2023

    Brain–computer interfaces (BCIs) aim to decode brain signals and transform them into commands for device operation. The present study aimed to decode the brain activity during imagined speech. The BCI must identify imagined words within a given vocabulary and thus perform the requested action. A possible scenario when using this approach is the gradual addition of new words to the vocabulary using incremental learning methods....

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Muhammad Usman PhD

    Osoby

    Muhammad Usman is a researcher at the Gdansk University of Technology, currently working on the BE-Light project focused on face skin analysis using multimodal imaging and machine learning methods. He previously worked as a Hardware Test Engineer at Apple Inc., specializing in the rigorous testing and validation of electronic systems, ensuring reliability and performance. He holds a Master of Science in Automation and Control from...

  • Transfer learning in imagined speech EEG-based BCIs

    Publikacja

    - Biomedical Signal Processing and Control - Rok 2019

    The Brain–Computer Interfaces (BCI) based on electroencephalograms (EEG) are systems which aim is to provide a communication channel to any person with a computer, initially it was proposed to aid people with disabilities, but actually wider applications have been proposed. These devices allow to send messages or to control devices using the brain signals. There are different neuro-paradigms which evoke brain signals of interest...

    Pełny tekst do pobrania w portalu

  • Artificial intelligence for software development — the present and the challenges for the future

    Since the time when first CASE (Computer-Aided Software Engineering) methods and tools were developed, little has been done in the area of automated creation of code. CASE tools support a software engineer in creation the system structure, in defining interfaces and relationships between software modules and, after the code has been written, in performing testing tasks on different levels of detail. Writing code is still the task...

    Pełny tekst do pobrania w portalu

  • ACS Applied Materials & Interfaces

    Czasopisma

    ISSN: 1944-8244 , eISSN: 1944-8252

  • Multimodal Attention Stimulator

    Multimodal attention stimulator was proposed and tested for improving auditory and visual attention, including pupils with developmental dyslexia. Results of the conducted experiments shown that the designed stimulator can be used in order to improve comprehension during reading tasks. The changes in the visual attention, observed in reading test results, translate into the overall reading performance.

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Path integrals formulations leading to propagator evaluation for coupled linear physics in large geometric models

    Publikacja

    - COMPUTER PHYSICS COMMUNICATIONS - Rok 2024

    Reformulating linear physics using second kind Fredholm equations is very standard practice. One of the straightforward consequences is that the resulting integrals can be expanded (when the Neumann expansion converges) and probabilized, leading to path statistics and Monte Carlo estimations. An essential feature of these algorithms is that they also allow to estimate propagators for all types of sources, including initial conditions....

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Post-comatose patients with minimal consciousness tend to preserve reading comprehension skills but neglect syntax and spelling

    Publikacja

    - Scientific Reports - Rok 2019

    Modern eye tracking technology provides a means for communication with patients suffering from disorders of consciousness (DoC) or remaining in locked-in-state. However, being able to use an eye tracker for controlling text-based contents by such patients requires preserved reading ability in the first place. To our knowledge, this aspect, although of great social importance, so far has seemed to be neglected. In the paper, we...

    Pełny tekst do pobrania w portalu

  • Mineral and Organic Matter Constituents in Weak Interfaces in Shales

    Publikacja

    - Rok 2016

    This paper identifies formation interfaces that would appear to be "weak interfaces", in the Jurassic, Early- Cretaceous Vaca Muerta formation, in the Neuquén Basin, Argentina. Significant distribution of the weak interfaces was observed including contacts between volcanic ash layers of varying thicknesses, calcite-filled veins, and contacts between lithology changes, such as between argillaceous mudstone and mottled carbonates....

    Pełny tekst do pobrania w serwisie zewnętrznym

  • CCS-lecture-2023-2024

    Kursy Online
    • P. Raczyński

    materiały wspierające wykład na studiach II stopnia na kierunku ACR pod tytułem komputerowe systemy automatyki 1. Computer system – controlled plant interfacing technique; simple interfacing and with both side acknowledgement; ideas, algorithms, acknowledge passing. 2. Methods of acknowledgement passing: software checking and passing, using interrupt techniques, using readiness checking (ready – wait lines). The best solution optimization...

  • Multimodal English corpus for automatic speech recognition

    A multimodal corpus developed for research of speech recognition based on audio-visual data is presented. Besides usual video and sound excerpts, the prepared database contains also thermovision images and depth maps. All streams were recorded simultaneously, therefore the corpus enables to examine the importance of the information provided by different modalities. Based on the recordings, it is also possible to develop a speech...

  • Colloids and Interfaces

    Czasopisma

    ISSN: 2504-5377