Search
dr hab. inż. Agnieszka Landowska
Employment
- Head of Department at Department of Software Engineering
- Associate professor at Department of Software Engineering
Publications
Filters
total: 74
Catalog Publications
-
Emotion Recognition and Its Applications
PublicationThe paper proposes a set of research scenarios to be applied in four domains: software engineering, website customization, education and gaming. The goal of applying the scenarios is to assess the possibility of using emotion recognition methods in these areas. It also points out the problems of defining sets of emotions to be recognized in different applications, representing the defined emotional states, gathering the data and...
-
Emotion recognition and its application in software engineering
PublicationIn this paper a novel application of multimodal emotion recognition algorithms in software engineering is described. Several application scenarios are proposed concerning program usability testing and software process improvement. Also a set of emotional states relevant in that application area is identified. The multimodal emotion recognition method that integrates video and depth channels, physiological signals and input devices...
-
Emotion Monitoring – Verification of Physiological Characteristics Measurement Procedures
PublicationThis paper concerns measurement procedures on an emotion monitoring stand designed for tracking human emotions in the Human-Computer Interaction with physiological characteristics. The paper addresses the key problem of physiological measurements being disturbed by a motion typical for human-computer interaction such as keyboard typing or mouse movements. An original experiment...
-
Robot-Based Intervention for Children With Autism Spectrum Disorder: A Systematic Literature Review
PublicationChildren with autism spectrum disorder (ASD) have deficits in the socio-communicative domain and frequently face severe difficulties in the recognition and expression of emotions. Existing literature suggested that children with ASD benefit from robot-based interventions. However, studies varied considerably in participant characteristics, applied robots, and trained skills. Here, we reviewed robot-based interventions targeting...
-
Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions
PublicationThe paper concerns accuracy of emotion recognition from facial expressions. As there are a couple of ready off-the-shelf solutions available in the market today, this study aims at practical evaluation of selected solutions in order to provide some insight into what potential buyers might expect. Two solutions were compared: FaceReader by Noldus and Xpress Engine by QuantumLab. The performed evaluation revealed that the recognition...
-
Automatic recognition of therapy progress among children with autism
PublicationThe article presents a research study on recognizing therapy progress among children with autism spectrum disorder. The progress is recognized on the basis of behavioural data gathered via five specially designed tablet games. Over 180 distinct parameters are calculated on the basis of raw data delivered via the game flow and tablet sensors - i.e. touch screen, accelerometer and gyroscope. The results obtained confirm the possibility...
-
Towards New Mappings between Emotion Representation Models
PublicationThere are several models for representing emotions in affect-aware applications, and available emotion recognition solutions provide results using diverse emotion models. As multimodal fusion is beneficial in terms of both accuracy and reliability of emotion recognition, one of the challenges is mapping between the models of affect representation. This paper addresses this issue by: proposing a procedure to elaborate new mappings,...
-
Limitations of Emotion Recognition in Software User Experience Evaluation Context
PublicationThis paper concerns how an affective-behavioural- cognitive approach applies to the evaluation of the software user experience. Although it may seem that affect recognition solutions are accurate in determining the user experience, there are several challenges in practice. This paper aims to explore the limitations of the automatic affect recognition applied in the usability context as well as...
-
Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review
PublicationThe automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities...
-
Limitations of Emotion Recognition from Facial Expressions in e-Learning Context
PublicationThe paper concerns technology of automatic emotion recognition applied in e-learning environment. During a study of e-learning process the authors applied facial expressions observation via multiple video cameras. Preliminary analysis of the facial expressions using automatic emotion recognition tools revealed several unexpected results, including unavailability of recognition due to face coverage and significant inconsistency...
-
Uncertainty in emotion recognition
PublicationPurpose–The purpose of this paper is to explore uncertainty inherent in emotion recognition technologiesand the consequences resulting from that phenomenon.Design/methodology/approach–The paper is a general overview of the concept; however, it is basedon a meta-analysis of multiple experimental and observational studies performed over the past couple of years.Findings–The mainfinding of the paper might be summarized as follows:...
-
Methodology of Affective Intervention Design for Intelligent Systems
PublicationThis paper concerns how intelligent systems should be designed to make adequate, valuable and natural affective interventions. The article proposes a process for choosing an affective intervention model for an intelligent system. The process consists of 10 activities that allow for step-by-step design of an affective feedback loop and takes into account the following factors: expected and desired emotional states, characteristics...
-
Affective reactions to playing digital games
PublicationThe paper presents a study of emotional states during a gameplay. An experiment of two-player Tetris game is reported, followed by the analysis of the results - self-reported emotional states as well as physiological signals measurements interpretation. The study reveals the diversity of emotional reactions and concludes, that a representative player's emotional model is hard to define. Instead, an adaptive approach to emotion...
-
System supporting behavioral therapy for children with autism
PublicationIn this paper, a system supporting behavioral therapy for autistic children is presented. The system consists of sensors network, base station and a brooch indicating person's emotional states. The system can be used to measure values of physiological parameters that are associated with changes in the emotional state. In the future, it can be useful to inform the autistic child and the therapist about the emotional state of the...
-
Automatic recognition of males and females among web browser users based on behavioural patterns of peripherals usage
PublicationPurpose The purpose of this paper is to answer the question whether it is possible to recognise the gender of a web browser user on the basis of keystroke dynamics and mouse movements. Design/methodology/approach An experiment was organised in order to track mouse and keyboard usage using a special web browser plug-in. After collecting the data, a number of parameters describing the users’ keystrokes, mouse movements and clicks...
-
Emotion Monitor - Concept, Construction and Lessons Learned
PublicationThis paper concerns the design and physical construction of an emotion monitor stand for tracking human emotions in Human-Computer Interaction using multi-modal approach. The concept of the stand using cameras, behavioral analysis tools and a set of physiological sensors such as galvanic skin response, blood-volume pulse, temperature, breath and electromyography is presented and followed...
-
Stress Detection of Children with Autism using Physiological Signals in Kaspar Robot-Based Intervention Studies
PublicationThis study aims to develop a stress detection system using the blood volume pulse (BVP) signals of children with Autism Spectrum Disorder (ASD) during robot-based interven- tion. This study presents the heart rate variability (HRV) analysis method to detect the stress, where HRV features are extracted from raw BVP signals recorded from an E4 wristband during interaction studies with the social robot Kaspar. Low frequency power...
-
Towards Emotion Acquisition in IT Usability Evaluation Context
PublicationThe paper concerns extension of IT usability studies with automatic analysis of the emotional state of a user. Affect recognition methods and emotion representation models are reviewed and evaluated for applicability in usability testing procedures. Accuracy of emotion recognition, susceptibility to disturbances, independence on human will and interference with usability testing procedures are...
-
Applications for investigating therapy progress of autistic children
PublicationThe paper regards supporting behavioral therapy of autistic children with mobile applications, specifically applied for measuring the child’s progress. A family of five applications is presented, that was developed as an investigation tool within the project aimed at automation of therapy progress monitoring. The applications were already tested with children with autism spectrum disorder. Hereby we analyse children’ experience...
-
Model of distributed learning objects repository for a heterogenic internet environment
PublicationW artykule wprowadzono pojęcie komponentu edukacyjnego jako rozszerzenie obiektu edukacyjnego o elementy zachowania (metody). Zaproponowane podejście jest zgodne z paradygmatem obiektowym. W oparciu o komponent edukacyjny zaprojektowano model budowy repozytorium materiałów edukacyjnych. Model ten jest oparty o usługi sieciowe i rejestry UDDI. Komponent edukacyjny oraz model repozytorium mogą znaleźć zastosowanie w konstrukcji zbiorów...
-
Evaluation Criteria for Affect-Annotated Databases
PublicationIn this paper a set of comprehensive evaluation criteria for affect-annotated databases is proposed. These criteria can be used for evaluation of the quality of a database on the stage of its creation as well as for evaluation and comparison of existing databases. The usefulness of these criteria is demonstrated on several databases selected from affect computing domain. The databases contain different kind of data: video or still...
-
Designing effective educational games - a case study of a project management game
PublicationThis paper addresses the issues of designing effective educational games. We aim at investigating how the cognitive, behavioral and emotional aspects of the games influence their educational effectiveness. The results were obtained with an observational user experience study extended with affect analysis carried out for a project management game GraPM. We analyzed the...
-
Mobile Activity Plan Applications for Behavioral Therapy of Autistic Children
PublicationThis paper concerns technological support for behavioral therapy of autistic children. A family of tools dedicated for mobile devices is presented, that allows to design and perform an activity schedule in behavioral therapy. The paper describes the main challenges, that were encountered, especially in meeting the non-functional requirements of the application: simplicity, repeatability, robustness, personalization, re-usability...
-
Keystroke Dynamics Patterns While Writing Positive and Negative Opinions
PublicationThis paper deals with analysis of behavioural patterns in human–computer interaction. In the study, keystroke dynamics were analysed while participants were writing positive and negative opinions. A semi-experiment with 50 participants was performed. The participants were asked to recall the most negative and positive learning experiences (subject and teacher) and write an opinion about it. Keystroke dynamics were captured and...
-
Mining inconsistent emotion recognition results with the multidimensional model
PublicationThe paper deals with the challenge of inconsistency in multichannel emotion recognition. The focus of the paper is to explore factors that might influence the inconsistency. The paper reports an experiment that used multi-camera facial expression analysis with multiple recognition systems. The data were analyzed using a multidimensional approach and data mining techniques. The study allowed us to explore camera location, occlusions...
-
Selection of physiological parameters for optoelectronic system supporting behavioral therapy of autistic children
PublicationIn this article the procedure of selection of physiological parameters for optoelectronic system supporting behavioral therapy of autistic children is proposed. Authors designed and conducted an experiment in which a group of 30 health volunteers (16 females and 14 males) were examined. Under controlled conditions people were exposed to a stressful situation caused by the picture or sound (1kHz constant sound, which was gradually...
-
Stress Detection of Children With ASD Using Physiological Signals
PublicationThis paper proposes a physiological signal-based stress detection approach for children with autism spectrum disorder (ASD) to be used in social and assistive robot inter- vention. Electrodermal activity (EDA) and blood volume pulse (BVP) signals are collected with an E4 smart wristband from children with ASD in different countries. The peak count and signal amplitude features are derived from EDA signal and used in order to detect...
-
Integration in Multichannel Emotion Recognition
PublicationThe paper concerns integration of results provided by automatic emotion recognition algorithms. It presents both the challenges and the approaches to solve them. Paper shows experimental results of integration. The paper might be of interest to researchers and practitioners who deal with automatic emotion recognition and use more than one solution or multichannel observation.
-
E-technologie w diagnozie i pomiarach postępów terapii dzieci z autyzmem w Polsce
PublicationCelem artykułu jest przeanalizowanie możliwości wsparcia technologicznego - w szczególności z wykorzystaniem urządzeń mobilnych - diagnozy i oceny postępów terapii dzieci z autyzmem. W ramach badań dokonano przeglądu istniejących rozwiązań wspierających diagnozę i pomiar postępów terapii oraz przeprowadzono ankietę w polskich ośrodkach zajmujących się pracą z osobami dotkniętymi autyzmem. Wyniki badania wskazują na zainteresowanie...
-
Web Questionnaire as Construction Method of Affect-annotated Lexicon - Risks Reduction Strategy
PublicationThe paper concerns credibility of construction methods for affect-annotated lexicons, specifically a web questionnaire is explored and evaluated. Web-based surveys are susceptible to some risks, which might influence credibility of the results, as some participants might perform random clicks or intentionally falsify the responses. The paper explores the risks and proposes some strategies to reduce them. The strategies are supported...
-
Robot Eye Perspective in Perceiving Facial Expressions in Interaction with Children with Autism
PublicationThe paper concerns automatic facial expression analysis applied in a study of natural “in the wild” interaction between children with autism and a social robot. The paper reports a study that analyzed the recordings captured via a camera located in the eye of a robot. Children with autism exhibit a diverse level of deficits, including ones in social interaction and emotional expression. The aim of the study was to explore the possibility...
-
Scoreboard Architectural Pattern and Integration of Emotion Recognition Results
PublicationThis paper proposes a new design pattern, named Scoreboard , dedicated for applications solving complex, multi-stage, non-deterministic problems. The pattern provides a computational framework for the design and implementation of systems that integrate a large number of diverse specialized modules that may vary in accuracy, solution level, and modality. The Scoreboard is an extension of Blackboard design pattern and comes under...
-
Investigation of educational processes with affective computing methods
PublicationThis paper concerns the monitoring of educational processes with the use of new technologies for the recognition of human emotions. This paper summarizes results from three experiments, aimed at the validation of applying emotion recognition to e-learning. An analysis of the experiments’ executions provides an evaluation of the emotion elicitation methods used to monitor learners. The comparison of affect recognition algorithms...
-
Educational resources as digital products
PublicationW artykule zaproponowano podejście do tworzenia i dystrybucji materiałów edukacyjnych oparte na znanych rozwiązaniach dotyczących produktów cyfrowych. Szczególnie skoncentrowano się na pracochłonności wykonania materiałów oraz wynikającego z niej kosztu zakupu i ceny materiałów. Zaproponowano miarę rozmiaru obiektów edukacyjnych, która wykazuje korelację z pracochłonnością wykonania obiektów. Zaproponowano także metody dotyczące...
-
Which digital games are appropriate for our children?
PublicationChapter contains advice on which digital games are accessible for children with diverse impairments. It providess a process for choosing the device, the game and adjusting it. It might be of use for therapists, techers and caregivers.
-
Badania nad e-technologiami wspierającymi terapię autyzmu
PublicationArtykuł opisuje badania i osiągnięcia we wspomaganiu automatycznego pomiaru postępów dzieci z autyzmem. Badania te zostały zrealizowane w ramach projektu AUTMON realizowanego na Politechnice Gdańskiej, WETI w latach 2015-2017
-
Przyjazne aplikacje dla dzieci z autyzmem – e-edukacja na poziomie przedszkolnym
PublicationArtykuł dotyczy możliwości wykorzystania aplikacji na tablety do wspomagania terapii dzieci z zaburzeniami rozwojowymi ze spektrum autyzmu. Przedstawia studium przypadku skutecznego zastosowania e-technologii w kształceniu specjalnym na poziomie przedszkolnym. Artykuł opisuje zestaw aplikacji edukacyjnych o nazwie Przyjazne Aplikacje, których celem jest wspieranie terapii dzieci z autyzmem opartej o stosowaną...
-
Postrzeganie inwazyjności automatycznego rozpoznawania emocji w kontekście edukacyjnym
PublicationArtykuł dotyczy aktualnych trendów w konstrukcji inteligentnych systemów edukacyjnych, uwzględniających stan emocjonalny ucznia w doborze ścieżki nauczania. Artykuł przedstawia założenia i rezultaty badania ankietowego, którego celem było określenie, jak zastosowanie automatycznego rozpoznawania emocji jest postrzegane w kontekście edukacyjnym. Badanie przeprowadzono wśród studentów oraz pracowników uczelni wyższych w Polsce. Rezultaty...
-
Behaviometrics of Digital Games for Children with Autism Spectrum Disorder
PublicationTe paper reports current stage of the project Automated Terapy Monitoring for Children with Developmental Disorders of Autism Spectrum (AUTMON), that aims at development of methods and tools to allow for the automatic evaluation of the therapy progress among children with autism. Finding objective measures suitable for evaluating therapy progress would let create a system supporting those who diagnose autism and the therapists...
-
Friendly Applications: supporting education of children with autism
PublicationFriendly Applications is a project introducing a family of applications supporting education of children with autism at kindergarten level. The applications were developed as a joint initiative of Gdansk University of Technology and Institute for Child Development, which uses the applications in daily educational activities.
-
Model inteligentnego systemu edukacyjnego rozpoznającego emocje ucznia
PublicationW niniejszym raporcie omówiono model afektywnego systemu edukacyjnego i jego składowe oraz wyzwania, jakie stoją przed konstruktorami tego rodzaju rozwiązań.
-
How to Design Affect-aware Educational Systems – the AFFINT Process Approach
PublicationComputer systems, that support learning processes, can adapt to the needs and states of a learner. The adaptation might directly address the knowledge deficits and most tutoring systems apply an adaptable learning path of that kind. Apart from a preliminary knowledge state, there are more factors, that influence education effectiveness and among those there are fluctuating emotional states. The tutoring systems may recognize or...
-
A Prototype of Educational Agent in Distance Learning Environment - Virtual Student Assistant
PublicationW zdalnym nauczaniu pojawia się wiele systemów wspierających, z których niezwykle ciekawym przykładem są agenty edukacyjne. Wśród wielu rodzajów agentów edukacyjnych wyróżnia się osobistych asystentów, których rolą jest organizacyjna pomoc osobie zdobywającej wiedzę. Artykuł jest poświęcony zaimplementowanemu na Wydziale ETI Politechniki Gdańskiej prototypowi agenta edukacyjnego o nazwie WAS (Wirtualny Asystent Studenta). Pokazana...
-
współczesne trendy w dziedzinie zdalnego nauczania
PublicationZdalne nauczanie jest dziedziną starszą niż Internet i komputery. Pojęcie zdalnej edukacji oznacza nauczanie prowadzone w warunkach, gdy nauczyciel i uczeń są od siebie oddaleni w przestrzeni. W czasach, gdy podróżowanie było bardzo kosztowne, posługiwano się kursami korespondencyjnymi, które można uznać za pierwszą formę zdalnego nauczania. W miarę spadku kosztów podróży coraz częstsze stawały się wyjazdy do szkół, jednak nauczanie...
-
Kierunki standaryzacji w zdalnym nauczaniu
PublicationDziedzina zdalnego nauczania rozwija się dzięki wielu współpracującym organizacjom i konsorcjom. Opracowały one kilkadziesiąt specyfikacji i modeli referencyjnych, z których część została zaakceptowana jako standardy takich organizacji jak ISO czy IEEE. Artykuł zawiera przegląd najważniejszych instytucji zajmujących się dziedziną zdalnego nauczania oraz wskazuje ich wkład w dotychczasowe dokonania dziedziny. Wskazano także obszary,...
-
Szkoła systemu Linux
PublicationKsiążka ''Szkoła systemu Linux'' wprowadza czytelnika w świat oprogramowania typu open source. Przedstawione zostały liczne programy, które umożliwiają między innymi zarządzanie danymi, pisanie i drukowanie dokumentów czy korzystanie z sieci. Za pomocą ksiązki można się nauczyć używania środowiska graficznego oraz wiersza poleceń. Opisano również działanie systemów operacyjnych, w tym Linux. Na płycie dołączonej do książki znajduje...
-
The role and construction of educational agents in distance learning environments
PublicationArtykuł przedstawia definicję oraz klasyfikację agentów edukacyjnych. Wskazuje typowe cele i zadania agentów, a także omawia schemat ich budowy i funkcjonowania. Wskazano także różnorodność możliwości, jakie stwarzają różne rodzaje agentów w procesie nauczania. W artykule opisano także wytworzony w ramach badań prototyp agenta WAS, którego zadaniem jest wspomaganie uczniów w zakresie pracy z materiałami edukacyjnymi.
-
Wykorzystanie serwerów UDDI dla systemów zdalnej edukacji.
PublicationW artykule przedstawiono możliwości wykorzystania usług sieciowych opartych na serwerach UDDI (Universal Description, Discovery and Integration) do przechowywania obiektów edukacyjnych. Opisane rozwiązanie wykorzystujące język XML, protokół SOAP (Simple Object Access Protocol) i standard WSDL (Web Services Description Language) pozwala na tworzenie baz wiedzy przeznaczonych zarówno dla uczniów jak również dla nauczycieli....
-
Możliwości komputerowego wspomagania interaktywnych ćwiczeń i testów.
PublicationArtykuł dotyczy tworzenia interaktywnych obiektów uczących w środowiskach zdalnego nauczania. Opisano zalecenia standardu SCORM dotyczące sposobu tworzenia obiektów z wykorzystaniem języka XML. Omówiono problemy z implementacją pytań i testów w interaktywnych materiałach dydaktycznych. Wyróżniono typy pytań i testów możliwe do realizacji w technologiach internetowych. Wskazano na konieczność budowy narzędzi, które umożliwią nauczycielom...
-
Technology adoption review for ageing well: analysis of technical solutions
PublicationWhile several technological solutions are available for older adults to improve their wellbeing and quality of life, little is known about the gaps between the needs, provided solutions, and their adoption from a more pragmatic perspective. This paper reports on reviewing existing technological solutions for older adults, which span the work life, life in the community, and wellbeing at home. We analyzed 50 different solutions...
seen 3735 times