Driver’s Condition Detection System Using Multimodal Imaging and Machine Learning Algorithms - Publication - Bridge of Knowledge

Search

Driver’s Condition Detection System Using Multimodal Imaging and Machine Learning Algorithms

Abstract

To this day, driver fatigue remains one of the most significant causes of road accidents. In this paper, a novel way of detecting and monitoring a driver’s physical state has been proposed. The goal of the system was to make use of multimodal imaging from RGB and thermal cameras working simultaneously to monitor the driver’s current condition. A custom dataset was created consisting of thermal and RGB video samples. Acquired data was further processed and used for the extraction of necessary metrics pertaining to the state of the eyes and mouth, such as the eye aspect ratio (EAR) and mouth aspect ratio (MAR), respectively. Breath characteristics were also measured. A customized residual neural network was chosen as the final prediction model for the entire system. The results achieved by the proposed model validate the chosen approach to fatigue detection by achieving an average accuracy of 75% on test data

Citations

  • 1

    CrossRef

  • 0

    Web of Science

  • 2

    Scopus

Cite as

Full text

full text is not available in portal

Keywords

Details

Category:
Conference activity
Type:
publikacja w wydawnictwie zbiorowym recenzowanym (także w materiałach konferencyjnych)
Language:
English
Publication year:
2023
Bibliographic description:
Leszczełowska P., Bollin M., Lempkowski K., Żak M., Rumiński J.: Driver’s Condition Detection System Using Multimodal Imaging and Machine Learning Algorithms// / : , 2023,
DOI:
Digital Object Identifier (open in new tab) 10.1007/978-3-031-43078-7_6
Sources of funding:
  • Project -
Verified by:
Gdańsk University of Technology

seen 89 times

Recommended for you

Meta Tags