Search
Abstract
In this paper the implementation of recurrent neural network models for hand gesture recognition on edge devices was performed. The models were trained with 27 hand gestures recorded with the use of a linear optical sensor consisting of 8 photodiodes and 4 LEDs. Different models, trained off-line, were tested in terms of different network topologies (different number of neurons and layers) and different effective sampling frequency of a recorded gesture on the inference time were evaluated. Inference time tests performed on the most effective of available platforms, Samsung Galaxy S8 smartphone, present that recurrent neural networks trained on unprocessed (raw) data from the gesture sensor (1-layer model) execute faster than models trained on differently processed features (2 and 3- layer models): 374ms vs 765ms and 1048ms for data recorded with 100Hz. Also, the reduction of effective sampling frequency allows to shorten the inference time, e.g., for raw data from 374ms at 100Hz to 115ms at 25Hz. Presented results confirm the usability of low complexity interfaces like linear gesture sensor in mobile devices with limited computational capabilities, which allows to consider such sensors in wearable electronic devices e.g. smart glasses.
Citations
-
3
CrossRef
-
0
Web of Science
-
3
Scopus
Authors (4)
Cite as
Full text
full text is not available in portal
Keywords
Details
- Category:
- Conference activity
- Type:
- publikacja w wydawnictwie zbiorowym recenzowanym (także w materiałach konferencyjnych)
- Title of issue:
- 2018 11th International Conference on Human System Interaction (HSI) strony 100 - 106
- Language:
- English
- Publication year:
- 2018
- Bibliographic description:
- Czuszyński K., Kwaśniewska A., SZANKIN M., Rumiński J.: Optical Sensor Based Gestures Inference Using Recurrent Neural Network in Mobile Conditions// 2018 11th International Conference on Human System Interaction (HSI)/ : , 2018, s.100-106
- DOI:
- Digital Object Identifier (open in new tab) 10.1109/hsi.2018.8430823
- Verified by:
- Gdańsk University of Technology
seen 123 times