Search
Abstract
The objective of this work was to provide an app that can automatically recognize hand gestures from the American Sign Language (ASL) on mobile devices. The app employs a model based on Convolutional Neural Network (CNN) for gesture classification. Various CNN architectures and optimization strategies suitable for devices with limited resources were examined. InceptionV3 and VGG-19 models exhibited negligibly higher accuracy than our own model, but they also had more complicated architectures. The best method for network optimization became Layer Decomposition which achieved the lowest inference time in classification effectiveness. Each optimization method reduced the inference time of our model at the small expense of classification accuracy. The accelerators with the shortest inference time were GPU and CPU in a configuration of 5 threads. For the purpose of loading the trained models, running and testing their effectiveness under different hardware configurations a prototype of the mobile application was developed: https://github.com/DariuszKobiela/sign-language-recognition-using-CNN
Citations
-
0
CrossRef
-
0
Web of Science
-
0
Scopus
Authors (3)
Cite as
Full text
- Publication version
- Accepted or Published Version
- DOI:
- Digital Object Identifier (open in new tab) 10.62036/ISD.2024.96
- License
-
open in new tab
Keywords
Details
- Category:
- Conference activity
- Type:
- publikacja w wydawnictwie zbiorowym recenzowanym (także w materiałach konferencyjnych)
- Language:
- English
- Publication year:
- 2024
- Bibliographic description:
- Kobiela J., Kobiela D., Artemiuk A.: Sign Language Recognition Using Convolution Neural Networks// / : , 2024,
- DOI:
- Digital Object Identifier (open in new tab) 10.62036/isd.2024.96
- Verified by:
- Gdańsk University of Technology
seen 31 times
Recommended for you
Exploring Neural Networks for Musical Instrument Identification in Polyphonic Audio
- M. Blaszke,
- G. Korvel,
- B. Kostek