Search
Abstract
The advent of machine learning (ML) has significantly advanced the recognition and translation of sign languages, bridging communication gaps for hearing-impaired communities. At the heart of these technologies is data labeling, crucial for training ML algorithms on a huge amount of consistently labeled data to achieve models that generalize well. The adoption of language-agnostic annotations is essential to connect different sign languages, as single-language databases often provide limited lexicon examples, insufficient for training robust ML algorithms. This study critically examines the Hamburg Sign Language Notation System (HamNoSys), which describes the signer’s initial position and body movements, in contrary to the meanings of glosses. Despite HamNoSys’s utility in standardizing transcriptions across various sign languages, our investigation uncovers inconsistencies within HamNoSys that may negatively impact the development of accurate and reliable ML models. By analyzing HamNoSys labels across five sign languages, we identified a lack of standardized annotation procedures and the complexities within HamNoSys that introduce biases and errors. Our findings underscore the urgent need for unified, standardized data annotation guidelines to enhance the accuracy and efficiency of sign language recognition technologies. This research highlights the importance of addressing annotation challenges and advocates for a comprehensive, diversified database to improve the generalization of ML models.
Citations
-
0
CrossRef
-
0
Web of Science
-
0
Scopus
Authors (7)
-
Sylwia Majchrowska mgr inż.
-
Marta A. Plantykow mgr inż
-
Alicja Kwaśniewska dr inż.
-
Agnieszka Mikołajczyk-Bareła dr inż.
-
Milena Olech mgr inż.
-
Jakub Nalepa dr inż.
Cite as
Full text
full text is not available in portal
Keywords
Details
- Category:
- Articles
- Type:
- artykuły w czasopismach
- Published in:
-
EXPERT SYSTEMS WITH APPLICATIONS
no. 256,
ISSN: 0957-4174 - Language:
- English
- Publication year:
- 2024
- Bibliographic description:
- Ferlin M., Majchrowska S., Plantykow M. A., Kwaśniewska A., Mikołajczyk-Bareła A., Olech M., Nalepa J.: Quantifying inconsistencies in the Hamburg Sign Language Notation System// EXPERT SYSTEMS WITH APPLICATIONS -,iss. 256 (2024), s.124911-
- DOI:
- Digital Object Identifier (open in new tab) 10.1016/j.eswa.2024.124911
- Sources of funding:
-
- umowa PG - Elsevier
- Verified by:
- Gdańsk University of Technology
seen 9 times
Recommended for you
A Parallel Corpus-Based Approach to the Crime Event Extraction for Low-Resource Languages
- N. Khairova,
- O. Mamyrbayev,
- N. Rizun
- + 2 authors
Cross-Lingual Knowledge Distillation via Flow-Based Voice Conversion for Robust Polyglot Text-to-Speech
- D. Piotrowski,
- R. Korzeniowski,
- A. Falai
- + 5 authors