Wyszukiwarka
Abstrakt
In the medical field, text annotation involves categorizing clinical and biomedical texts with specific medical categories, enhancing the organization and interpretation of large volumes of unstructured data. This process is crucial for developing tools such as speech recognition systems, which help medical professionals reduce their paperwork. It addresses a significant cause of burnout reported by up to 60% of medical staff. However, annotating medical texts in languages other than English poses unique challenges and necessitates using advanced models. In our research, conducted in collaboration with Gdańsk University of Technology and the Medical University of Gdańsk, we explore strategies to tackle these challenges. We evaluated the performance of various tools and models in recognizing medical terms within a comprehensive vocabulary, comparing these tools’ outcomes with annotations made by medical experts. Our study specifically examined categories such as ‘Drugs’, ‘Diseases and Symptoms’, ‘Procedures’, and ‘Other Medical Terms’, contrasting human expert annotations with the performance of popular multilingual chatbots and natural language processing (NLP) tools on translated texts. The conclusion drawn from our statistical analysis reveals that no significant differences were detected between the groups we examined. This suggests that the tools and models we tested are, on average, similarly effective—or ineffective—at recognizing medical terms as categorized by our specific criteria. Our findings highlight the challenges in bridging the gap between human and machine accuracy in medical text annotation, especially in non-English contexts, and emphasize the need for further refinement of these technologies.
Cytowania
-
0
CrossRef
-
0
Web of Science
-
0
Scopus
Autorzy (7)
-
Dariusz Szplit mgr inż.
-
Beata Graff dr n. med.
-
Anna Szyndler dr n. med.
-
Mariusz Budzisz mgr inż.
-
Krzysztof Narkiewicz Prof. dr hab. n. med.
Cytuj jako
Pełna treść
pełna treść publikacji nie jest dostępna w portalu
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Publikacja w czasopiśmie
- Typ:
- artykuły w czasopismach
- Opublikowano w:
-
Scientific Reports
nr 15,
ISSN: 2045-2322 - Język:
- angielski
- Rok wydania:
- 2025
- Opis bibliograficzny:
- Zielonka M., Czyżewski A., Szplit D., Graff B., Szyndler A., Budzisz M., Narkiewicz K.: Machine learning tools match physician accuracy in multilingual text annotation// Scientific Reports -,iss. 15 (2025), s.1-15
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1038/s41598-025-89754-y
- Źródła finansowania:
- Weryfikacja:
- Politechnika Gdańska
wyświetlono 7 razy
Publikacje, które mogą cię zainteresować
Quantifying inconsistencies in the Hamburg Sign Language Notation System
- M. Ferlin,
- S. Majchrowska,
- M. A. Plantykow
- + 4 autorów
Semantic OLAP with FluentEditor and Ontorion Semantic Excel Toolchain
- D. Dobrowolski,
- P. Kapłański,
- A. Marciniak
- + 1 autorów