Search
Abstract
Fighting medical disinformation in the era of the pandemic is an increasingly important problem. Today, automatic systems for assessing the credibility of medical information do not offer sufficient precision, so human supervision and the involvement of medical expert annotators are required. Our work aims to optimize the utilization of medical experts’ time. We also equip them with tools for semi-automatic initial verification of the credibility of the annotated content. We introduce a general framework for filtering medical statements that do not require manual evaluation by medical experts, thus focusing annotation efforts on non-credible medical statements. Our framework is based on the construction of filtering classifiers adapted to narrow thematic categories. This allows medical experts to fact-check and identify over two times more non-credible medical statements in a given time interval without applying any changes to the annotation flow. We verify our results across a broad spectrum of medical topic areas. We perform quantitative, as well as exploratory analysis on our output data. We also point out how those filtering classifiers can be modified to provide experts with different types of feedback without any loss of performance.
Citations
-
1
CrossRef
-
0
Web of Science
-
1
Scopus
Authors (6)
-
Bartłomiej Balcerzak dr
-
Mikołaj Morzy dr hab. inż.
-
Adam Wierzbicki prof. dr hab. inż.
-
Pavel Savov
-
Kamil Warpechowski
Cite as
Full text
- Publication version
- Accepted or Published Version
- DOI:
- Digital Object Identifier (open in new tab) 10.1007/s11280-022-01084-5
- License
-
open in new tab
Keywords
Details
- Category:
- Articles
- Type:
- artykuły w czasopismach
- Published in:
-
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS
no. 12,
ISSN: 1386-145X - Language:
- English
- Publication year:
- 2022
- Bibliographic description:
- Nabożny A., Balcerzak B., Morzy M., Wierzbicki A., Savov P., Warpechowski K.: Improving medical experts’ efficiency of misinformation detection: an exploratory study// WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS -Vol. 12,iss. 1 (2022), s.26-
- DOI:
- Digital Object Identifier (open in new tab) 10.1007/s11280-022-01084-5
- Sources of funding:
-
- COST_FREE
- Verified by:
- Gdańsk University of Technology
seen 53 times
Recommended for you
Focus on Misinformation: Improving Medical Experts’ Efficiency of Misinformation Detection
- A. Nabożny,
- B. Balcerzak,
- M. Morzy
- + 1 authors
Active Annotation in Evaluating the Credibility of Web-Based Medical Information: Guidelines for Creating Training Data Sets for Machine Learning
- A. Nabożny,
- B. Balcerzak,
- A. Wierzbicki
- + 2 authors
Enriching the Context: Methods of Improving the Non-contextual Assessment of Sentence Credibility
- A. Nabożny,
- B. Balcerzak,
- D. Korzinek
Medical Image Dataset Annotation Service (MIDAS)
- B. Klaudel,
- A. Obuchowski,
- B. Rydziński
- + 4 authors