Enhancing voice biometric security: Evaluating neural network and human capabilities in detecting cloned voices

Andrzej Czyżewski

doi:10.1121/2.0001978

Enhancing voice biometric security: Evaluating neural network and human capabilities in detecting cloned voices

Abstract

This study assesses speaker verification efficacy in detecting cloned voices, particularly in safety-critical applications such as healthcare documentation and banking biometrics. It compares deeply trained neural networks like the DeepSpeaker with human listeners in recognizing these cloned voices, underlining the severe implications of voice cloning in these sectors. Cloned voices in healthcare could endanger patient safety by altering medical records, causing inaccurate diagnoses and treatments. In banking, they threaten biometric security, increasing the risk of financial fraud and identity theft. We tested feature extraction strategies using up to 40 parameters, including MFCC, GFCC, LFCC, CQCC, MSRCC, and others computed with the Simplified Python Audio Features Extraction (spafe libraries) or Librosa. We verified the feature vectors using Feature Ranking (Random Forest-derived) and performed dimensionality reduction using Principal Component Analysis (PCA). Our central research question was whether using the voice cloning method to effectively attack the advanced authentication systems is possible. The research reveals the neural network's superiority over human detection in pinpointing cloned voices, underscoring the urgent need for sophisticated AI-based security.

Citations

0

CrossRef
0

Web of Science
0

Scopus

Author (1)

Andrzej Czyżewski prof. dr hab. inż.
- Faculty of Electronics, Telecommunications and Informatics
- Gdańsk University of Technology

Cite as

Full text

full text is not available in portal

full content of the article see on external site open in new tab

Keywords

Details

Category:

Articles

Type:

artykuły w czasopismach

Published in:

Journal of the Acoustical Society of America no. 155,
ISSN: 0001-4966

Language:

English

Publication year:

2024

Bibliographic description:

Czyżewski A.: Enhancing voice biometric security: Evaluating neural network and human capabilities in detecting cloned voices// Journal of the Acoustical Society of America -,iss. 155, 3 (2024), s.1-16

DOI: