Abstrakt
Robust Lombard speech-in-noise detecting is challenging. This study proposes a strategy to detect Lombard speech using a machine learning approach for applications such as public address systems that work in near real time. The paper starts with the background concerning the Lombard effect. Then, assumptions of the work performed for Lombard speech detection are outlined. The framework proposed combines convolutional neural networks (CNNs) and various two-dimensional (2D) speech signal representations. To reduce the computational cost and not resign from the 2D representation-based approach, a strategy for threshold-based averaging of the Lombard effect detection results is introduced. The pseudocode of the averaging process is also included. A series of experiments are performed to determine the most effective network structure and the 2D speech signal representation. Investigations are carried out on German and Polish recordings containing Lombard speech. All 2D signal speech representations are tested with and without augmentation. Augmentation means using the alpha channel to store additional data: gender of the speaker, F0 frequency, and first two MFCCs. The experimental results show that Lombard and neutral speech recordings can clearly be discerned, which is done with high detection accuracy. It is also demonstrated that the proposed speech detection process is capable of working in near real-time. These are the key contributions of this work.
Cytowania
-
1
CrossRef
-
0
Web of Science
-
2
Scopus
Autorzy (4)
Cytuj jako
Pełna treść
- Wersja publikacji
- Accepted albo Published Version
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.3390/s23010315
- Licencja
- otwiera się w nowej karcie
Słowa kluczowe
Informacje szczegółowe
- Kategoria:
- Publikacja w czasopiśmie
- Typ:
- artykuły w czasopismach
- Opublikowano w:
-
SENSORS
nr 23,
ISSN: 1424-8220 - Język:
- angielski
- Rok wydania:
- 2023
- Opis bibliograficzny:
- Kąkol K., Korvel G., Tamulevicius G., Kostek B.: Detecting Lombard Speech Using Deep Learning Approach// SENSORS -,iss. 23, 315 (2022), s.1-20
- DOI:
- Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.3390/s23010315
- Źródła finansowania:
-
- COST_FREE
- Weryfikacja:
- Politechnika Gdańska
wyświetlono 150 razy
Publikacje, które mogą cię zainteresować
A Study of Cross-Linguistic Speech Emotion Recognition Based on 2D Feature Spaces
- G. Tamulevicius,
- G. Korvel,
- A. B. Yayak
- + 3 autorów
Investigating Feature Spaces for Isolated Word Recognition
- G. Korvel,
- G. Tamulevicus,
- P. Treigys
- + 2 autorów
An Attempt to Create Speech Synthesis Model That Retains Lombard Effect Characteristics
- G. Korvel,
- O. Kurasova,
- B. Kostek