Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders

Damian Koszewski; Thomas Görne; Grazina Korvel; Bożena Kostek

doi:10.1186/s13636-022-00266-3

Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders

Abstrakt

The purpose of this paper is to show a music mixing system that is capable of automatically mixing separate raw recordings with good quality regardless of the music genre. This work recalls selected methods for automatic audio mixing first. Then, a novel deep model based on one-dimensional Wave-U-Net autoencoders is proposed for automatic music mixing. The model is trained on a custom-prepared database. Mixes created using the proposed system are compared with amateur, state-of-the-art software, and professional mixes prepared by audio engineers. The results obtained prove that mixes created automatically by Wave-U-Net can objectively be evaluated as highly as mixes prepared professionally. This is also confirmed by the statistical analysis of the results of the conducted listening tests. Moreover, the results show a strong correlation between the experience of the listeners in mixing and the likelihood of a higher rating of the Wave-U-Net-based and professional mixes than the amateur ones or the mix prepared using state-of-the-art software. These results are also confirmed by the outcome of the similarity matrix-based analysis.

Cytowania

2

CrossRef
0

Web of Science
1

Scopus

Autorzy (4)

Damian Koszewski mgr inż.
- Wydział Elektroniki, Telekomunikacji i Informatyki
- Politechnika Gdańska
Thomas Görne prof.
Grazina Korvel
Bożena Kostek prof. dr hab. inż.

Cytuj jako

Pełna treść

pobierz publikację

pobrano 51 razy

Wersja publikacji: Accepted albo Published Version
DOI:: Cyfrowy identyfikator dokumentu elektronicznego (otwiera się w nowej karcie) 10.1186/s13636-022-00266-3
Licencja: otwiera się w nowej karcie

pełna treść artykułu zobacz w serwisie zewnętrznym otwiera się w nowej karcie

Słowa kluczowe

Informacje szczegółowe

Kategoria:

Publikacja w czasopiśmie

Typ:

artykuły w czasopismach

Opublikowano w:

EURASIP Journal on Audio Speech and Music Processing nr 2023, strony 1 - 17,
ISSN: 1687-4714

Język:

angielski

Rok wydania:

2023

Opis bibliograficzny:

Koszewski D., Görne T., Korvel G., Kostek B.: Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders// EURASIP Journal on Audio Speech and Music Processing -Vol. 2023,iss. 1 (2023), s.1-17

DOI: