Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders

Damian Koszewski; Thomas Görne; Grazina Korvel; Bożena Kostek

doi:10.1186/s13636-022-00266-3

Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders

Abstract

The purpose of this paper is to show a music mixing system that is capable of automatically mixing separate raw recordings with good quality regardless of the music genre. This work recalls selected methods for automatic audio mixing first. Then, a novel deep model based on one-dimensional Wave-U-Net autoencoders is proposed for automatic music mixing. The model is trained on a custom-prepared database. Mixes created using the proposed system are compared with amateur, state-of-the-art software, and professional mixes prepared by audio engineers. The results obtained prove that mixes created automatically by Wave-U-Net can objectively be evaluated as highly as mixes prepared professionally. This is also confirmed by the statistical analysis of the results of the conducted listening tests. Moreover, the results show a strong correlation between the experience of the listeners in mixing and the likelihood of a higher rating of the Wave-U-Net-based and professional mixes than the amateur ones or the mix prepared using state-of-the-art software. These results are also confirmed by the outcome of the similarity matrix-based analysis.

Citations

2

CrossRef
0

Web of Science
3

Scopus

Authors (4)

Damian Koszewski mgr inż.
- Faculty of Electronics, Telecommunications and Informatics
- Gdańsk University of Technology
Thomas Görne prof.
Grazina Korvel
Bożena Kostek prof. dr hab. inż.

Cite as

Full text

download paper

downloaded 107 times

Publication version: Accepted or Published Version
DOI:: Digital Object Identifier (open in new tab) 10.1186/s13636-022-00266-3
License: open in new tab

full content of the article see on external site open in new tab

Keywords

Details

Category:

Articles

Type:

artykuły w czasopismach

Published in:

EURASIP Journal on Audio Speech and Music Processing no. 2023, pages 1 - 17,
ISSN: 1687-4714

Language:

English

Publication year:

2023

Bibliographic description:

Koszewski D., Görne T., Korvel G., Kostek B.: Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders// EURASIP Journal on Audio Speech and Music Processing -Vol. 2023,iss. 1 (2023), s.1-17

DOI: