Title :
Aligning singing voice with MIDI melody using synthesized audio signal
Author :
Dong, Minghui ; Chan, Paul ; Cen, Ling ; Li, Haizhou
Author_Institution :
Human Language Technol. Dept., A*Star, Singapore, Singapore
fDate :
Nov. 29 2010-Dec. 3 2010
Abstract :
Proper alignment of singing voice to its corresponding musical score is particularly important for singing voice analysis and processing in many applications. This paper proposes a method to align singing voice with its MIDI melody. The MIDI is first converted into a synthesized music audio file. Then spectral features are calculated for both singing voice and MIDI synthesis files. Next dynamic time warping method is used to perform forced alignment between the two feature sequences. Experiments show that the alignment result is promising.
Keywords :
audio signal processing; music; speech synthesis; time warp simulation; MIDI melody; audio signal synthesis; dynamic time warping method; feature sequence; musical score; singing voice alignment; singing voice analysis; singing voice processing; synthesized music audio file; Feature extraction; Humans; Music; Music information retrieval; Signal processing; Timing; MIDI; alignment; dynamic time warping; singing voice;
Conference_Titel :
Chinese Spoken Language Processing (ISCSLP), 2010 7th International Symposium on
Conference_Location :
Tainan
Print_ISBN :
978-1-4244-6244-5
DOI :
10.1109/ISCSLP.2010.5684843