Title :
Progressive sound rendering in multimedia applications
Author :
Zhang, Qiong ; Shi, Jiaoying
Author_Institution :
State Key Lab. of CAD & CG, Zhejiang Univ.
Abstract :
Realistic audio rendering is an integral part of any immersive multimedia applications. A progressive sound-rendering scheme, which integrates sound source modeling with sound transmission simulation, is proposed to generate D sound effects for multimedia applications. At first, sound source modeling is performed through either sinusoidal analysis of prerecorded sound or modal analysis of virtual object based on its geometry and material properties. Then, all the sub components derived are sorted according to perceptual criteria. Dependent on resource availability, the afterwards real time synthesis can be done in a progressive way and binaural filtering is integrated into this process directly
Keywords :
audio acoustics; audio signal processing; hearing; modal analysis; multimedia communication; real-time systems; D sound effects; audio rendering; immersive multimedia applications; integrated binaural filtering; perceptual criteria; prerecorded sound; progressive sound rendering; real time synthesis; resource availability; sinusoidal analysis; sound source modeling; sound transmission simulation; virtual object geometry; virtual object material properties; virtual object modal analysis; Algorithm design and analysis; Frequency; Geometry; Material properties; Modal analysis; Rough surfaces; Signal analysis; Signal synthesis; Solid modeling; Surface roughness;
Conference_Titel :
Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference on
Conference_Location :
Taipei
Print_ISBN :
0-7803-8603-5
DOI :
10.1109/ICME.2004.1394276
