Sound localisation for 3D multimedia streaming

This paper proposes an audiovisual 3D multimedia system based on multi-view video and wave field synthesis cooperated with the object-based audio. The spatial audio rendering method based on wave field synthesis is particularly useful for applications where multiple users experience true immersive sound while being free to move without losing spatial sound effects. The unique features of the methodology can be very useful in high quality virtual experience applications, and in particular for creating precise audio objects synchronised with multi-view video stream, delivered to the users in network platforms. The paper introduces a novel 3D multimedia rendering and streaming architecture over the Internet, and also reports on the experimental results. The multimedia system is demonstrated and con-firmed that while covering the viewing angle, the developed approach can create a variety of virtual audio objects at target positions with very high accuracy.