Sound localisation for 3D multimedia streaming
conference contributionposted on 26.05.2016 by Hyun Lim, Cagri Ozcinar, Andrew P. Hill, Ahmet Kondoz
Any type of content contributed to an academic conference, such as papers, presentations, lectures or proceedings.
This paper proposes an audiovisual 3D multimedia system based on multi-view video and wave field synthesis cooperated with the object-based audio. The spatial audio rendering method based on wave field synthesis is particularly useful for applications where multiple users experience true immersive sound while being free to move without losing spatial sound effects. The unique features of the methodology can be very useful in high quality virtual experience applications, and in particular for creating precise audio objects synchronised with multi-view video stream, delivered to the users in network platforms. The paper introduces a novel 3D multimedia rendering and streaming architecture over the Internet, and also reports on the experimental results. The multimedia system is demonstrated and con-firmed that while covering the viewing angle, the developed approach can create a variety of virtual audio objects at target positions with very high accuracy.
- Loughborough University London