Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network
journal contribution
posted on 2018-11-13, 11:11 authored by Jiachen Yang, Yang Zhao, Yinghao Zhu, Huifang Xu, Wen Lu, Qinggang MengQinggang Meng© 2018 Elsevier Inc. In recent years, blind image quality assessment in the field of 2D image/video has gained the popularity, but its applications in 3D image/video are to be generalized. In this paper, we propose an effective blind metric evaluating stereo images via deep belief network (DBN). This method is based on wavelet transform with both 2D features from monocular images respectively as image content description and 3D features from a novel depth perception map (DPM) as depth perception description. In particular, the DPM is introduced to quantify longitudinal depth information to align with human stereo visual perception. More specifically, the 2D features are local histogram of oriented gradient (HoG) features from high frequency wavelet coefficients and global statistical features including magnitude, variance and entropy. Meanwhile, the global statistical features from the DPM are characterized as 3D features. Subsequently, considering binocular characteristics, an effective binocular weight model based on multiscale energy estimation of the left and right images is adopted to obtain the content quality. In the training and testing stages, three DBN models for the three types features separately are used to get the final score. Experimental results demonstrate that the proposed stereo image quality evaluation model has high superiority over existing methods and achieve higher consistency with subjective quality assessments.
History
School
- Science
Department
- Computer Science
Published in
Information SciencesVolume
474Pages
1 - 17Citation
YANG, J. ... et al., 2019. Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network. Information Sciences, 474, pp. 1-17.Publisher
© ElsevierVersion
- AM (Accepted Manuscript)
Publisher statement
This paper was accepted for publication in the journal Information Sciences and the definitive published version is available at https://doi.org/10.1016/j.ins.2018.08.066.Publication date
2019ISSN
0020-0255Publisher version
Language
- en
Administrator link
Usage metrics
Keywords
Licence
Exports
RefWorksRefWorks
BibTeXBibTeX
Ref. managerRef. manager
EndnoteEndnote
DataCiteDataCite
NLMNLM
DCDC