基于双目融合与竞争的无参考立体图像质量评价方法
PDF下载 (417)何美伶 1,郁 梅 1,2*.基于双目融合与竞争的无参考立体图像质量评价方法[J].宁波大学学报(理工版),2016,29(4):50-55.DOI:
HE Mei-ling 1,YU Mei 1,2*.No-reference Stereoscopic Image Quality Assessment Based on Binocular Fusion and Binocular Rivalry[J].Journal of Ningbo University(Natural Science & Engineering Edition),2016,29(4):50-55.DOI:
| Title: | No-reference Stereoscopic Image Quality Assessment Based on Binocular Fusion and Binocular Rivalry |
| 作者: | 何美伶 1, 郁 梅 1, 2* |
| Author(s): | HE Mei-ling 1, YU Mei 1, 2* |
| 关键词: | 立体图像质量评价; 无参考图像质量评价; 双目融合; 双目竞争; 独眼图 |
| Keywords: | stereoscopic image quality assessment; no-reference quality assessment; binocular fusion; binocular rivalry; cyclopean image |
| 分类号: | TN919.81 |
| 文献标识码: | A |
| 摘要: | 根据人眼对立体图像的感知过程, 提出了一种基于双目融合和竞争特性的无参考立体图像质量评价方法. 首先将左右视点图像进行融合, 对得到的独眼图进行Gabor特征提取; 然后对左右视点图像的绝对差值图提取特征; 最后将独眼图特征和绝对差值图特征融合得到立体图像特征集, 通过支持向量回归预测得到客观值. 采用该方法对LIVE立体图像数据库进行评价, Pearson线性相关系数(PLCC)和Spearman等级相关系数(SROCC)均在0.94左右, 优于其他参与对比的质量评价方法. 表明该方法符合人眼视觉特性, 能够很好地描述人眼感知特性. |
| Abstract: | Stereoscopic image quality assessment (SIQA) plays an important role in stereo video system applications. According to the processing of binocular perception in watching stereo image, a novel no-reference SIQA based on binocular fusion and binocular rivalry is proposed. In this method, firstly, Gabor filtering features are extracted from the binocular fusion image formed by both left and right view images. Secondly, the natural features are abstracted from absolute difference map. Finally, two parts of features are incorporated to form stereoscopic image feature information, and support vector regression is used to predict the objective scores by establishing the relationship between the stereoscopic image feature information and the subjective scores. By applying the proposed method to the test stereoscopic image database, it demonstrates that correlation coefficients are all about 0.94, better than the other representative image quality assessment methods, suggesting that the proposed method has better correlation with human subjective visual quality evaluation compared with some existing methods. |
| 参考文献 /References: | [1] SHAO F, LI K M, LIN W S, et al. Using binocular feature combination for blind quality assessment of stereoscopic images[J]. IEEE Signal Processing Letters, 2015, 22(10):1548-1551. [2] 蒋刚毅, 黄大江, 王旭, 等. 图像质量评价方法研究进展[J]. 电子信息学报, 2010, 32(1):2396-2400. [3] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: From error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4):600-612 [4] WANG Z, SIMONCELLI E P, BOVIK A C. Multiscale structural similarity for image quality assessment[C]// Proc of the 37th Asilomar Conference on Signals, Systems and Computers. New York: IEEE, 2004:1398- 1402. [5] ZHANG L, ZHANG L, MOU X Q, et al. FSIM: A feature similarity index for image quality assessment[J]. IEEE Transactions on Image Processing, 2011, 20(8):2378- 2386. [6] XUE W F, ZHANG L, MOU X Q, et al. Gradient magnitude similarity deviation: A highly efficient perceptual image quality index[J]. IEEE Transactions on Image Processing, 2014, 23(2):684-695. [7] MITTAL A, MOORTHY A K, BOVIK A C. No-reference image quality assessment in the spatial domain[J]. IEEE Transactions on Image Processing, 2012, 21(12):4695- 4708. [8] BENOIT A, CALLET P L, CAMPISI P, et al. Quality assessment of stereoscopic images[J]. Journal on Image and Video Processing, 2008, 209:1-13. [9] YOU J M, XING L Y, PERKIS A, et al. Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis[EB/OL]. [2015-09-23]. https://www.researchgate.net/publication/ 200774635_Perceptual_Quality_Assessment_for_Stereoscopic_Images_Based_on_2D_Image_Quality_Metrics_and_Disparity_Analysis. [10] CHEN M J, LAWRENCE K C, BOVIK A C. No- reference quality assessment of natural stereopairs[J]. IEEE Transactions on Image Processing, 2013, 22(9): 3379-3392. [11] LIN Y H, WU J L. Quality assessment of stereoscopic 3D image compression by binocular integration behaviors[J]. IEEE Transactions on Image Processing, 2014, 23(4): 1527-1542. [12] DAUGMAN J G. Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression[J]. IEEE Transactions on Acoustic Speech and Signal Processing, 1998, 36(7):1169-1179. [13] RUDERMAN D L. The statistics of natural images[J]. Network (Computation in Neural Systems), 1994, 5(4): 517-548. [14] MITTAL A, MOORTHY A K, BOVIK A C. Making image quality assessment robust[EB/OL]. [2015-09-23]. http://www.doc88.com/p-6873139629451.html. [15] CHANG C C, LIN C J. LIBSVM: A library for support vector machines[J]. ACM Transactions on Intelligent Systems and Technology, 2011, 2(3):1-27. [16] CHEN M J, SU C C, KWON D K, et al. Full-reference quality assessment of stereopairs accounting for binocular rivalry[J] Signal Processing (Image Communication), 2013, 28:1143-1155. [17] VQEG. Final report from the video quality experts group on the validation of objective models of video quality assessment[EB/OL]. [2015-09-23]. http://www.vqeg.org. [18] PAUL G G, JOHN R D. The five-parameter logistic: A characterization and comparison with the four-parameter logistic[J]. Analytical Biochemistry, 2005, 343(1):54-65. [19] SU C C, LAWRENCE K C, BOVIK A C. Oriented correlation models of distorted natural images with application to natural stereopair quality evaluation[J]. IEEE Transactions on Image Processing, 2015, 24(5): 1685-1699. |
| 备注/Memo: | 收稿日期: 2015-10-10. 宁波大学学报(理工版)网址: http://journallg.nbu.edu.cn/ 基金项目: 国家自然科学基金(61271270); 浙江省自然科学基金(LY15F010005). 第一作者: 何美伶(1991-), 女, 山东潍坊人, 在读硕士研究生, 主要研究方向: 立体图像及视频质量评价. E-mail: hemeiling1991@126.com *通信作者: 郁梅(1968-), 女, 江苏无锡人, 博士/教授, 主要研究方向: 视频通信与图像处理等. E-mail: yumei@nbu.edu.cn 宁波大学学报(理工版)网址:http://journallg.nbu.edu.cn/ |