结合美学特征的无参考色调映射图像质量评价
PDF下载 (516)刘 佳1,郁 梅1,2*,姜 浩1,马华林1.结合美学特征的无参考色调映射图像质量评价[J].宁波大学学报(理工版),2018,31(6):12-19.DOI:
LIU Jia1,YU Mei1,2*,JIANG Hao1,MA Hua-lin1.No-reference image quality evaluation of tone-mapped images based on aesthetic characteristics[J].Journal of Ningbo University(Natural Science & Engineering Edition),2018,31(6):12-19.DOI:
| Title: | No-reference image quality evaluation of tone-mapped images based on aesthetic characteristics |
| 作者: | 刘 佳1, 郁 梅1, 2*, 姜 浩1, 马华林1 |
| Author(s): | LIU Jia1, YU Mei1, 2*, JIANG Hao1, MA Hua-lin1 |
| 关键词: | 高动态范围图像; 色调映射图像; 图像质量评价; 美学特征 |
| Keywords: | high dynamic range image; tone-mapped image; image quality assessment; aesthetics characteristics |
| 分类号: | TN911.73 |
| 文献标识码: | A |
| 摘要: | 如何对色调映射图像(Tone-mapped Image, TMI)质量进行有效评价是图像处理领域亟待解决的问题. 现有方法仅是低动态范围图像质量评价方法的改进, 并未考虑TM图像本身独有的特点. 基于此, 本文提出了一种结合美学特征的TMI质量评价方法. 从颜色保真度、色温分布、对比度、黑暗度、自然度5个方面出发提取图像的美学特征, 并在梯度域、张量域、高斯差分域和拉普拉斯域提取变换域特征, 利用支持向量回归训练得到质量评价模型. 在ESPL-LIVE HDR库上的实验表明, 现有代表性方法的Spearman秩相关系数最高为0.752, 而所提出模型可达0.766, 与人眼感知结果具有更强的一致性. |
| Abstract: | How to effectively evaluate the Tone-Mapped Image (TMI) has become much-needed subject worth probing in the field of image processing. The existing method offers only improvement of the low dynamic range image quality evaluation method without considering the unique characteristics of the TMI itself. To tackle this weakness, in this paper a TMI quality evaluation method is proposed which takes the aesthetic features into consideration. The aesthetic features of the image are extracted from five indices: color fidelity, color temperature distribution, contrast, darkness, and naturalness. The transform domain features are extracted from the domains of the gradient, tensor, difference of Gaussian, and Laplacian. Based on the feature extraction, the quality evaluation model is trained through support vector regression. Experimental results by applying to the ESPL-LIVE HDR Image Database show that the Spearman rank correlation coefficient of the proposed model can reach 0.766 comparing with the other existing methods being no greater than 0.752, which indicates that the proposed model is in better agreement with the results given by human eye perception. |
| 参考文献 /References: | [1].Chen H, Zhu R, Li M C, et al. Pixel-by-pixel local dimming for high-dynamic-range liquid crystal displays [J]. Optics Express, 2017, 25(3):1973-1984. [2].Artusi A, Mantiuk R K, Richter T, et al. JPEG XT: A compression standard for HDR and WCG images[J]. IEEE Signal Processing Magazine, 2016, 33(2):118-124. [3].Ma K, Yeganeh H, Zeng K, et al. High dynamic range image tone mapping by optimizing tone mapped image quality index[J]. IEEE Transactions on Image Processing, 2015, 24(10):3086-3097. [4].Neelima N, Adithya G, Avinash D, et al. Tone mapping operators for conversion of HDR images to LDR[J]. Iup Journal of Electrical & Electronics Engineering, 2016, 9(2):103-115. [5].Yeganeh H, Wang Z. Objective quality assessment of tone-mapped images[J]. IEEE Transactions on Image Processing, 2013, 22(2):657-67. [6].何美伶, 郁梅. 基于双目融合与竞争的无参考立体图像质量评价方法[J]. 宁波大学学报(理工版), 2016, 29 (4):50-55. [7].Kundu D, Evans B L. Visual attention guided quality assessment of tone-mapped images using scene statistics[C]. IEEE International Conference on Image Processing, 2016:96-100. [8].Xie L, Zhang X, Wang S, et al. Quality assessment of tone-mapped images based on sparse representation[C]. IEEE International Symposium on Circuits and Systems, 2016:2218-2221. [9].Nafchi H Z, Shahkolaei A, Moghaddam R F, et al. FSITM: A feature similarity index for tone-mapped images[J]. IEEE Signal Processing Letters, 2014, 22(8):1026-1029. [10].Gu K, Wang S, Zhai G, et al. Blind quality assessment of tone-mapped images via analysis of information, naturalness, and structure[J]. IEEE Transactions on Multimedia, 2016, 18(3):432-443. [11].Kundu D, Ghadiyaram D, Bovik A C, et al. Large-scale crowdsourced study for tone mapped HDR pictures[J]. IEEE Transactions on Image Processing, 2017, 26(10): 4725-4740. [12].顾婷婷. 结合美学的图像质量评价及优化[D]. 南京南京大学, 2013.Jenadeleh M, Masaeli M M, Moghaddam M E. Blind image quality assessment based on aesthetic and statistical quality-aware features[EB/OL]. [2017-09-14]. https://doi.org/10.1117/1.JEI.26.4.043018. [13].Jraissati Y, Douven I. Does optimal partitioning of color space account for universal color categorization? [EB/OL]. [2017-09-21]. https://doi.org/10.1371/journal. pone.0178083. [14].Li B, Xiong W, Hu W, et al. Multi-cue illumination estimation via a tree-structured group joint sparse representation[J]. International Journal of Computer Vision, 2016, 117(1):21-47. [15].Mccamy C S. Correlated color temperature as an explicit function of chromaticity coordinates[J]. Color Research & Application, 2010, 17(2):142-144. [16].Gu K, Lin W, Zhai G, et al. No-reference quality metric of contrast-distorted images based on information maximization[J]. IEEE Transactions on Cybernetics, 2016, 47(12):4559-4565. [17].Kaya O, U?ar B. High performance parallel algorithms for the tucker decomposition of sparse tensors[C]. International Conference on Parallel Processing, 2016: 103-112. [18].Mittal A, Moorthy A K, Bovik A C. No-reference image quality assessment in the spatial domain[J]. IEEE Transactions on Image Processing, 2012, 21(12):4695- 4708. [19].Saad M A, Bovik A C, Charrier C. Blind image quality assessment: A natural scene statistics approach in the DCT domain[J]. IEEE Transactions on Image Processing, 2012, 21(8):3339-3352. [20].Zhang Y, Moorthy A K, Chandler D M, et al. C-DIIVINE: No-reference image quality assessment based on local magnitude and phase statistics of natural scenes[J]. Signal Processing Image Communication, 2014, 29(7):725-747. [21].Moorthy A K, Bovik A C. Blind image quality assessment: From natural scene statistics to perceptual quality[J]. IEEE Transactions on Image Processing, 2011, 20(12): 3350-3364. [22].Liu L, Dong H, Huang H, et al. No-reference image quality assessment in curvelet domain[J]. Signal Processing Image Communication, 2014, 29(4):494-505. [23].Xue W, Mou X, Zhang L, et al. Blind image quality assessment using joint statistics of gradient magnitude and laplacian features[J]. IEEE Transactions on Image Processing, 2014, 23(11):4850-4862. |
| 备注/Memo: | 收稿日期: 2017?11?14. 宁波大学学报（理工版）网址: http://journallg.nbu.edu.cn/ 基金项目: 国家自然科学基金（61671258）; 浙江省自然科学基金（LY15F010005）. 第一作者: 刘佳（1993－）, 女, 浙江衢州人, 在读硕士研究生, 主要研究方向: 高动态范围图像技术. E-mail: 2994838645@qq.com *通信作者: 郁梅（1968－）, 女, 江苏无锡人, 博导/教授, 主要研究方向: 多媒体信号处理与通信. E-mail: yumei@nbu.edu.cn 宁波大学学报（理工版）网址：http://journallg.nbu.edu.cn/ |
