一种自适应四叉树分块的图像拼接算法
PDF下载 (18630)王元炜 1,郁 梅 1,2*,姜 浩 1,邵 华 1.一种自适应四叉树分块的图像拼接算法[J].宁波大学学报(理工版),2018,31(4):52-58.DOI:
Wang Yuan-wei 1,Yu Mei 1,2*,Jiang Hao 1,Shao Hua 1.An image stitching algorithm via adaptive quadtree segmentation[J].Journal of Ningbo University(Natural Science & Engineering Edition),2018,31(4):52-58.DOI:
| Title: | An image stitching algorithm via adaptive quadtree segmentation |
| 作者: | 王元炜 1, 郁 梅 1, 2*, 姜 浩 1, 邵 华 1 |
| Author(s): | Wang Yuan-wei 1, Yu Mei 1, 2*, Jiang Hao 1, Shao Hua 1 |
| 关键词: | 图像拼接; 图像映射; 投影变换; 四叉树 |
| Keywords: | image stitching; image warping; projective transformation; quadtree |
| 分类号: | TN911.73 |
| 文献标识码: | A |
| 摘要: | 图像拼接技术是计算机图形学的研究热点, 具有代表性的As-Projective-As-Possible (APAP)算法采用均匀分块法来实现图像拼接的局部映射, 没有充分考虑图像不同区域之间的差异性. 为了兼顾图像拼接的精度和效率, 提出了一种基于特征点分布的图像映射算法, 利用四叉树对图像分块来实现图像拼接的局部映射. 首先, 设定四叉树的最大深度, 并根据图像匹配点的总数估计出每个图像块的匹配点阈值; 然后, 利用最大深度和匹配点阈值对图像做自适应四叉树分块; 最后, 对不同的图像块使用移动线性变换估计出单应性矩阵, 依据估计的结果完成图像拼接. 实验结果表明, 提出的算法提高了图像拼接的精度, 其速度远大于APAP算法, 并且提升了拼接图像的质量. |
| Abstract: | Image stitching is a hot topic in computer graphics research, and the representative As-Projective-As- Possible (APAP) stitching algorithm segments image into uniform blocks to achieve local image warping, which does not take into full account the differences between varying image regions. In order to achieve the tradeoff between the accuracy and the efficiency of image stitching, an image warping algorithm based on the feature points distribution is proposed, which uses quadtree to segment image into blocks to achieve local image warping for image stitching. Firstly, the maximum depth of the quadtree is set, and the matching threshold of each image block is estimated according to the number of image matching points. Then, the maximum depth and the matching point threshold is used to adaptively segment the image into blocks by quadtree. Finally, homography matrices of different image blocks are estimated by Moving Direct Linear Transformation algorithm to complete the stitching. The experimental results show that the proposed algorithm notably improve the accuracy of image stitching, and the speed is much faster than the APAP algorithm, and the quality of the stitched image is ameliorated accordingly. |
| 参考文献 /References: | [1] Xiang T, Xia G S, Zhang L, et al. Locally warping-based image stitching by imposing line constraints[C]. 23rd International Conference on Pattern Recognition (ICPR), 2016:4178-4183. [2] 谷雨, 周阳, 任刚, 等. 结合最佳缝合线和多分辨率融合的图像拼接[J]. 中国图象图形学报, 2017, 22(6):842-851. [3] Brown M, Lowe D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision, 2007, 74(1):59-73. [4] Gao J, Kim S J, Brown M S. Constructing image panoramas using dual-homography warping[C]. IEEE Conference on Computer Vision and Pattern Recognition, 2011:49-56. [5] Lin W Y, Liu S, Matsushita Y, et al. Smoothly varying affine stitching[C]. IEEE Conference on Computer Vision and Pattern Recognition, 2011:345-352. [6] Zaragoza J, Chin T J, Brown M S, et al. As-Projective- As-Possible image stitching with moving DLT[C]. IEEE Conference on Computer Vision and Pattern Recognition, 2013:2339-2346. [7] Li Y, Wang S, Tian Q, et al. A survey of recent advances in visual feature detection[J]. Neurocomputing, 2015, 149(PB):736-751. [8] Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110. [9] Salahat E, Qasaimeh M. Recent advances in features extraction and description algorithms: A comprehensive survey[C]. 2017 IEEE International Conference on Industrial Technology (ICIT), 2017:1059-1063. [10] Fischler M A, Bolles R C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6):381-395. [11] 冯宇平. 图像快速配准与自动拼接技术研究[D]. 长春: 中国科学院长春光学精密机械与物理研究所, 2010. [12] Zaragoza J, Chin T J, Tran Q H, et al. As-projective-as-possible image stitching with moving DLT[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2014, 36(7):1285-1298. [13] 曾清红, 卢德唐. 基于移动最小二乘法的曲线曲面拟合[J]. 工程图学学报, 2004(1):84-89. [14] Lin C C, Pankanti S U, Ramamurthy K N, et al. Adaptive as-natural-as-possible image stitching[C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015:1155-1163. [15] 白瑞广. 全景视频系统若干关键技术研究[D]. 湘潭: 湘潭大学, 2014. |
| 备注/Memo: | 收稿日期: 2017－11－13. 宁波大学学报（理工版）网址: http://journallg.nbu.edu.cn/基金项目: 国家自然科学基金（61671258）; 浙江省自然科学基金（LY15F010005）.第一作者: 王元炜（1993－）, 男, 湖北十堰人, 在读硕士研究生, 主要研究方向: 多媒体信号处理与通信. E-mail: wyw1038194231@qq.com*通信作者: 郁梅（1968－）, 女, 江苏无锡人, 博导/教授, 主要研究方向: 多媒体信号处理与通信. E-mail: yumei2@126.com 宁波大学学报（理工版）网址：http://journallg.nbu.edu.cn/ |
