[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]

一种旋转和尺度不变的异源景象匹配方法

  • 彭韬 ,
  • 杨培臻 ,
  • 周亮 ,
  • 唐腾峰 ,
  • 叶沅鑫
展开
  • 西南交通大学地球科学与工程学院,四川 成都 611756
叶沅鑫(1985—),男,教授,博士,研究方向:遥感图像处理。

彭韬(2000—),男,硕士研究生,研究方向:多模态遥感图像匹配。

收稿日期: 2024-07-04

  网络出版日期: 2024-12-18

基金资助

国家自然科学基金项目(42271446)

A Rotation and Scale Invariant Heterogeneous Sence Matching Approach

  • PENG Tao ,
  • YANG Peizhen ,
  • ZHOU Liang ,
  • TANG Tengfeng ,
  • YE Yuanxin
Expand
  • Faculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu 611756, Sichuan, China

Received date: 2024-07-04

  Online published: 2024-12-18

摘要

异源景象匹配作为一种重要的辅助导航手段已经被广泛研究,但受到异源图像对之间非线性辐射失真和几何变形的影响,实现异源图像的匹配仍然是一项具有挑战性的任务。为了解决这些问题,提出了一种具备旋转和尺度不变性的异源景象匹配方法以同时估计异源图像对之间的旋转、尺度和位移变化。首先,基于图像局部的结构关系,利用局部自相似描述子进行特征描述以抵抗非线性辐射差异和局部变形的影响。再结合对数极坐标变换将图像整体的旋转和尺度变化正交展开并分别在笛卡尔坐标系上表示。最后,利用位移估计以及旋转和尺度估计的连续性,构造了一个五维特征描述符,并利用相位相关方法同时估计图像的旋转、尺度和位移变化量。在3种常见类型的异源图像匹配任务上进行的实验表明,文中的方法相较于当前其他先进的方法,在匹配正确率方面至少能提高4.5%,这突出了其在异源景象匹配领域的有效性。

本文引用格式

彭韬 , 杨培臻 , 周亮 , 唐腾峰 , 叶沅鑫 . 一种旋转和尺度不变的异源景象匹配方法[J]. 弹箭与制导学报, 2024 , 44(5) : 38 -46 . DOI: 10.15892/j.cnki.djzdxb.2024.05.005

Abstract

Heterogeneous scene matching, as an important auxiliary navigation method, has been widely studied. However, due to the influence of nonlinear radiation distortion and geometric deformation between heterogeneous image pairs, achieving heterogeneous image matching remains a challenging task. To address these issues, a heterogeneous scene matching method with rotation and scale invariance is proposed to simultaneously estimate the rotation, scale, and displacement variations between heterogeneous image pairs. Firstly, based on the local structural relationships of the image, local self-similarity descriptors (LSS) are used for feature description to resist the influence of nonlinear radiation differences and local deformations. Combined with the logarithmic polar coordinate transformation, the overall rotation and scale changes of the image are orthogonally expanded and represented separately in the Cartesian coordinate system. Finally, by utilizing the continuity of displacement estimation, rotation, and scale estimation, a five-dimensional feature descriptor is constructed and using phase correlation method estimates the variation of image rotation, scale and displacement simultaneously. Experiments conducted on three common types of heterogeneous image matching tasks shows that the proposed method achieves a matching accuracy of at least 4.5% higher than existing state-of-the-art methods tech, that highlights its effectiveness in the field of heterogeneous scene matching.

[an error occurred while processing this directive]
[1]
马卫华. 导弹/火箭制导、导航与控制技术发展与展望[J]. 宇航学报, 2020, 41(7):860-867.

MA W H. Review and prospect of missile/launch vehicle guidance, navigation and control technologies[J]. Journal of Astronautics, 2020, 41(7): 860-867.

[2]
倪少杰, 李诗扬, 谢郁辰, 等. GNSS/INS超紧组合导航综述[J]. 国防科技大学学报, 2023, 45(5):48-59.

NI S J, LI S Y, XIE Y C, et al. Overview of GNSS/INS ultra-tight integrated navigation[J]. Journal of National University of Defense Technology, 2023, 45(5):48-59.

[3]
杨波, 王跃钢, 徐洪涛. 弹载惯性/卫星/星光高精度组合导航[J]. 中国惯性技术学报, 2010, 18(4):444-449.

YANG B, WANG Y G, XU H T. High-precision integrated inertial/satellite/starlight navigation for missile[J]. Journal of Chinese Inertial Technology, 2010, 18(4):444-449.

[4]
ZHUANG Y, SUN X, LI Y, et al. Multi-sensor integrated navigation/positioning systems using data fusion: From analytics-based to learning-based approaches[J]. Information Fusion, 2023, 95: 62-90.

[5]
HE Y, LI J, LIU J. Research on GNSS INS & GNSS/INS integrated navigation method for autonomous vehicles: a survey[J]. IEEE Access, 2023: 79033-79055.

[6]
CARR J R, SOBEK J S. Digital scene matching area correlator (DSMAC)[M]. Image Processing For Missile Guidance. New York: SPIE, 1980, 238: 36-41.

[7]
黄显林, 姜肖楠, 卢鸿谦, 等. 自主视觉导航方法综述[J]. 吉林大学学报(信息科学版), 2010, 28(2):158-165.

HUANG X L, JIANG X N, LU H Q, et al. Survey of vision for autonomous navigation[J]. Journal of Jilin University(Information Science Edition), 2010, 28(2):158-165.

[8]
陈圣义, 刘晓春, 雷志辉, 等. 结合景象匹配与惯导信息的SAR平台定位方法[J]. 国防科技大学学报, 2017, 39(4):105-109.

CHEN S Y, LIU X C, LEI Z H, et al. SAR platform location method based on scene matching and inertial navigation system information[J]. Journal of National University of Defense Technology, 2017, 39(4):105-109.

[9]
JIANG X, MA J, XIAO G, et al. A review of multimodal image matching: methods and applications[J]. Information Fusion, 2021, 73: 22-71.

[10]
DENG Y, MA J. ReDFeat: recoupling detection and description for multimodal feature learning[J]. IEEE Transactions on Image Processing, 2022, 32: 591-602.

[11]
CHEN J, CHEN X, CHEN S, et al. Shape-former: bridging CNN and transformer via ShapeConv for multimodal image matching[J]. Information Fusion, 2023, 91: 445-457.

[12]
YE Y, YANG C, GONG G, et al. Robust optical and SAR image matching using attention-enhanced structural features[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62: 1-12.

[13]
YE Y, TANG T, ZHU B, et al. A multiscale framework with unsupervised learning for remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-15.

[14]
LI J, HU Q, AI M. RIFT: multi-modal image matching based on radiation-variation insensitive feature transform[J]. IEEE Transactions on Image Processing, 2019, 29: 3296-3310.

[15]
SUN Y, ZHAO L, HUANG S, et al. Line matching based on planar homography for stereo aerial images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015, 104: 1-17.

[16]
LI Z, YUE J, FANG L. Adaptive regional multiple features for large-scale high-resolution remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-13.

[17]
SEDAGHAT A, MOHAMMADI N. Illumination-robust remote sensing image matching based on oriented self-similarity[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 153: 21-35.

[18]
XIONG X, JIN G, XU Q, et al. Self-similarity features for multimodal remote sensing image matching[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 12440-12454.

[19]
XIONG X, JIN G, XU Q, et al. Robust registration algorithm for optical and SAR images based on adjacent self-similarity feature[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-17.

[20]
ZHU B, YANG C, DAI J, et al. R2FD2: fast and robust matching of multimodal remote sensing images via repeatable feature detector and rotation-invariant feature descriptor[J]. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 1-15.

[21]
YE Y, SHAN J, BRUZZONE L, et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5): 2941-2958.

[22]
MA J, JIANG X, FAN A, et al. Image matching from handcrafted to deep features: a survey[J]. International Journal of Computer Vision, 2021, 129(1): 23-79.

[23]
ORON S, DEKEL T, XUE T, et al. Best-buddies similarity—Robust template matching using mutual nearest neighbors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 40(8): 1799-1813.

[24]
KUGLIN C, HINES D. The phase correlation image alignment method[C]// IEEE. Proceedings of the IEEE International Conference on Cybernetics and Society. New York: IEEE, 1975, 1975: 163-165.

[25]
SHECHTMAN E, IRANI M. Matching local self-similarities across images and videos[C]// IEEE. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2007: 1-8.

[26]
HEINRICH M P, JENKINSON M, BHUSHAN M, et al. MIND: modality independent neighbourhood descriptor for multi-modal deformable registration[J]. Medical image analysis, 2012, 16(7): 1423-1435.

DOI PMID

[27]
YE Y, SHEN L, HAO M, et al. Robust optical-to-SAR image matching based on shape properties[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(4): 564-568.

[28]
XIONG X, XU Q, JIN G, et al. Rank-based local self-similarity descriptor for optical-to-SAR image matching[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 17(10): 1742-1746.

[29]
YE Y, SHAN J, BRUZZONE L, et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5): 2941-2958.

[30]
YE Y, BRUZZONE L, SHAN J, et al. Fast and robust matching for multimodal remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11): 9059-9070.

[31]
LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60: 91-110.

[32]
DETONE D, MALISIEWICZ T, RABINOVICH A. Superpoint: self-supervised interest point detection and description[C]// IEEE. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018: 224-236.

[33]
SARLIN P E, DETONE D, MALISIEWICZ T, et al. Superglue: learning feature matching with graph neural networks[C]// /IEEE. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2020: 4938-4947.

[34]
DENG Y, MA J. ReDFeat: recoupling detection and description for multimodal feature learning[J]. IEEE Transactions on Image Processing, 2022, 32: 591-602.

[35]
LI J, HU Q, ZHANG Y. Multimodal image matching: a scale-invariant algorithm and an open dataset[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2023, 204: 77-88.

[36]
JI S, WEI S, LU M. Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 57(1): 574-586.

[37]
XIANG Y, TAO R, WANG F, et al. Automatic registration of optical and SAR images via improved phase congruency model[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13: 5847-5861.

文章导航

/

[an error occurred while processing this directive]