[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]

Journal of Projectiles, Rockets, Missiles and Guidance >

2024 , Vol. 44 >Issue 5: 38 - 46

DOI: https://doi.org/10.15892/j.cnki.djzdxb.2024.05.005

A Rotation and Scale Invariant Heterogeneous Sence Matching Approach

  • PENG Tao ,
  • YANG Peizhen ,
  • ZHOU Liang ,
  • TANG Tengfeng ,
  • YE Yuanxin
Expand
  • Faculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu 611756, Sichuan, China

Received date: 2024-07-04

  Online published: 2024-12-18

Fold

Abstract

Heterogeneous scene matching, as an important auxiliary navigation method, has been widely studied. However, due to the influence of nonlinear radiation distortion and geometric deformation between heterogeneous image pairs, achieving heterogeneous image matching remains a challenging task. To address these issues, a heterogeneous scene matching method with rotation and scale invariance is proposed to simultaneously estimate the rotation, scale, and displacement variations between heterogeneous image pairs. Firstly, based on the local structural relationships of the image, local self-similarity descriptors (LSS) are used for feature description to resist the influence of nonlinear radiation differences and local deformations. Combined with the logarithmic polar coordinate transformation, the overall rotation and scale changes of the image are orthogonally expanded and represented separately in the Cartesian coordinate system. Finally, by utilizing the continuity of displacement estimation, rotation, and scale estimation, a five-dimensional feature descriptor is constructed and using phase correlation method estimates the variation of image rotation, scale and displacement simultaneously. Experiments conducted on three common types of heterogeneous image matching tasks shows that the proposed method achieves a matching accuracy of at least 4.5% higher than existing state-of-the-art methods tech, that highlights its effectiveness in the field of heterogeneous scene matching.

Key words： heterogeneous scene matching; local self-similarity; logarithmic polar coordinate transformation; five-dimensional feature descriptors

Cite this article

PENG Tao , YANG Peizhen , ZHOU Liang , TANG Tengfeng , YE Yuanxin . A Rotation and Scale Invariant Heterogeneous Sence Matching Approach[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2024 , 44(5) : 38 -46 . DOI: 10.15892/j.cnki.djzdxb.2024.05.005

[an error occurred while processing this directive]

References

Publishing order | Descend order by publishing year | Descend order by cited within
[1]
马卫华. 导弹/火箭制导、导航与控制技术发展与展望[J]. 宇航学报, 2020, 41(7):860-867.

MA W H. Review and prospect of missile/launch vehicle guidance, navigation and control technologies[J]. Journal of Astronautics, 2020, 41(7): 860-867.

[2]
倪少杰, 李诗扬, 谢郁辰, 等. GNSS/INS超紧组合导航综述[J]. 国防科技大学学报, 2023, 45(5):48-59.

NI S J, LI S Y, XIE Y C, et al. Overview of GNSS/INS ultra-tight integrated navigation[J]. Journal of National University of Defense Technology, 2023, 45(5):48-59.

[3]
杨波, 王跃钢, 徐洪涛. 弹载惯性/卫星/星光高精度组合导航[J]. 中国惯性技术学报, 2010, 18(4):444-449.

YANG B, WANG Y G, XU H T. High-precision integrated inertial/satellite/starlight navigation for missile[J]. Journal of Chinese Inertial Technology, 2010, 18(4):444-449.

[4]
ZHUANG Y, SUN X, LI Y, et al. Multi-sensor integrated navigation/positioning systems using data fusion: From analytics-based to learning-based approaches[J]. Information Fusion, 2023, 95: 62-90.

[5]
HE Y, LI J, LIU J. Research on GNSS INS & GNSS/INS integrated navigation method for autonomous vehicles: a survey[J]. IEEE Access, 2023: 79033-79055.

[6]
CARR J R, SOBEK J S. Digital scene matching area correlator (DSMAC)[M]. Image Processing For Missile Guidance. New York: SPIE, 1980, 238: 36-41.

[7]
黄显林, 姜肖楠, 卢鸿谦, 等. 自主视觉导航方法综述[J]. 吉林大学学报(信息科学版), 2010, 28(2):158-165.

HUANG X L, JIANG X N, LU H Q, et al. Survey of vision for autonomous navigation[J]. Journal of Jilin University(Information Science Edition), 2010, 28(2):158-165.

[8]
陈圣义, 刘晓春, 雷志辉, 等. 结合景象匹配与惯导信息的SAR平台定位方法[J]. 国防科技大学学报, 2017, 39(4):105-109.

CHEN S Y, LIU X C, LEI Z H, et al. SAR platform location method based on scene matching and inertial navigation system information[J]. Journal of National University of Defense Technology, 2017, 39(4):105-109.

[9]
JIANG X, MA J, XIAO G, et al. A review of multimodal image matching: methods and applications[J]. Information Fusion, 2021, 73: 22-71.

[10]
DENG Y, MA J. ReDFeat: recoupling detection and description for multimodal feature learning[J]. IEEE Transactions on Image Processing, 2022, 32: 591-602.

[11]
CHEN J, CHEN X, CHEN S, et al. Shape-former: bridging CNN and transformer via ShapeConv for multimodal image matching[J]. Information Fusion, 2023, 91: 445-457.

[12]
YE Y, YANG C, GONG G, et al. Robust optical and SAR image matching using attention-enhanced structural features[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62: 1-12.

[13]
YE Y, TANG T, ZHU B, et al. A multiscale framework with unsupervised learning for remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-15.

[14]
LI J, HU Q, AI M. RIFT: multi-modal image matching based on radiation-variation insensitive feature transform[J]. IEEE Transactions on Image Processing, 2019, 29: 3296-3310.

[15]
SUN Y, ZHAO L, HUANG S, et al. Line matching based on planar homography for stereo aerial images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015, 104: 1-17.

[16]
LI Z, YUE J, FANG L. Adaptive regional multiple features for large-scale high-resolution remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-13.

[17]
SEDAGHAT A, MOHAMMADI N. Illumination-robust remote sensing image matching based on oriented self-similarity[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 153: 21-35.

[18]
XIONG X, JIN G, XU Q, et al. Self-similarity features for multimodal remote sensing image matching[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 12440-12454.

[19]
XIONG X, JIN G, XU Q, et al. Robust registration algorithm for optical and SAR images based on adjacent self-similarity feature[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-17.

[20]
ZHU B, YANG C, DAI J, et al. R2FD2: fast and robust matching of multimodal remote sensing images via repeatable feature detector and rotation-invariant feature descriptor[J]. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 1-15.

[21]
YE Y, SHAN J, BRUZZONE L, et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5): 2941-2958.

[22]
MA J, JIANG X, FAN A, et al. Image matching from handcrafted to deep features: a survey[J]. International Journal of Computer Vision, 2021, 129(1): 23-79.

[23]
ORON S, DEKEL T, XUE T, et al. Best-buddies similarity—Robust template matching using mutual nearest neighbors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 40(8): 1799-1813.

[24]
KUGLIN C, HINES D. The phase correlation image alignment method[C]// IEEE. Proceedings of the IEEE International Conference on Cybernetics and Society. New York: IEEE, 1975, 1975: 163-165.

[25]
SHECHTMAN E, IRANI M. Matching local self-similarities across images and videos[C]// IEEE. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2007: 1-8.

[26]
HEINRICH M P, JENKINSON M, BHUSHAN M, et al. MIND: modality independent neighbourhood descriptor for multi-modal deformable registration[J]. Medical image analysis, 2012, 16(7): 1423-1435.

DOI PMID

[27]
YE Y, SHEN L, HAO M, et al. Robust optical-to-SAR image matching based on shape properties[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(4): 564-568.

[28]
XIONG X, XU Q, JIN G, et al. Rank-based local self-similarity descriptor for optical-to-SAR image matching[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 17(10): 1742-1746.

[29]
YE Y, SHAN J, BRUZZONE L, et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5): 2941-2958.

[30]
YE Y, BRUZZONE L, SHAN J, et al. Fast and robust matching for multimodal remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11): 9059-9070.

[31]
LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60: 91-110.

[32]
DETONE D, MALISIEWICZ T, RABINOVICH A. Superpoint: self-supervised interest point detection and description[C]// IEEE. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018: 224-236.

[33]
SARLIN P E, DETONE D, MALISIEWICZ T, et al. Superglue: learning feature matching with graph neural networks[C]// /IEEE. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2020: 4938-4947.

[34]
DENG Y, MA J. ReDFeat: recoupling detection and description for multimodal feature learning[J]. IEEE Transactions on Image Processing, 2022, 32: 591-602.

[35]
LI J, HU Q, ZHANG Y. Multimodal image matching: a scale-invariant algorithm and an open dataset[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2023, 204: 77-88.

[36]
JI S, WEI S, LU M. Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 57(1): 574-586.

[37]
XIANG Y, TAO R, WANG F, et al. Automatic registration of optical and SAR images via improved phase congruency model[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13: 5847-5861.

Options
Outlines

/

〈 〉

[an error occurred while processing this directive]