[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]

Journal of Projectiles, Rockets, Missiles and Guidance >

2024 , Vol. 44 >Issue 3: 51 - 58

DOI: https://doi.org/10.15892/j.cnki.djzdxb.2024.03.007

Aerial Remote Sensing Image Aircraft Detection based on Feature Fusion of Multi-scale U-Net and Transformer

  • ZHANG Shanwen 1 ,
  • SHAO Yu 1 ,
  • LI Ping 1 ,
  • LING Weifeng 2
Expand
  • 1 School of Telecommunications and Intelligent Manufacturing, Sias University, Zhengzhou 451150, Henan, China
  • 2 School of Accounting, Xijing University, Xi’an 710123, Shaanxi, China

Received date: 2024-03-31

  Online published: 2024-12-28

Fold

Abstract

Aerial remote sensing image aircraft detection (ARSIAD) is an important and challenging research. Aiming at the problems of existing ARSIAD methods, such as blurred edges of detection aircrafts, low detection accuracy of small aircrafts and insufficient use of global context information of aerial remote sensing image (ARSI), an ARSIAD method based on feature fusion of multi-scale U-Net and Transformer (MSU-Trans) is proposed. In MSU-Trans, multi-scale convolution module inception is used to extract the classification features of various aircrafts in ARSI, Transformer is used to enhance the global semantic detection performance of the model, and feature fusion module is used to integrate high-level and low-level features to obtain complete edge and texture features of aircraft images, and improve the overall detection performance of MSU-Trans. It integrates the strong local feature extraction capability of multi-scale U-Net and strong global context dependency extraction capability of Transformer to improve the overall detection performance of MSU-Trans. Experiments on an ARSI set show that MSU-Trans has higher detection accuracy than U-Net, multi-scale U-Net and attention U-Nets, with the accuracy over 95%. This method provides some technical support for ARSIAD.

Key words： aerial remote sensing image aircraft detection; multi-scale U-Net; Transformer; multi-scale U-Net and Transformer

Cite this article

ZHANG Shanwen , SHAO Yu , LI Ping , LING Weifeng . Aerial Remote Sensing Image Aircraft Detection based on Feature Fusion of Multi-scale U-Net and Transformer[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2024 , 44(3) : 51 -58 . DOI: 10.15892/j.cnki.djzdxb.2024.03.007

[an error occurred while processing this directive]

References

Publishing order | Descend order by publishing year | Descend order by cited within
[1]
白小双. 军事运输目标的遥感图像目视判读研究[J]. 测绘科学技术, 2020, 8(4): 133-138.

BAI X S. Study on visual interpretation of remote sensing image of military transport[J]. Target Geomatics Science and Technology, 2020, 8(4): 133-138.

[2]
CHENG G, HAN J W. A survey on object detection in optical remote sensing images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016, 117: 11-28.

[3]
高琪琪. 遥感图像飞机目标检测与识别算法研究[D]. 南昌: 南昌航空大学, 2024.

GAO Q Q. Research on aircraft target detection and recognition algorithm in remote sensing image[D]. Nanchang: Nanchang Hangkong University, 2024.

[4]
GUO Z, SONG P, ZHANG Y, et al. Aircraft detection method based on deep convolutional neural network for remote sensing images[J]. Journal of Electronics & Information Technology, 2018, 40(11): 2684-2690.

[5]
孙岩, 吴熙曦, 雷震. 基于改进 U-Net 的高分辨率遥感图像目标提取[J]. 指挥与控制学报, 2023, 9(5): 596-605.

SUN Y, WU X X, LEI Z. Target extraction of high-resolution remote sensing images based on improved U-Net[J]. Journal of Command and Control, 2023, 9(5): 596-605.

[6]
范新南, 严炜, 史朋飞, 等. 多尺度深度特征融合网络的遥感图像目标检测[J]. 遥感学报, 2022, 26(11): 2292-2303.

FAN X N, YAN W, SHI P F, et al. Remote sensing image target detection based on a multi-scale deep feature fusion network[J]. National Renote Sensing Bulletin, 2022, 26(11): 2292-2303.

[7]
龙丽红, 朱宇霆, 闫敬文, 等. 新型语义分割D-UNet的建筑物提取[J]. 遥感学报, 2023, 27(11): 2593-2602.

LONG L H, ZHU Y T, YAN J W, et al. New building extraction method based on semantic segmentation[J]. National Remote Sensing Bulletin, 2023, 27(11): 2593-2602.

[8]
张婷, 张善文, 徐聪. 基于超像素与多尺度残差U-Net相结合的遥感图像飞机检测方法[J]. 宇航计测技术, 2022, 42(3): 86-92.

ZHANG T, ZHANG S W, XU C. Remote sensing image aircraft detection method by combining superpixel and multi-scale residual U-Net[J]. Journal of Astronautic Metrology and Measurement, 2022, 42(3): 86-92.

[9]
CUI M, LI K, CHEN J, et al. CM-UNet: a novel remote sensing image segmentation method based on improved U-Net[J]. IEEE Access, 2023, 11: 56994-57005.

[10]
李建, 杜建强, 朱彦陈, 等. 基于Transformer的目标检测算法综述[J]. 计算机工程与应用, 2023, 59(10): 48-64.

DOI

LI J, DU J Q, ZHU Y C, et al. Survey of transformer-based object detection algorithms[J]. Computer Engineering and Applications, 2023, 59(10): 48-64.

DOI

[11]
KHAN A, RAUF Z, SOHAIL A, et al. A survey of the vision transformers and their CNN-transformer based variants[J]. Artif Intell Rev, 2023, 56(3): 2917-2970.

[12]
戴洋毅, 何康, 瑚琦, 等. CNN-Transformer混合模型在计算机视觉领域的研究综述[J]. 建模与仿真, 2023, 12(4): 3657-3672.

DAI Y Y, HE K, HU Q, et al. Review of CNN-transformer hybrid model in computer vision[J]. Modeling and Simulation, 2023, 12(4): 3657-3672.

[13]
金传, 童常青. 融合CNN与Transformer结构的遥感图像分类方法[J]. 激光与光电子学进展, 2023, 60(20): 225-234.

JIN C, TONG C Q. Remote sensing image classification method based on fusion of CNN and transformer[J]. Laser & Optoelectronics Progress, 2023, 60(20): 225-234.

[14]
魏玉梅, 江涛, 白金燕. 基于Transformer的遥感图像目标检测算法研究[J]. 计算机科学与应用, 2024, 14(4): 105-114.

WEI Y H, JIANG T, BAI J Y. Research on remote sensing image target detection algorithm based on transformer[J]. Computer Science and Application, 2024, 14(4): 105-114.

[15]
YE H R, LIU S, JIN K, et al. CT-UNet: An improved neural network based on U-Net for building segmentation in remote sensing images[C]// IEEE. Proceedings of the 25th International Conference on Pattern Recognition. New York: IEEE, 2021: 166-172.

[16]
ZHANG Z A, WU C D, COLEMAN S, et al. Dense-inception U-Net for medical image segmentation[J]. Computer Methods Programs Biomed, 2020, 192: 105395.

[17]
禹文奇, 程塨, 王美君, 等. MAR20: 遥感图像军用飞机目标识别数据集[J]. 遥感学报, 2023, 27(12): 2688-2696.

YU W Q, CHENG G, WANG M J, et al. MAR20: a benchmark for military aircraft recognition in remote sensing images[J]. National Remote Sensing Bulletin, 2023, 27(12): 2688-2696.

Options
Outlines

/

〈 〉

[an error occurred while processing this directive]