[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]

基于多尺度U-Net与Transformer特征融合的航空遥感图像飞机检测方法

  • 张善文 1 ,
  • 邵彧 1 ,
  • 李萍 1 ,
  • 令伟锋 2
展开
  • 1 郑州西亚斯学院电信与智能制造学院,河南 郑州 451150
  • 2 西京学院会计学院,陕西 西安 710123
李萍(1979—),女,教授,硕士,研究方向:机器学习及其应用。

张善文(1965—),男,教授,博士,研究方向:机器学习及其应用。

收稿日期: 2024-03-31

  网络出版日期: 2024-12-28

基金资助

河南省科技厅科技攻关项目(242102210007)

河南省科技厅科技攻关项目(232102210097)

陕西省教育厅专项科研计划项目(20JK0413)

Aerial Remote Sensing Image Aircraft Detection based on Feature Fusion of Multi-scale U-Net and Transformer

  • ZHANG Shanwen 1 ,
  • SHAO Yu 1 ,
  • LI Ping 1 ,
  • LING Weifeng 2
Expand
  • 1 School of Telecommunications and Intelligent Manufacturing, Sias University, Zhengzhou 451150, Henan, China
  • 2 School of Accounting, Xijing University, Xi’an 710123, Shaanxi, China

Received date: 2024-03-31

  Online published: 2024-12-28

摘要

航空遥感图像(ARSI)飞机检测一直是一个重要且具有挑战性的课题。针对现有ARSI飞机检测方法(ARSIAD)检测目标的边缘模糊、小目标的检测精度低、没有充分利用ARSI的全局上下文信息等问题,提出一种基于多尺度U-Net与Transformer (MSU-Trans)特征融合的ARSIAD方法。通过多尺度卷积模块Inception提取ARSI中多样性目标的分类特征,通过Transformer增强模型的全局语义检测性能,通过特征融合模块整合高层和低层特征,得到航空目标图像完整的边缘和纹理特征。该模型结合多尺度U-Net较强的局部特征提取能力和Transformer较强的全局上下文依存关系提取能力,进而提高MSU-Trans的整体检测性能。在ARSI集上的试验表明,与U-Net、多尺度U-Net、注意力U-Nets相比,MSU-Trans具有较高的检测精度,精度超过95%,该方法为ARSIAD提供一定的技术支撑。

本文引用格式

张善文 , 邵彧 , 李萍 , 令伟锋 . 基于多尺度U-Net与Transformer特征融合的航空遥感图像飞机检测方法[J]. 弹箭与制导学报, 2024 , 44(3) : 51 -58 . DOI: 10.15892/j.cnki.djzdxb.2024.03.007

Abstract

Aerial remote sensing image aircraft detection (ARSIAD) is an important and challenging research. Aiming at the problems of existing ARSIAD methods, such as blurred edges of detection aircrafts, low detection accuracy of small aircrafts and insufficient use of global context information of aerial remote sensing image (ARSI), an ARSIAD method based on feature fusion of multi-scale U-Net and Transformer (MSU-Trans) is proposed. In MSU-Trans, multi-scale convolution module inception is used to extract the classification features of various aircrafts in ARSI, Transformer is used to enhance the global semantic detection performance of the model, and feature fusion module is used to integrate high-level and low-level features to obtain complete edge and texture features of aircraft images, and improve the overall detection performance of MSU-Trans. It integrates the strong local feature extraction capability of multi-scale U-Net and strong global context dependency extraction capability of Transformer to improve the overall detection performance of MSU-Trans. Experiments on an ARSI set show that MSU-Trans has higher detection accuracy than U-Net, multi-scale U-Net and attention U-Nets, with the accuracy over 95%. This method provides some technical support for ARSIAD.

[an error occurred while processing this directive]
[1]
白小双. 军事运输目标的遥感图像目视判读研究[J]. 测绘科学技术, 2020, 8(4): 133-138.

BAI X S. Study on visual interpretation of remote sensing image of military transport[J]. Target Geomatics Science and Technology, 2020, 8(4): 133-138.

[2]
CHENG G, HAN J W. A survey on object detection in optical remote sensing images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016, 117: 11-28.

[3]
高琪琪. 遥感图像飞机目标检测与识别算法研究[D]. 南昌: 南昌航空大学, 2024.

GAO Q Q. Research on aircraft target detection and recognition algorithm in remote sensing image[D]. Nanchang: Nanchang Hangkong University, 2024.

[4]
GUO Z, SONG P, ZHANG Y, et al. Aircraft detection method based on deep convolutional neural network for remote sensing images[J]. Journal of Electronics & Information Technology, 2018, 40(11): 2684-2690.

[5]
孙岩, 吴熙曦, 雷震. 基于改进 U-Net 的高分辨率遥感图像目标提取[J]. 指挥与控制学报, 2023, 9(5): 596-605.

SUN Y, WU X X, LEI Z. Target extraction of high-resolution remote sensing images based on improved U-Net[J]. Journal of Command and Control, 2023, 9(5): 596-605.

[6]
范新南, 严炜, 史朋飞, 等. 多尺度深度特征融合网络的遥感图像目标检测[J]. 遥感学报, 2022, 26(11): 2292-2303.

FAN X N, YAN W, SHI P F, et al. Remote sensing image target detection based on a multi-scale deep feature fusion network[J]. National Renote Sensing Bulletin, 2022, 26(11): 2292-2303.

[7]
龙丽红, 朱宇霆, 闫敬文, 等. 新型语义分割D-UNet的建筑物提取[J]. 遥感学报, 2023, 27(11): 2593-2602.

LONG L H, ZHU Y T, YAN J W, et al. New building extraction method based on semantic segmentation[J]. National Remote Sensing Bulletin, 2023, 27(11): 2593-2602.

[8]
张婷, 张善文, 徐聪. 基于超像素与多尺度残差U-Net相结合的遥感图像飞机检测方法[J]. 宇航计测技术, 2022, 42(3): 86-92.

ZHANG T, ZHANG S W, XU C. Remote sensing image aircraft detection method by combining superpixel and multi-scale residual U-Net[J]. Journal of Astronautic Metrology and Measurement, 2022, 42(3): 86-92.

[9]
CUI M, LI K, CHEN J, et al. CM-UNet: a novel remote sensing image segmentation method based on improved U-Net[J]. IEEE Access, 2023, 11: 56994-57005.

[10]
李建, 杜建强, 朱彦陈, 等. 基于Transformer的目标检测算法综述[J]. 计算机工程与应用, 2023, 59(10): 48-64.

DOI

LI J, DU J Q, ZHU Y C, et al. Survey of transformer-based object detection algorithms[J]. Computer Engineering and Applications, 2023, 59(10): 48-64.

DOI

[11]
KHAN A, RAUF Z, SOHAIL A, et al. A survey of the vision transformers and their CNN-transformer based variants[J]. Artif Intell Rev, 2023, 56(3): 2917-2970.

[12]
戴洋毅, 何康, 瑚琦, 等. CNN-Transformer混合模型在计算机视觉领域的研究综述[J]. 建模与仿真, 2023, 12(4): 3657-3672.

DAI Y Y, HE K, HU Q, et al. Review of CNN-transformer hybrid model in computer vision[J]. Modeling and Simulation, 2023, 12(4): 3657-3672.

[13]
金传, 童常青. 融合CNN与Transformer结构的遥感图像分类方法[J]. 激光与光电子学进展, 2023, 60(20): 225-234.

JIN C, TONG C Q. Remote sensing image classification method based on fusion of CNN and transformer[J]. Laser & Optoelectronics Progress, 2023, 60(20): 225-234.

[14]
魏玉梅, 江涛, 白金燕. 基于Transformer的遥感图像目标检测算法研究[J]. 计算机科学与应用, 2024, 14(4): 105-114.

WEI Y H, JIANG T, BAI J Y. Research on remote sensing image target detection algorithm based on transformer[J]. Computer Science and Application, 2024, 14(4): 105-114.

[15]
YE H R, LIU S, JIN K, et al. CT-UNet: An improved neural network based on U-Net for building segmentation in remote sensing images[C]// IEEE. Proceedings of the 25th International Conference on Pattern Recognition. New York: IEEE, 2021: 166-172.

[16]
ZHANG Z A, WU C D, COLEMAN S, et al. Dense-inception U-Net for medical image segmentation[J]. Computer Methods Programs Biomed, 2020, 192: 105395.

[17]
禹文奇, 程塨, 王美君, 等. MAR20: 遥感图像军用飞机目标识别数据集[J]. 遥感学报, 2023, 27(12): 2688-2696.

YU W Q, CHENG G, WANG M J, et al. MAR20: a benchmark for military aircraft recognition in remote sensing images[J]. National Remote Sensing Bulletin, 2023, 27(12): 2688-2696.

文章导航

/

[an error occurred while processing this directive]