小波图像融合与目标识别的嵌入式系统实现方法

  • 王磊 ,
  • 孟志敏 ,
  • 刘帅 ,
  • 郝永平 ,
  • 徐九龙
展开
  • 沈阳理工大学兵器科学与技术研究中心,沈阳 110159

王磊(1978—),男,山东莱州人,副教授,博士,研究方向:导航,制导与控制应用技术,红外成像系统,视觉辅助导航等.

收稿日期: 2021-01-22

  网络出版日期: 2025-05-30

基金资助

沈阳市中青年科技创新人才支持计划项目(RC200537)

The Realization of Wavelet Image Fusion and Target Recognition Methods for Embedded System

  • WANG Lei ,
  • MENG Zhimin ,
  • LIU Shuai ,
  • HAO Yongping ,
  • XU Jiulong
Expand
  • Weapon Science and Technology Research Center of Shenyang Ligong University, Shenyang 110159, China

Received date: 2021-01-22

  Online published: 2025-05-30

摘要

针对坦克目标,采用形状上下文特征级的异源图像配准以及小波变换图像融合方法。在此基础上,通过提取融合图像HOG特征并生成SVM分类器模型实现坦克目标识别。构建了嵌入式的红外与可见光图像融合系统,定制了ARM+FPGA样机。采用图像行缓存、窗口缓存等方法对图像进行处理,实现加速遍历图像像素卷积运算。定制了融合算法的IP核,通过软硬件协同设计进行资源优化与合理配置。对复杂背景下的静止和运动坦克目标在PC与嵌入式平台进行了融合和识别实验,结果表明:系统平均耗时为51ms,帧率约为20Hz,满足目标检测识别的实时性要求。

本文引用格式

王磊 , 孟志敏 , 刘帅 , 郝永平 , 徐九龙 . 小波图像融合与目标识别的嵌入式系统实现方法[J]. 弹箭与制导学报, 2021 , 41(5) : 12 -18 . DOI: 10.15892/j.cnki.djzdxb.2021.05.003

Abstract

According to tank target, the image registration based on shape context feature leveland wavelet transform image fusion methodis adopted. Subsequently, the target recognition process for tank is developed by extracting HOG features of the fusion image and generatingSVM classifier model. An embedded system infrared and visible light image fusion system is constructed, and an ARM/FPGA prototype iscustomized. The improved methods, such as image line buffering, window buffering methods, are used to process the image to acceleratethe convolution operation of traversing image pixels. The IP core of the fusion algorithm is also customized, and the performance of resourceis optimized and reconfigured, which is based on the software and hardware cooperative design process. Depending on fusion experimentsfor stationary and moving tank targets in PC or embedded system, comparisons results show that the average processing time of single imageis about 51 ms, the frame rate is about 20 Hz, which could meet the demands of real running time.

参考文献

[1]
刘智嘉 , 贾鹏 , 夏寅辉 , 等 . 基于红外与可见光图像融合技术发展与性能评价 [J]. 激光与红外 , 2019,49 (5): 633 - 640 .
[2]
郭雷 , 李晖晖 , 鲍永生 . 图像融合 [M]. 北京 : 电子工业出版社 , 2008,2 . 3 .
[3]
LI W , DONG M L , LU N G , et al . Multi-sensor face registration based on global and local structures [J]. Applied Sciences , 2019,9 (21): 4623 - 4639 .
[4]
叶银芳 , 聂建英 . 基于拉普拉斯金字塔变换的红外/被动毫米波图像融合 [J]. 弹箭与制导学报 , 2014,34 (2): 165 - 167 .
[5]
LI Y Y , WANG C Y , YAO C . Multi-sensors image fusion via NSCT and GoogLeNet [J]. Transactions of Nanjing University of Aeronautics and Astronautics , 2020,37 (1): 88 - 94 .
[6]
GUO L Q , CAO X , LIU L . Dual-tree biquaternion wavelet transform and its application to color image fusion [J]. Signal Processing , 2020,171 . 5 - 13 .
[7]
CADAMBIS , MAJUMDAR A , BECCHI M , et al . A programmable parallel accelerator for learning and classification [C]// PACT. Proceedings of the 2010 19th International Conference on Parallel Architectures & Compilation Techniques. New York: IEEE , 2010:273 - 284 .
[8]
DHAMECHA TI , NOORE A , SINGH R , et al . Between-sub-class piece-wise linear solutions in large scale kernel SVM learning [J]. Pattern Recognition , 2019,95 . 173 - 190 .
[9]
王园园 , 张娜 , 韩美林 . 基于Canny 算子边缘检测的小波变换多聚焦图像融合方法 [J]. 电子测量技术 , 2019,42 (17): 148 - 151 .
[10]
刘明君 , 董增寿 . 基于多特征的红外与可见光图像融合 [J]. 激光杂志 , 2019,40 (10): 81 - 85 .
[11]
嵇达龙 , 张尤赛 , 王亚军 . 基于ZYNQ 的行人检测系统的设计与实现 [J]. 计算机工程与设计 , 2020,41 (1): 238 - 245 .
文章导航

/