[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]

多特征融合的无人机通信领域实体识别方法

  • 彭珍妮 1 ,
  • 樊瑞 , 2, * ,
  • 杨歆童 2 ,
  • 雷磊 3
展开
  • 1 南京航空航天大学 公共实验教学部, 江苏 南京 211106
  • 2 南京航空航天大学 电子信息工程学院, 江苏 南京 211106
  • 3 南京航空航天大学 航天学院, 江苏 南京 211106

收稿日期: 2025-12-23

  网络出版日期: 2026-06-29

基金资助

国家自然科学基金面上项目(62371232)

中国高校产学研创新基金(2024XL085)

A Chinese Named Entity Recognition Method Based on Multi-feature Fusion for UAV Communication Domain

  • PENG Zhenni 1 ,
  • FAN Rui , 2, * ,
  • YANG Xintong 2 ,
  • LEI Lei 3
Expand
  • 1 Fundamental Experimental Teaching Department, Nanjing 211106,Jiangsu, China
  • 2 College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106,Jiangsu, China
  • 3 College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106,Jiangsu, China

Received date: 2025-12-23

  Online published: 2026-06-29

摘要

针对无人机通信领域中文命名实体识别样本不足、语义易混淆和实体边界模糊等问题,提出了一种多特征融合的中文命名实体识别模型RCPAC(roberta-wwm-ext-large-CNN-PositionAwareAttention-BiLSTM-CRF)。首先,使用无人机通信领域词典动态融入到 roberta-wwm-ext-large模型获得融合无人机领域词信息的全局特征,并在卷积神经网络(Convolutional Neural Network,CNN)层引入挤压激励网络(SENet,SqueezeandExcitation Networks)注意力机制,提取关键特征,在双向位置感知注意力机制中设计区域划分的前向、后向两个注意力模块,以捕捉实体边界特征;然后将融合词信息的全局特征、CNN层提取的多尺度局部特征和双向位置感知注意力机制获取的位置信息与实体特征进行动态权重融合;接着通过双向长短期记忆网络(Bidirectional Long Short-Term Memory,BiLSTM)层建立长序列依赖并过滤掉冗余特征;最后通过条件随机场(Conditional Random Fields,CRF)解码层输出最佳标注序列。通过对比实验和消融实验证明了该模型的有效性和优越性。在自主构建的小规模无人机通信领域数据集上,与其他模型相比,RCPAC模型的F1值提升了1.01%~9.95%。此外,在CCKS2021中文地址要素解析和MSRA数据集上,模型的F1值分别达到92.15%和95.56%,证明了该模型的泛化性和有效性。

本文引用格式

彭珍妮 , 樊瑞 , 杨歆童 , 雷磊 . 多特征融合的无人机通信领域实体识别方法[J]. 弹箭与制导学报, 2026 , 46(3) : 225 -236 . DOI: 10.15892/j.cnki.djzdxb.2026.03.001

Abstract

Aiming at the problems of insufficient samples, semantic ambiguity and blurred entity boundaries in Chinese named entity recognition for UAV communication, this paper proposes a multifeature fusion Chinese named entity recognition model RCPAC (roberta-wwm-ext-large-CNN-PositionAwareAttention-BiLSTM-CRF). Firstly, the UAV communication domain dictionary is dynamically integrated into the robertawwmextlarge model to obtain global features fused with domainspecific lexical information. A SqueezeandExcitation Networks (SENet) attention mechanism is introduced into the Convolutional Neural Network (CNN) layer to extraction key feature. Within the bidirectional positionaware attention mechanism, two regiondivided forward and backward attention modules are designed to capture entity boundary features. Then, dynamic weightbased fusion is conducted on the global features with lexical information, multiscale local features extracted by the CNN layer, as well as position information and entity features obtained from the bidirectional positionaware attention mechanism. Next, the Bidirectional Long ShortTerm Memory (BiLSTM) layer is used to model longrange sequence dependencies and filter redundant features. Finally, the Conditional Random Fields (CRF) decoding layer outputs the optimal label sequence. Comparative experiments and ablation experiments verify the effectiveness and superiority of the proposed model. On the selfconstructed smallscale UAV communication dataset, the F1score of the RCPAC model is improved by 1.01%-9.95% compared with other baseline models. In addition, the model achieves F1scores of 92.15% and 95.56% on the CCKS2021 Chinese address element parsing dataset and the MSRA dataset respectively, demonstrating its generalization ability and effectiveness.

[an error occurred while processing this directive]
[1]
HUANG K X, ALTOSAAR J, RANGANATH R. Clinical BERT: modeling clinical notes and predicting hospital readmission[EB/OL].(2020-11-19)[2025-12-23]. https://arxiv.org/abs/1904.05342.

[2]
ČEOVIĆ H, KURDIJA A S, DELAČ G, et al. Named entity recognition for addresses:an empirical study[J]. IEEE Access, 2022, 10:42108-42120.

[3]
郭瑞, 张欢欢. 基于RoBERTa和对抗训练的中文医疗命名实体识别[J]. 华东理工大学学报(自然科学版), 2023, 49(1):144-152.

GUO R, ZHANG H H. Chinese medical named entity recognition based on RoBERTa and adversarial training[J]. Journal of East China University of Science and Technology(Natural Science Edition), 2023, 49(1):144-152.

[4]
陈明, 刘蓉, 张晔. 基于多重注意力机制的中文医疗实体识别[J]. 计算机工程, 2023, 49(6):314-320.

CHEN M, LIU R, ZHANG Y. Chinese medical entity recognition based on multiple attention mechanism[J]. Computer Engineering, 2023, 49(6):314-320.

[5]
廖列法, 谢树松. 基于注意力机制特征融合的中文命名实体识别[J]. 计算机工程, 2023, 49(4):256-262.

LIAO L F, XIE S S. Chinese named entity recognition based on attention mechanism feature fusion[J]. Computer Engineering, 2023, 49(4):256-262.

[6]
TANG Z R, LIU Y. Chinese named entity recognition based on lexicon fusion and dependency relation[J]. Computer Engineering, 2024, 50(10):145-153.

[7]
YANG L H, WANG J, QIU W R. RoBERTa-based multi-feature integrated BiLSTM and CNN model for ceramic review analysis[J]. IEEE Access, 2025, 13:103668-103681.

[8]
LIU X C, WANG Z Q, WANG F B. Research on Chinese semantic relation extraction in marine engine rooms based on multi-feature fusion[J]. IEEE Access, 2024, 12:192013-192027.

[9]
蒋成伟. 无人机信息领域智能问答系统的研究与实现[D]. 北京: 北京邮电大学, 2018.

JIANG C W. Research and implementation of intelligent question answering system in UAV information[D]. Beijing: Beijing University of Posts and Telecommunications, 2018.

[10]
LUO S C, YAO Y X, ZHAO H H, et al. A language model-based fine-grained address resolution framework in UAV delivery system[J]. IEEE Journal of Selected Topics in Signal Processing, 2024, 18(3):529-539.

[11]
Cu Y, Che W, Liu T, et al. B.Qin and Z.Yang.Pre-Training With Whole Word Masking for Chinese BERT[J]. IEEE/ACM Transactions on Audio,Speech,and Language Processing, 2021, 29:3504-3514.

[12]
CHITTY-VENKATA K T, EMANI M, VISHWANATH V, et al. Neural architecture search for transformers:a survey[J]. IEEE Access, 2022, 10:108374-108412.

[13]
SUN T T, ZHANG C H, JI Y, et al. MSnet:multi-head self-attention network for distantly supervised relation extraction[J]. IEEE Access, 2019, 7:54472-54482.

[14]
Wang X, Zhang M, Wu S, et al. Bridging Low-Level and High-Level Visions:A Hybrid Transformer-CNN Multitask Framework for Hyperspectral Image Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2025, 63:1-15.

[15]
Tang Y, Huang W, Chen C, et al. CT-DCENet:Deep EEG Denoising via CNN-Transformer-Based Dual-Stage Collaborative Ensemble Learning[J]. IEEE Journal of Biomedical and Health Informatics, 2025,29,(6):4095-4108.

[16]
CHO K, VAN MERRIËNBOER B, GULCEHRE C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha,QAT:ACL,2014:1724-1734.

[17]
Jin L J, Zhang Y F, Yuan Z K, et al. Chinese Named Entity Recognition of Transformer Bushing Faults Based on ALBERT-BiLSTM-CRF[J]. IEEE Transactions on Industry Applications, 2025, 61(2):2115-2123.

[18]
贾玉红. 无人机系统概论[M]. 北京: 北京航空航天大学出版社, 2020.

JIA Y H. Introduction to unmanned aerial vehicle systems[M]. Beijing: Beijing University of Aeronautics and Astronautics Press, 2020.

[19]
雷磊, 宋晓勤. 无人机集群技术:智能组网与协同[M]. 北京: 高等教育出版社, 2023.

LEI L, SONG X Q. Drone swarm technology:intelligent networking and collaboration[M]. Beijing: Higher Education Press, 2023.

[20]
YANG G, XU H Z. A residual BiLSTM model for named entity recognition[J]. IEEE Access, 2020, 8:227710-227718.

[21]
MA R T, PENG M L, ZHANG Q, et al. Simplify the usage of lexicon in Chinese NER[C/OL]// Proceedings of the Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.[S.l.]:ACL,2020:5951-5960.https://aclanthology.org/2020.acl-main.528/.

[22]
XIAO Y L, JI Z C, LI J A, et al. DualFLAT:dual flat-lattice transformer for domain-specific Chinese named entity recognition[J]. Information Processing & Management, 2025, 62(1):103902.

[23]
Lai. Lattice-BERT:leveraging multi-granularity representations in Chinese pre-trained language models[C/OL]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.[S.l.]:ACL,2021:1716-1731.https://aclanthology.org/2021.naacl-main.137/.

[24]
WANG C Y, ZHAO S, YAN T W, et al. Hierarchical label-enhanced contrastive learning for Chinese NER[J]. IEEE Transactions on Neural Networks and Learning Systems, 2025, 36(6):10504-10514.

[25]
WEI L, LAI Y X, HAN X P, et al. PLTE:position and label aware transformer encoder for Chinese NER[C]// Proceedings of the 29th International Conference on Computational Linguistics.Barcelona, ESP:ACL,2022:4365-4376.

[26]
YU J Y, LU Y L, ZHANG Y H, et al. A unified model for Chinese cyber threat intelligence flat entity and nested entity recognition[J]. Electronics, 2024, 13(21):4329.

[27]
SU J L, AHMED M, LU Y, et al. RoFormer:enhanced transformer with rotary position embedding[J]. Neurocomputing, 2024, 568:127063.

[28]
XU Y P, YING M T, FANG K Y, et al. Chinese named entity recognition based on adaptive lexical weights[J]. Computer Speech & Language, 2025, 90:101735.

[29]
YANG L Y, XING S L, MAO G J. MISS:multiple information span scoring for Chinese named entity recognition[J]. Computer Speech & Language, 2025, 92:101783.

[30]
HOU S X, QIAN Y R, CHEN J Y, et al. HiNER:hierarchical feature fusion for Chinese named entity recognition[J]. Neurocomputing, 2025, 611:128667.

[31]
ZARATIANA U, TOMEH N, HOLAT P, et al. GLiNER:generalist model for named entity recognition using bidirectional transformer[C]//Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.Mexico City, MEX:ACL,2024:5364-5376.

文章导航

/

[an error occurred while processing this directive]