Abstract
At present, the single strategy of aircraft is difficult to penetration success and the decision making mainly depends on the pilot. In this paper, an intelligent aircraft defense decision algorithm based on rainbow algorithm is proposed by combining the two kinds of decision making of aircraft maneuver and decoy projectile. Firstly, motion model and interaction model are established. Then, with line-of-sight and line-of-sight Angle as states, maneuvering and decoy deployment as actions, the reward function considering fuel loss and decoy consumption is designed to establish reinforcement learning environment. The rainbow algorithm in reinforcement learning (RL) is used to train the agent. Considering the requirement of training speed and stability, \(\varepsilon - greedy\) strategy is used to replace the noise network in Rainbow algorithm to speed up convergence and improve stability, and the optimal aircraft intelligent defense decision method is obtained. Finally, the simulation results show that this method can make the aircraft maneuver and deploy decoys autonomously, reduce the dependence on the pilot, and improve the survivability of the aircraft.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Li, F., et al.: Simulation research on jamming effect of helicopter airborne infrared decoy. In: Symposium on Novel Photoelectronic Detection Technology and Application, Kunming, pp. 1216958–1216971. SPIE (2022)
Vermeulen, A., Maes, G.: Missile avoidance manoeuvres with simultaneous decoy deployment. In: Proceedings of the AIAA Guidance, Navigation, and Control Conference, Toronto, Canada, pp. 10–13 (2009)
Huang, H., et al.: Defense strategy of aircraft confronted with IR guided missile. Math. Probl. Eng. 2017(1), 1–9 (2017)
Huang, H., et al.: Study of IR defense strategy based on IR guided missile. In: Proceedings of the International Conference on Information Technology and Electrical Engineering 2018, Xiamen, pp. 1–5. Association for Computing Machinery (2018)
Sun, W., Yao, M.J.: Research on jamming strategy of surface-type infrared decoy against by infrared-guided simulation. In: 20th International Conference on Control, Automation and Systems, Korea (South), pp. 845–849. IEEE (2020)
Fan, X., Dong, L., Jie, Z.: Research on helicopter infrared decoy dropping strategy training based on GA-BP algorithm. Electric Light Control 2022(1), 1–6 (2022)
Cao, Y., et al.: Autonomous maneuver decision of UCAV air combat based on double deep Q network algorithm and stochastic game theory. Int. J. Aerospace Eng. 2023(1), 1–20 (2023)
He, Y., et al.: Computation offloading and resource allocation based on DT-MEC-assisted federated learning framework. IEEE Trans. Cogn. Commun. Network. 6(9), 1707–1720 (2023)
Chen, G., et al.: Research on algorithms of computing offloading and resource allocation based on DQN. J. Phys. Conf. Ser. 2021(3), 47–54 (2021)
Hessel, M., et al.: Rainbow: combining improvements in deep reinforcement learning. In: AAAI 2018, pp. 1–14. arXiv, New Orleans (2017)
Lu, L., et al.: GA-LSTM speed prediction-based DDQN energy management for extended-range vehicles. Energy AI 17(1), 100367–100385 (2024)
Wang, J., et al.: An intelligent routing approach for SDN based on improved dueling DQN algorithm. In: 2023 9th International Conference on Computer and Communications (ICCC) , Chendu, pp.1–7. IEEE (2023)
Schaul, T., et al.: Prioritized experience replay. Comput. Sci. 2015(1), 1–21 (2015)
Efroni, Y., et al.: Multiple-step greedy policies in online and approximate reinforcement learning. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, Red Hook, pp. 5244–5253. Curran Associates Inc (2018)
Han, S., et al.: NROWAN-DQN: a stable noisy network with noise reduction and online weight adjustment for exploration. Expert Syst. Appl. 203(1), 1–14 (2022)
Jiang, X., and Y. J.: HD3: distributed dueling DQN with discrete-continuous hybrid action spaces for live video streaming. In: Proceedings of the 27th ACM International Conference on Multimedia, New York, pp. 2632–2636. ACM (2019)
Hu, Y., et al.: Incremental learning framework for autonomous robots based on q-learning and the adaptive kernel linear model. IEEE Trans. Cogn. Dev. Syst. 1(14), 64–74 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, Z., Bai, H., Xue, S., Jin, K. (2025). Intelligent Defense Decision of Aircraft Based on Rainbow Algorithm. In: Lan, X., Mei, X., Jiang, C., Zhao, F., Tian, Z. (eds) Intelligent Robotics and Applications. ICIRA 2024. Lecture Notes in Computer Science(), vol 15207. Springer, Singapore. https://doi.org/10.1007/978-981-96-0780-8_4
Download citation
DOI: https://doi.org/10.1007/978-981-96-0780-8_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-96-0779-2
Online ISBN: 978-981-96-0780-8
eBook Packages: Computer ScienceComputer Science (R0)