Skip to Content
You are currently on the new version of our website. Access the old version .
ComputersComputers
  • Article
  • Open Access

11 March 2022

19 Pages

Deep Q-Learning Based Reinforcement Learning Approach for Network Intrusion Detection

,
and
1
UNSW Institute for Cyber Security, University of New South Wales, Canberra 2612, Australia
2
Computer Engineering Department, Imam Reza International University, Mashhad 553-91735, Iran
3
Cybersecurity Laboratory, School of Information Technology and Electrical Engineering, Massey University, Auckland 0632, New Zealand
*
Author to whom correspondence should be addressed.

Abstract

The rise of the new generation of cyber threats demands more sophisticated and intelligent cyber defense solutions equipped with autonomous agents capable of learning to make decisions without the knowledge of human experts. Several reinforcement learning methods (e.g., Markov) for automated network intrusion tasks have been proposed in recent years. In this paper, we introduce a new generation of the network intrusion detection method, which combines a Q-learning based reinforcement learning with a deep feed forward neural network method for network intrusion detection. Our proposed Deep Q-Learning (DQL) model provides an ongoing auto-learning capability for a network environment that can detect different types of network intrusions using an automated trial-error approach and continuously enhance its detection capabilities. We provide the details of fine-tuning different hyperparameters involved in the DQL model for more effective self-learning. According to our extensive experimental results based on the NSL-KDD dataset, we confirm that the lower discount factor, which is set as 0.001 under 250 episodes of training, yields the best performance results. Our experimental results also show that our proposed DQL is highly effective in detecting different intrusion classes and outperforms other similar machine learning approaches.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.