Q-Learning Based Co-Operative Spectrum Mobility in Cognitive Radio Networks
Document Type
Conference Article
Publication Title
Proceedings - Conference on Local Computer Networks, LCN
Abstract
In cognitive radio systems, fast and efficient spectrum selection is a vital task to minimize the overhead of spectrum scanning, and hence to improve the response time of the system. So, the choice of channel sensing sequence plays an important role for better performance of the system. This paper proposes a co-operative Q-learning based spectrum sensing technique for the secondary users of an ad hoc network to access the primary channels. By the proposed technique, every secondary user (SU) maintains a dynamic priority list of channels based on Q-learning from its own action-observation history, as well as from spatial channel information exchange among its local neighbors. Whenever there is a demand an SU scans the spectrum according to the order in the priority list until there is a success. Simulation studies show that with significantly less computing and scanning overhead, our proposed Q-learning based approach improves the response time and call block / drop rate to offer better performance compared to other contemporary reinforcement learning based approaches.
First Page
502
Last Page
505
DOI
10.1109/LCN.2017.80
Publication Date
11-14-2017
Recommended Citation
Das, Avirup; Ghosh, Sasthi C.; Das, Nabanita; and Barman, Abhirup Das, "Q-Learning Based Co-Operative Spectrum Mobility in Cognitive Radio Networks" (2017). Conference Articles. 188.
https://digitalcommons.isical.ac.in/conf-articles/188