DTWN: Q-learning-based Transmit Power Control for Digital Twin WiFi Networks
DOI:
https://doi.org/10.4108/eetinis.v9i31.1059Keywords:
Digital Twin, Reinforcement Learning, Transmit Power Control, WiFi, InterferenceAbstract
Interference has always been the main threat to the performance of traditional WiFi networks and next-generation moving forward. The problem can be solved with transmit power control(TPC). However, to accomplish this, an information-gathering process is required. But this brings overhead concerns that decrease the throughput. Moreover, mitigation of interference relies on the selection of transmit powers. In other words, the control scheme should select the optimum configuration relative to other possibilities based on the total interference, and this requires an extensive search. Furthermore, bidirectional communication in real-time needs to exist to control the transmit powers based on the current situation. Based on these challenges, we propose a complete solution with Digital Twin WiFi Networks (DTWN). Contrarily to other studies, with the agent programs installed on the APs in the physical layer of this architecture, we enable information-gathering without causing overhead to the wireless medium. Additionally, we employ Q-learning-based TPC in the Brain Layer to find the best configuration given the current situation. Consequently, we accomplish real-time monitoring and management thanks to the digital twin. Then, we evaluate the performance of the proposed approach through total interference and throughput metrics over the increasing number of users. Furthermore, we show that the proposed DTWN model outperforms existing schemes.
Downloads
References
Zhong Z, Kulkarni P, Cao F, Fan Z, Armour S. Issues and challenges in dense WiFi networks. In: 2015 International Wireless Communications and Mobile Computing Conference (IWCMC) [Internet]. IEEE; doi: 10.1109/IWCMC.2015.7289210 DOI: https://doi.org/10.1109/IWCMC.2015.7289210
Khorov E, Kiryanov A, Lyakhov A, Bianchi G. A Tutorial on IEEE 802.11ax High Efficiency WLANs. IEEE Communications Surveys & Tutorials [Internet]. 2018;21(1):197–216. doi: 10.1109/COMST.2018.2871099 DOI: https://doi.org/10.1109/COMST.2018.2871099
Deng C, Fang X, Han X, Wang X, Yan L, He R, et al. IEEE 802.11be Wi-Fi 7: New Challenges and Opportunities. IEEE Communications Surveys & Tutorials [Internet]. 2020; 22(4):2136–66. doi: 10.1109/COMST.2020.3012715 DOI: https://doi.org/10.1109/COMST.2020.3012715
Aio K. Coordinated Spatial Reuse Performance Analysis [Internet]. 2019. Available from: https://mentor.ieee.org/802.11/dcn/19/11-19-1534-01-00be-coordinated-spatial-reuse-performance-analysis.pptx
Wang JJ-M, Ku C-T, Bajko G, Anwyl GA, Feng S, Liu J, et al. MULTI-ACCESS POINT COORDINATED SPATIAL REUSE PROTOCOL AND ALGORITHM [Internet]. European Patent. 3 809 735 A1, 2021. Available from: https://data.epo.org/publication-server/document?iDocId=6519834
Ak E, Canberk B. FSC: Two-Scale AI-Driven Fair Sensitivity Control for 802.11ax Networks. In: GLOBECOM 2020 - 2020 IEEE Global Communications Conference [Internet]. 2020. doi: 10.1109/GLOBECOM42002.2020.9322153 DOI: https://doi.org/10.1109/GLOBECOM42002.2020.9322153
He C, Hu Y, Chen Y, Fan X, Li H, Zeng B. MUcast: Linear Uncoded Multiuser Video Streaming With Channel Assignment and Power Allocation Optimization. IEEE Transactions on Circuits and Systems for Video Technology [Internet]. 2019;30(4):1136–46. doi: 10.1109/TCSVT.2019.2897649 DOI: https://doi.org/10.1109/TCSVT.2019.2897649
Zhang Y, Jiang C, Han Z, Yu S, Yuan J. Interference-Aware Coordinated Power Allocation in Autonomous Wi-Fi Environment. IEEE Access [Internet]. 2016;4:3489–500. doi: 10.1109/ACCESS.2016.2585581 DOI: https://doi.org/10.1109/ACCESS.2016.2585581
Zhao G, Li Y, Xu C, Han Z, Xing Y, Yu S. Joint Power Control and Channel Allocation for Interference Mitigation Based on Reinforcement Learning. IEEE Access [Internet]. 2019;7:177254–65. doi: 10.1109/ACCESS.2019.2937438 DOI: https://doi.org/10.1109/ACCESS.2019.2937438
Jones W, Eddie Wilson R, Doufexi A, Sooriyabandara M. A Pragmatic Approach to Clear Channel Assessment Threshold Adaptation and Transmission Power Control for Performance Gain in CSMA/CA WLANs. IEEE Transactions on Mobile Computing [Internet]. 2019;19(2):262–75. doi: 10.1109/TMC.2019.2892713 DOI: https://doi.org/10.1109/TMC.2019.2892713
Zhou C, Yang H, Duan X, Lopez D, Pastor A, Wu Q, et al. Digital Twin Network: Concepts and Reference Architecture [Internet]. IETF Datatracker. 2022 [cited 2022 Apr 24]. Available from: https://datatracker.ietf.org/doc/draft-irtf-nmrg-network-digital-twin-arch/00/
Wu Y, Zhang K, Zhang Y. Digital Twin Networks: A Survey. IEEE Internet of Things Journal [Internet]. 2021;8(18):13789–804. doi: 10.1109/JIOT.2021.3079510 DOI: https://doi.org/10.1109/JIOT.2021.3079510
Barricelli BR, Casiraghi E, Fogli D. A Survey on Digital Twin: Definitions, Characteristics, Applications, and Design Implications. IEEE Access [Internet]. 167653 - 167671;7. doi: 10.1109/ACCESS.2019.2953499 DOI: https://doi.org/10.1109/ACCESS.2019.2953499
Microsoft. DTDL models - Azure Digital Twins [Internet]. Microsoft Docs. 2022 [cited 2022 Apr 24]. Available from: https://docs.microsoft.com/en-us/azure/digital-twins/concepts-models
ns-3 | a discrete-event network simulator for internet systems [Internet]. [cited 2022 May 6]. Available from: https://www.nsnam.org/
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 EAI Endorsed Transactions on Industrial Networks and Intelligent Systems
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 3.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.
