ABSTRACT
Cellular networks dynamically adjust the transmission parameters for a wireless link in response to its time-varying channel state. This is known as link adaptation, where the typical goal is to maximize the link throughput. State-of-the-art outer loop link adaptation (OLLA) selects the optimal transmission parameters based on an approximate, offline, model of the wireless link. Further, OLLA refines the offline model by dynamically compensating any deviations from the observed link performance. However, in practice, OLLA suffers from slow convergence and a sub-optimal link throughput. In this paper, we propose a link adaptation approach that overcomes the shortcomings of OLLA through a novel learning scheme. Our approach relies on contextual multi-armed bandits (MAB), where the context vector is composed of the instantaneous wireless channel state along with side information about the link. For a given context, our approach learns the success probability for each of the available transmission parameters, which is then exploited to select the throughput-maximizing parameters. Through numerical experiments, we show that our approach converges faster than OLLA and achieves a higher steady-state link throughput. For frequent and infrequent channel reports respectively, our scheme outperforms OLLA by 15% and 25% in terms of the steady-state link throughput.
Supplemental Material
- 3rd Generation Partnership Project. 2016. Evolved Universal Terrestrial Radio Access (E-UTRA); Physical layer procedures. Technical Report 36.213 v12.3.0.Google Scholar
- Kari Aho, Olli Alanen, and Jorma Kaikkonen. 2011. CQI reporting imperfections and their consequences in LTE networks. In Proceedings of ICN.Google Scholar
- Francisco Blanquez-Casado, Gerardo Gomez, Maria del Carmen Aguayo-Torres, and Jose Tomas Entrambasaguas. 2016. eOLLA: an enhanced outer loop link adaptation for cellular networks. EURASIP Journal on Wireless Communications and Networking 2016, 1 (16 Jan 2016), 20.Google ScholarCross Ref
- V. Buenestado, J. M. Ruiz-Avilés, M. Toril, S. Luna-Ramírez, and A. Mendo. 2014. Analysis of Throughput Performance Statistics for Benchmarking LTE Networks. IEEE Communications Letters 18, 9 (Sept 2014), 1607--1610.Google ScholarCross Ref
- Wei Chu, Lihong Li, Lev Reyzin, and Robert Schapire. 2011. Contextual bandits with linear payoff functions. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. 208--214.Google Scholar
- R. Combes and A. Proutiere. 2015. Dynamic Rate and Channel Selection in Cognitive Radio Systems. IEEE Journal on Selected Areas in Communications 33, 5 (May 2015), 910--921.Google ScholarDigital Library
- R. C. Daniels, C. M. Caramanis, and R. W. Heath. 2010. Adaptation in Convolutionally Coded MIMO-OFDM Wireless Systems Through Supervised Learning and SNR Ordering. IEEE Transactions on Vehicular Technology 59, 1 (Jan 2010), 114--126.Google ScholarCross Ref
- R. A. Delgado, K. Lau, R. Middleton, R. S. Karlsson, T. Wigren, and Y. Sun. 2017. Fast Convergence Outer Loop Link Adaptation with Infrequent Updates in Steady State. In 2017 IEEE 86th Vehicular Technology Conference (VTC-Fall). 1--5.Google Scholar
- A. Durán, M. Toril, F. Ruiz, and A. Mendo. 2015. Self-Optimization Algorithm for Outer Loop Link Adaptation in LTE. IEEE Communications Letters 19, 11 (Nov 2015), 2005--2008.Google ScholarCross Ref
- Yun Chao Hu, Milan Patel, Dario Sabella, Nurit Sprecher, and Valerie Young. 2015. Mobile edge computing - A key technology towards 5G. ETSI white paper 11, 11 (2015), 1--16.Google Scholar
- ITU-R. 1997. Guidelines for evaluation of radio transmission technologies for IMT-2000. Technical Report.Google Scholar
- T. L. Jensen, S. Kant, J. Wehinger, and B. H. Fleury. 2010. Fast Link Adaptation for MIMO OFDM. IEEE Transactions on Vehicular Technology 59, 8 (Oct 2010), 3766--3778.Google ScholarCross Ref
- S. Katri Pulliyakode and S. Kalyani. 2017. Reinforcement learning techniques for Outer Loop Link Adaptation in 4G/5G systems. ArXiv e-prints (Aug. 2017). arXiv:stat.ML/1708.00994Google Scholar
- Lihong Li, Wei Chu, John Langford, and Robert E Schapire. 2010. A contextual-bandit approach to personalized news article recommendation. In Proceedings of the 19th international conference on World wide web. ACM, 661--670. Google ScholarDigital Library
- A.F. Molisch. 2010. Wireless Communications. Wiley. Google ScholarDigital Library
- Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, Melih Elibol, Zongheng Yang, William Paul, Michael I Jordan, et al. 2018. Ray: A distributed framework for emerging {AI} applications. In 13th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 18). 561--577. Google ScholarDigital Library
- S. Park, R. C. Daniels, and R. W. Heath. 2015. Optimizing the Target Error Rate for Link Adaptation. In 2015 IEEE Global Communications Conference (GLOBECOM). 1--6.Google Scholar
- Vidit Saxena. 2016. py-itpp: Python library for signal processing and communications research. https://github.com/vidits-kth/py-itppGoogle Scholar
- V. Saxena, J. Jaldén, M. Bengtsson, and H. Tullberg. 2018. Deep Learning for Frame Error Probability Prediction in BICM-OFDM Systems. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 6658--6662.Google Scholar
- M. Shikh-Bahaei. 2007. Joint Optimization Of Transmission Rate and Outer-Loop SNR Target Adaptation Over Fading Channels. IEEE Transactions on Communications 55, 3 (March 2007), 398--403.Google ScholarCross Ref
- Sander Wahls and H Vincent Poor. 2013. An outer loop link adaptation for BICM-OFDM that learns. In 2013 IEEE 14th Workshop on Signal Processing Advances in Wireless Communications (SPAWC). IEEE, 719--723.Google ScholarCross Ref
- Shangxing Wang, Hanpeng Liu, Pedro Henrique Gomes, and Bhaskar Krishnamachari. 2018. Deep reinforcement learning for dynamic multichannel access in wireless networks. IEEE Transactions on Cognitive Communications and Networking 4, 2 (2018), 257--265.Google ScholarCross Ref
Index Terms
- Contextual Multi-Armed Bandits for Link Adaptation in Cellular Networks
Recommendations
Multi-hop cellular networks: Architecture and protocols for best-effort and real-time communication
Until recently, research on cellular networks concentrated only in single-hop cellular networks. The demand for high throughput has driven to architectures that use multiple hops in the presence of infrastructure. We propose an architecture for multihop ...
Mathematical Characteristics of Uplink and Downlink Interference Regions in D2D Communications Underlaying Cellular Networks
In this paper, mathematical characteristics of uplink and downlink interference regions in device-to-device (D2D) communications underlaying cellular networks are analyzed. We consider that one CUE and one pair of D2D user equipments (DUEs) coexist and ...
Performance investigation of CDMA/PRMA with power control in TDD multimedia cellular networks
ICAIT '08: Proceedings of the 2008 International Conference on Advanced Infocomm TechnologyPacket reservation multiple access (PRMA) is a famous packet switching based medium access control (MAC) for its high multiplexing gain, which is further enhanced by jointly using code-division multiple access (CDMA). In most studies on CDMA/PRMA for ...
Comments