Cell Selection Mechanism Based on Q-learning Environment in Femtocell LTE-A Networks
DOI:
https://doi.org/10.5614/itbj.ict.res.appl.2021.15.1.4Keywords:
cell selection, femtocell, handover learning, LTE-A, Q-learningAbstract
Universal mobile networks require enhanced capability and appropriate quality of service (QoS) and experience (QoE). To achieve this, Long Term Evolution (LTE) system operators have intensively deployed femtocells (HeNBs) along with macrocells (eNBs) to offer user equipment (UE) with optimal capacity coverage and best quality of service. To achieve the requirement of QoS in the handover stage among macrocells and femtocells we need a seamless cell selection mechanism. Cell selection requirements are considered a difficult task in femtocell-based networks and effective cell selection procedures are essential to reduce the ping-pong phenomenon and to minimize needless handovers. In this study, we propose a seamless cell selection scheme for macrocell-femtocell LTE systems, based on the Q-learning environment. A novel cell selection mechanism is proposed for high-density femtocell network topologies to evaluate the target base station in the handover stage. We used the LTE-Sim simulator to implement and evaluate the cell selection procedures. The simulation results were encouraging: a decrease in the control signaling rate and packet loss ratio were observed and at the same time the system throughput was increased.
Downloads
References
Akyildiz, I.F., McNair, J., Ho, J.S.M., Uzunalioglu, H. & Wang, W., Mobility Management in Next-Generation Wireless Systems, in Proceedings of the IEEE, 87(8), pp. 1347-1384, Aug. 1999.
Ma, B., Wang, D., Cheng, S. & Xie, X., Modeling and Analysis for Vertical Handoff Based on the Decision Tree in a Heterogeneous Vehicle Network, in IEEE Access, 5, pp. 8812-8824, 2017.
Zahir, T., Arshad, K., Nakata, A. & Moessner, K., Interference Management in Femtocells, in IEEE Communications Surveys & Tutorials, 15(1), pp. 293-311, First Quarter 2013.
Gor, G., Jak Z., Knapp, A. & Imre, S., A Survey of Handover Management in LTE-Based Multi-tier Femtocell Networks: Requirements, Challenges and Solutions, Computer Networks, 76, pp. 17-41, ISSN 1389-1286, 2015.
Bhosale, S. & Daruwala, R., Multi-criteria Vertical Handoff Decision Algorithm Using Hierarchy Modeling and Additive Weighting in an Integrated WiFi/WiMAX/UMTS Environment? A Case Study, KSII Transactions on Internet and Information Systems, 8(1), pp. 35-57, 2014.
Rajule, N., Ambudkar, B. & Dhande, A.P., Survey of Vertical Handover Decision Algorithms, Int. J. Innovat. Eng. Technol. (IJIET), pp. 7207-7213, 2015. Available at: http://www.ijirset.com/upload/2015/august/69_A_Review.pdf (12 April 2020)
3GPP, E-UTRA and E-UTRAN Overall Description, TS 36.300 V15.2.0, July 2018. Accessed from: https://portal.3gpp.org/desktopmodules/ Specifications/SpecificationDetails.aspx?specificationId=2430 (12 April 2020)
Habibzadeh, A., Moghaddam, S.S., Razavizadeh, S.M. & Shirvanimoghaddam, M., A Novel Handover Decision-Making Algorithm for Hetnets, IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Abu Dhabi, pp.438-442,2015.
Kwak, H., Mobility Management Survey for Home-eNB Based 3GPP LTE Systems, Journal of Information Processing System, 4(4), pp. 145-152, 2008.
Neeraja, S., Analysis of Adaptive Hysteresis Based Horizontal Handoff Algorithm for GSM, International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering, 1, pp. 433-437, 2013.
Yan, X., S?ekerciog?lu, Y.A. & Narayanan, S., A Survey of Vertical Handover Decision Algorithms in Fourth Generation Heterogeneous Wireless Networks, Comput. Netw., 54(11), pp. 1848-1863, 2010.
Liang, G. & Yu, H., Network Selection Algorithm for Heterogeneous Wireless Networks Based on Service Characteristics and User Preferences, J. Wireless Com. Network, 241, 2018. DOI: 10.1186/s13638-018-1264-5
Chang, C.W., Lin, Y.H., Jan, R.H. & Chen, C., Efficient Measurement Procedure for Handover in LTE Femtocell Networks, 2012 International Conference on Selected Topics in Mobile and Wireless Networking, Avignon, pp. 119-123, 2012.
Chowdhury, M.Z. & Jang,Y.M, Handover Management in High-Dense Femtocellular Networks, EURASIP Journal on Wireless Communications and Networking, 1(6), 2013.
Marshoud, H., Otrok, H., Barada, H., Estrada, R., Jarray, A. & Dziong, Z, Realistic Framework for Resource Allocation in Macro-Femtocell Networks Based on Genetic Algorithm, Telecommunication Systems, 63(1), pp. 99-110, 2016.
Fachtali, I.E., Saadane, R. & ElKoutbi, M., Vertical Handover Decision Algorithm Using Ants? Colonies for 4G Heterogeneous Wireless Networks, Journal of Computer Networks and Communications, 2016(15), 6259802, 2016.
Jeong, B., Shin, S., Jang, I., Sung, N.W. & Yoon, H., A Smart Handover Decision Algorithm Using Location Prediction for Hierarchical Macro/Femto-Cell Networks, 2011 IEEE Vehicular Technology Conference (VTC Fall), San Francisco, CA, pp. 1-5, 2011.
Deswal, Suman, & Singhrova, A., A Vertical Handover Algorithm in Integrated Macrocell Femtocell Networks, International Journal of Electrical and Computer Engineering (IJECE), 7(1), pp. 299-308, 2017.
Huang, Y., Leu, F., Liu, J., Huang, Y. & Chu, W.C., A Handover Scheme for LTE Wireless Networks under the Assistance of GPS, Eighth International Conference on Broadband and Wireless Computing, Communication and Applications, Compiegne, pp.399-403, 2013.
Hsiu-Lang, Hsiu-Lang, W., Shang-Juh, K., Chung-Yi, H. & Fu-Min, Ch. A Moving Direction Prediction-Assisted Handover Scheme in LTE Networks, EURASIP Journal on Wireless Communications and Networking, 1,190, pp. 1-10, 2014.
Ciochina, S., Paleologu, C. & Benesty, J. An Optimized Nlms Algorithm for System Identification, Signal Processing, 118, pp. 115-121, 2016.
Wang, Y.C. & Chuang, C.A., Efficient Enb Deployment Strategy for Heterogeneous Cells In 4G LTE Systems, Elsevier Computer Networks, 79, pp. 297-312, 2015, DOI: 10.1016/J.Comnet.
Alpaydin, E., Introduction to Machine Learning, MIT press, 2nd Edition, 2010.
Watkins, J.C.H. & Dayan, P., Technical Note: Q-learning, Machine Learning, 8, pp. 279-292, 1992.
Wang, Y.H., Chang, J.L. & Huang, G.R., A Handover Prediction Mechanism Based on LTE-A Ue History Information, In Network-Based Information Systems (NBIS), 18th International Conference on, 2015, September, pp. 167-172, 2015.
