A Q-Learning-Based Downlink Power Control Algorithm for Energy Efficiency in LTE Femtocells

Lian Fen Huang; Bin Wen; Zhi Bin Gao; Hong Xiang Cai; Yu Jie Li

doi:10.4028/www.scientific.net/AMM.556-562.1766

Paper Titles

The Analysis of Implement of SiPM in LDRI System
p.1749

Control Strategy of Low Voltage Ride-Through for Grid-Connected Photovoltaic Power System Based on Predictive Current
p.1753

A Kind of Embedded Firewall Mechanism for ARM Processors
p.1757

Research on Broadband Power Amplifier Adaptive Digital Pre-Distortion Based on FPGA Technology
p.1761

A Q-Learning-Based Downlink Power Control Algorithm for Energy Efficiency in LTE Femtocells
p.1766

Design and Research on a 24GHz Microstrip Array Antenna
p.1770

Analysis of Switching Power Supply Optimization
p.1775

Analysis on Suddenly Stop Running Effect of Wind Turbine in Power System
p.1779

Research of Harmonic Reuse by Fundamental Resonant Method
p.1782

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 556-562A Q-Learning-Based Downlink Power Control...

A Q-Learning-Based Downlink Power Control Algorithm for Energy Efficiency in LTE Femtocells

Abstract:

Femtocell is introduced to improve indoor coverage, which is beneficial for both users and operators. But it will also inevitably produce interference management issues in the heterogeneous network which consists of femtocells and macrocells. In this paper, a decentralized Q-learning-based power control strategy is proposed, comparing with homogenous power allocation and smart power control (SPC) algorithm. Simulation results have shown that Q-learning-based power control algorithm can implement the compromise of capacity between macrocells and femtocells, and greatly enhance energy efficiency of the whole network.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 556-562)

Pages:

1766-1769

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.556-562.1766

Citation:

Cite this paper

Online since:

May 2014

Authors:

Lian Fen Huang, Bin Wen, Zhi Bin Gao*, Hong Xiang Cai, Yu Jie Li

Keywords:

Energy Efficiency, Heterogeneous Network, LTE, Power Control, Q-Learning

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] Cisco V N I. Forecast' Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2011–2016'[J]. Cisco Public Information, (2012).

DOI: 10.7717/peerj-cs.420/fig-1

Google Scholar

[2] Zhang J, De la Roche G. Femtocells: technologies and deployment [M]. New York: Wiley, (2010).

Google Scholar

[3] Xie R, Yu F R, Ji H. Interference Management and Power Allocation for Energy-Efficient Cognitive Femtocell Networks [J]. Mobile Networks and Applications, 2013: 1-13.

DOI: 10.1007/s11036-013-0434-2

Google Scholar

[4] Haiqin Ning, Power Control Algorithm for Femtocell Based on Machine Learning (in Chinese)[D], 2013, The Nanjing University of Posts and Telecommunications.

Google Scholar

[5] Saad H, Mohamed A, ElBatt T. A Cooperative Q-learning Approach for Real-time Power Allocation in Femtocell Networks [J]. arXiv preprint arXiv: 1303. 2789, (2013).

DOI: 10.1109/vtcfall.2013.6692027

Google Scholar

[6] Serrano A M G. Self-organized Femtocells: a Time Difference Learning Approach [J]. (2012).

Google Scholar

[7] Galindo-Serrano A, Giupponi L. Distributed Q-learning for interference control in OFDMA-based femtocell networks[C]/ VTC 2010-Spring, 2010 IEEE 71st. IEEE, 2010: 1-5.

DOI: 10.1109/vetecs.2010.5493950

Google Scholar

[8] Watkins C J C H, Dayan P. Q-learning [J]. Machine learning, 1992, 8(3-4): 279-292.

Google Scholar

[9] Harmon M E, Harmon S S. Reinforcement Learning: A Tutorial[R]. WRIGHT LAB WRIGHT-PATTERSON AFB OH, (1997).

Google Scholar

[10] Jeju, Interference control for LTE Rel-9 HeNB cells[S] 3GPP TSG RAN WG4, R4-094245, November 9th-13th, (2009).

Google Scholar