The Markov-modulated Poisson process (MMPP) cookbook
Performance Evaluation
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Wireless Communications
Dynamic-Programming Approximations for Stochastic Time-Staged Integer Multicommodity-Flow Problems
INFORMS Journal on Computing
An overview of the femtocell concept
Bell Labs Technical Journal - Next-Generation Wireline Access Networks
A case for adapting channel width in wireless networks
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Distributed spectrum sensing and access in cognitive radio networks with energy constraint
IEEE Transactions on Signal Processing
Optimality of myopic sensing in multichannel opportunistic access
IEEE Transactions on Information Theory
Cooperative resource management in cognitive WiMAX with femto cells
INFOCOM'10 Proceedings of the 29th conference on Information communications
LTE-advanced: next-generation wireless broadband technology
IEEE Wireless Communications
CTRL: a self-organizing femtocell management architecture for co-channel deployment
Proceedings of the sixteenth annual international conference on Mobile computing and networking
Optimal flexible spectrum partitioning for multihop wireless networks with software defined radios
Proceedings of the 13th ACM international conference on Modeling, analysis, and simulation of wireless and mobile systems
Cognitive femtocell networks: an overlay architecture for localized dynamic spectrum access
IEEE Wireless Communications
Joint power control, base station assignment, and channel assignment in cognitive femtocell networks
EURASIP Journal on Wireless Communications and Networking - Special issue on femtocell networks
On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance
IEEE Transactions on Wireless Communications - Part 2
IEEE Communications Magazine
Flexible UL-DL Switching Point in TDD Cellular Local Area Wireless Networks
Mobile Networks and Applications
SMART: A Stochastic Multiscale Model for the Analysis of Energy Resources, Technology, and Policy
INFORMS Journal on Computing
| Hi-index | 0.00 |
Both femtocells and cognitive radio (CR) are envisioned as promising technologies for the NeXt Generation (xG) cellular networks. Cognitive femtocell networks (CogFem) incorporate CR technology into femtocell deployment to reduce its demand for more spectrum bands, thereby improving the spectrum utilization. In this paper, we focus on the channel allocation problem in CogFem, and formulate it as a stochastic dynamic programming (SDP) problem aiming at optimizing the long-term cumulative system throughput of individual femtocells. However, the multi-dimensional state variables resulted from complex exogenous stochastic information make the SDP problem computationally intractable using standard value iteration algorithms. To address this issue, we propose an approximate dynamic programming (ADP) algorithm in pursuit of an approximate solution to the SDP problem. The proposed ADP algorithm relies on an efficient value function approximation (VFA) architecture that we design and a stochastic gradient learning strategy to function, enabling each femtocell to learn and improve its own channel allocation policy. The algorithm is computationally attractive for large-scale downlink channel allocation problems in CogFem since its time complexity does not grow exponentially with the number of femtocells. Simulation results have shown that the proposed ADP algorithm exhibits great advantages: (1) it is feasible for online implementation with a fair rate of convergence and adaptability to both long-term and short-term network dynamics; and (2) it produces high-quality solutions fast, reaching approximately 80% of the upper bounds provided by optimal backward dynamic programming (DP) solutions to a set of deterministic counterparts of the formulated SDP problem.