Average optimality in dynamic programming with general state space
Mathematics of Operations Research
Energy efficiency of TCP in a local wireless environment
Mobile Networks and Applications
A Survey of Energy Efficient Network Protocols for Wireless Networks
Wireless Networks
Transmission Rate Control over Randomly Varying Channels
Probability in the Engineering and Informational Sciences
Discrete-Event Control of Stochastic Networks: Multimodularity and Regularity (Lecture Notes in Mathematics)
Energy-constrained modulation optimization
IEEE Transactions on Wireless Communications
Multi-sensor event detection under temporal correlations with renewable energy sources
WiOPT'09 Proceedings of the 7th international conference on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks
Control of wireless networks with rechargeable batteries
IEEE Transactions on Wireless Communications
Multi-sensor activation for temporally correlated event monitoring with renewable energy sources
International Journal of Sensor Networks
| Hi-index | 0.00 |
We study a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the deviceýs transmit buffer. The possible decisions are: a) to serve some of the buffer content; b) to reorder a new battery after serving the maximum possible amount that it can; or c) to remain idle so that the battery charge can increase owing to diffusion process (which is possible in some commercially available batteries). We look at open and closed-loop controls of the system. The closed-loop control problem is a using the framework of Markov Decision Processes. We address both finite and infinite horizon discounted costs as well as average cost minimization problems. Without using any second order characteristics, we obtain results that include i) optimality of bang-bang control, ii) the optimality of threshold based policies, iii) parametric monotonicity of the threshold, and iv) uniqueness of the threshold. For the open-loop control setting we use recent advances in application of multimodular functions to establish optimality of bracket sequence based control.