A dynamical games approach to transmission-rate adaptation in multimedia WLAN

Authors:
Jane Wei Huang;Hassan Mansour;Vikram Krishnamurthy
Affiliations:
Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada;Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada;Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada
Venue:
IEEE Transactions on Signal Processing
Year:
2010

Citing 10
Cited 1

Competitive Markov decision processes

Competitive Markov decision processes
Structural Properties of Stochastic Dynamic Programs

Operations Research
Introduction to Stochastic Search and Optimization

Introduction to Stochastic Search and Optimization
Discrete-Event Control of Stochastic Networks: Multimodularity and Regularity (Lecture Notes in Mathematics)

Discrete-Event Control of Stochastic Networks: Multimodularity and Regularity (Lecture Notes in Mathematics)
MIMO Transmission Control in Fading Channels—A Constrained Markov Decision Process Formulation With Monotone Randomized Policies

IEEE Transactions on Signal Processing
-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission Control

IEEE Transactions on Signal Processing
Opportunistic scheduling for streaming multimedia users in high-speed downlink packet access (HSDPA)

IEEE Transactions on Multimedia
Recursive algorithms for estimation of hidden Markov models and autoregressive models with Markov regime

IEEE Transactions on Information Theory
Rate Control for H.264 Video With Enhanced Rate and Distortion Models

IEEE Transactions on Circuits and Systems for Video Technology
Overview of the Scalable Video Coding Extension of the H.264/AVC Standard

IEEE Transactions on Circuits and Systems for Video Technology

PABM-EDCF: parameter adaptive bi-directional mapping mechanism for video transmission over WSNs

Multimedia Tools and Applications

Quantified Score

Hi-index	35.68

Visualization

Abstract

This paper considers the scheduling, rate adaptation, and buffer management in a multiuser wireless local-area network (WLAN) where each user transmits scalable video payload. Based on opportunistic scheduling, users access the available medium (channel) in a decentralized manner. The rate adaptation problem of the WLAN multimedia networks is then formulated as a general-sum switching control dynamic Markovian game by modelling the video states and block fading channel qualities of each user as a finite states Markovian chain. A value iteration algorithm is proposed to compute the Nash equilibrium policy of such a game and the convergence of the algorithm is also proved. We also give assumptions on the system so that the Nash equilibrium transmission policy of each user is a randomization of two pure policies with each policy nondecreasing on the buffer state occupancy. Based on this structural result, we use the policy gradient algorithm to compute the Nash equilibrium policy.