Polynomial cost approximations in markov decision theory based call admission control
IEEE/ACM Transactions on Networking (TON)
Programming backgammon using self-teaching neural nets
Artificial Intelligence - Chips challenging champions: games, computers and Artificial Intelligence
Optimal resource allocation in multi-class networks with user-specified utility functions
Computer Networks: The International Journal of Computer and Telecommunications Networking
Risk-Sensitive Reinforcement Learning
Machine Learning
Minimizing Transmission Costs through Adaptive Marking in Differentiated Services Networks
MMNS '02 Proceedings of the 5th IFIP/IEEE International Conference on Management of Multimedia Networks and Services: Management of Multimedia on the Internet
Reinforcement Learning for Control of Traffic and Access Points in Intelligent Wireless ATM Networks
Proceedings of the International Conference, 7th Fuzzy Days on Computational Intelligence, Theory and Applications
QoS-IP 2003 Proceedings of the Second International Workshop on Quality of Service in Multiservice IP Networks
Call Admission Control for Multimedia Cellular Networks Using Neuro-dynamic Programming
NETWORKING '02 Proceedings of the Second International IFIP-TC6 Networking Conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; and Mobile and Wireless Communications
Call admission control in cellular networks: a reinforcement learning solution
International Journal of Network Management
BROADNETS '04 Proceedings of the First International Conference on Broadband Networks
A self-adaptive bandwidth reservation scheme for sectored cellular communications
Information Sciences—Informatics and Computer Science: An International Journal
Simplification of network dynamics in large systems
IEEE/ACM Transactions on Networking (TON)
Mobile Networks and Applications - Special issue: Recent advances in wireless networking
Predicting the quality of service of wireless LANs using neural networks
Proceedings of the 9th ACM international symposium on Modeling analysis and simulation of wireless and mobile systems
An optimization-based approach for QoS routing in high-bandwidth networks
IEEE/ACM Transactions on Networking (TON)
STEWARD: demo of spatio-textual extraction on the web aiding the retrieval of documents
dg.o '07 Proceedings of the 8th annual international conference on Digital government research: bridging disciplines & domains
WSEAS TRANSACTIONS on COMMUNICATIONS
Assured end-to-end QoS through adaptive marking in multi-domain differentiated services networks
Computer Communications
GameNets'09 Proceedings of the First ICST international conference on Game Theory for Networks
Network Cargo Capacity Management
Operations Research
Network-Adaptive qos routing using local information
APNOMS'06 Proceedings of the 9th Asia-Pacific international conference on Network Operations and Management: management of Convergence Networks and Services
A neural network method for minimum delay routing in packet-switched networks
Computer Communications
| Hi-index | 0.07 |
We consider the problem of call admission control (CAC) and routing in an integrated services network that handles several classes of calls of different value and with different resource requirements. The problem of maximizing the average value of admitted calls per unit time (or of revenue maximization) is naturally formulated as a dynamic programming problem, but is too complex to allow for an exact solution. We use methods of neuro-dynamic programming (NDP) [reinforcement learning (RL)], together with a decomposition approach, to construct dynamic (state-dependent) call admission control and routing policies. These policies are based on state-dependent link costs, and a simulation-based learning method is employed to tune the parameters that define these link costs. A broad set of experiments shows the robustness of our policy and compares its performance with a commonly used heuristic