Random Structures & Algorithms
A Markov Chain Monte Carlo Approach to Stereovision
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Bayesian Learning Techniques: Application to Neural Networks with Constraints on Weight Space
WIRN VIETRI 2002 Proceedings of the 13th Italian Workshop on Neural Nets-Revised Papers
Markov Chain Monte Carlo in small worlds
Statistics and Computing
Resource allocation and cross-layer control in wireless networks
Foundations and Trends® in Networking
Coarse-gradient Langevin algorithms for dynamic data integration and uncertainty quantification
Journal of Computational Physics - Special issue: Uncertainty quantification in simulation science
Task-driven automated component deployment for ambient intelligence environments
Pervasive and Mobile Computing
Model evolution by run-time parameter adaptation
ICSE '09 Proceedings of the 31st International Conference on Software Engineering
Network adiabatic theorem: an efficient randomized protocol for contention resolution
Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems
A Push---Pull Network with Infinite Supply of Work
Queueing Systems: Theory and Applications
Foundations and Trends® in Networking
On asymptotic theory for multivariate GARCH models
Journal of Multivariate Analysis
User Behavior Mining for On-Line GUI Adaptation
ICDHM '09 Proceedings of the 2nd International Conference on Digital Human Modeling: Held as Part of HCI International 2009
Queueing Systems: Theory and Applications
Nearest neighbor conditional estimation for Harris recurrent Markov chains
Journal of Multivariate Analysis
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
MAGENTA: transaction-based statistical micro-architectural root-cause analysis
Proceedings of the 46th Annual Design Automation Conference
Performability analysis method from reliability and availability
Proceedings of the 2009 International Conference on Hybrid Information Technology
Joint channel- and queue-aware scheduling for multiuser diversity in wireless OFDMA networks
IEEE Transactions on Communications
Markovian search games in heterogeneous spaces
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Queueing analysis for the OFDMA downlink: throughput regions, delay and exponential backlog bounds
IEEE Transactions on Wireless Communications
A stochastic control viewpoint on 'posterior matching'-style feedback communication schemes
ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 3
Influence in a large society: interplay between information dynamics and network structure
ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 3
A fundamental characterization of stability in broadcast queueing systems
ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 2
An information-theoretic framework to aggregate a Markov chain
ACC'09 Proceedings of the 2009 conference on American Control Conference
Stochastic Geometry and Wireless Networks: Volume II Applications
Foundations and Trends® in Networking
Weak Differentiability of Product Measures
Mathematics of Operations Research
A simple model of contact patterns in delay-tolerant networks
Wireless Networks
Asymptotic properties of nonlinear autoregressive Markov processes with state-dependent switching
Journal of Multivariate Analysis
Perturbation of the hyper-linked environment
COCOON'03 Proceedings of the 9th annual international conference on Computing and combinatorics
Coupling from the past in hybrid models for file sharing peer to peer systems
HSCC'07 Proceedings of the 10th international conference on Hybrid systems: computation and control
V-uniform ergodicity for state-dependent single class queueing networks
Queueing Systems: Theory and Applications
Cognitive interference management in retransmission-based wireless networks
Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
On fair sharing of spectrum via CSMA
Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
Generalization performance of ERM algorithm with geometrically ergodic Markov chain samples
ICNC'09 Proceedings of the 5th international conference on Natural computation
Scheduling in multichannel wireless networks with flow-level dynamics
Proceedings of the ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Throughput-optimal opportunistic scheduling in the presence of flow-level dynamics
INFOCOM'10 Proceedings of the 29th conference on Information communications
Large deviations sum-queue optimality of a radial sum-rate monotone opportunistic scheduler
IEEE Transactions on Information Theory
Coordinated learning in multiagent MDPs with infinite state-space
Autonomous Agents and Multi-Agent Systems
Estimating and sampling graphs with multidimensional random walks
IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
International Journal of Intelligent Information and Database Systems
Stochastic control via direct comparison
Discrete Event Dynamic Systems
Long-Run Accuracy of Variational Integrators in the Stochastic Context
SIAM Journal on Numerical Analysis
Journal of Computational Neuroscience
Computers & Mathematics with Applications
Measuring performance of continuous-time stochastic processes using timed automata
Proceedings of the 14th international conference on Hybrid systems: computation and control
The geometric and subgeometric convergence rates of the Ek/G/1 queueing system
Proceedings of the 6th International Conference on Queueing Theory and Network Applications
Proceedings of the 48th Design Automation Conference
Wide-sense regeneration for Harris recurrent Markov processes: an open problem
Queueing Systems: Theory and Applications
Tandem queueing networks with neighbor blocking and back-offs
Queueing Systems: Theory and Applications
Fixed-delay events in generalized semi-Markov processes revisited
CONCUR'11 Proceedings of the 22nd international conference on Concurrency theory
Throughput-optimal opportunistic scheduling in the presence of flow-level dynamics
IEEE/ACM Transactions on Networking (TON)
Stability with file arrivals and departures in multichannel cellular wireless networks
Queueing Systems: Theory and Applications
Constructive development of probabilistic programs
FSEN'11 Proceedings of the 4th IPM international conference on Fundamentals of Software Engineering
On the validity of the batch quantile method for Markov chains
Operations Research Letters
Fault resilience of the algebraic multi-grid solver
Proceedings of the 26th ACM international conference on Supercomputing
Some aspects of modeling dependence in copula-based Markov chains
Journal of Multivariate Analysis
A performance analysis of channel fragmentation in dynamic spectrum access systems
Queueing Systems: Theory and Applications
Generalized Look-Ahead Methods for Computing Stationary Densities
Mathematics of Operations Research
Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control
Automatica (Journal of IFAC)
Transform-Domain solutions of poisson's equation with applications to the asymptotic variance
ASMTA'12 Proceedings of the 19th international conference on Analytical and Stochastic Modeling Techniques and Applications
Improved methods and measures for computing dynamic program slices in stochastic simulations
Proceedings of the Winter Simulation Conference
Root finding via darts: dynamic adaptive random target shooting
Proceedings of the Winter Simulation Conference
Analysis of an interacting particle method for rare event estimation
Queueing Systems: Theory and Applications
Zero-Variance Importance Sampling Estimators for Markov Process Expectations
Mathematics of Operations Research
Join the shortest queue among k parallel queues: tail asymptotics of its stationary distribution
Queueing Systems: Theory and Applications
Poisson's equation for discrete-time quasi-birth-and-death processes
Performance Evaluation
Hedonic coalition formation for optimal deployment
Automatica (Journal of IFAC)
| Hi-index | 0.06 |
Meyn & Tweedie is back! The bible on Markov chains in general state spaces has been brought up to date to reflect developments in the field since 1996 - many of them sparked by publication of the first edition. The pursuit of more efficient simulation algorithms for complex Markovian models, or algorithms for computation of optimal policies for controlled Markov models, has opened new directions for research on Markov chains. As a result, new applications have emerged across a wide range of topics including optimisation, statistics, and economics. New commentary and an epilogue by Sean Meyn summarise recent developments and references have been fully updated. This second edition reflects the same discipline and style that marked out the original and helped it to become a classic: proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background.