Counterexamples In Markov Decision Processes
Regular price
€179.80
14 days return policy
Shipping & Delivery
A01=Alexey B Piunovskiy
Applied Probability
Author_Alexey B Piunovskiy
Category=PBKQ
Category=PBT
Control Strategy
eq_isMigrated=1
eq_isMigrated=2
eq_nobargain
Markov Decision Process
Mathematical Programming
Optimal Control
Optimization
Stochastic Processes
Product details
- ISBN 9781800616752
- Publication Date: 11 Apr 2025
- Publisher: World Scientific Europe Ltd
- Publication City/Country: GB
- Product Form: Hardback
Secure
checkout
Fast Shipping
Easy returns
Markov Decision Processes (MDPs) form a cornerstone of applied probability, with over 50 years of rich research history. Throughout this time, numerous foundational books and thousands of journal articles have shaped the field. The central objective of MDP theory is to identify the optimal control strategy for Markov random processes with discrete time. Interestingly, the best control strategies often display unexpected or counterintuitive behaviors, as documented by a wide array of studies.This book gathers some of the most compelling examples of such phenomena while introducing new ones. By doing so, it serves as a valuable companion to existing textbooks. While many examples require little to no prior knowledge, others delve into advanced topics and will primarily interest specialists.In this second edition, extensive revisions have been made, correcting errors and refining the content, with a wealth of new examples added. The range of examples spans from elementary to advanced, requiring background knowledge in areas like measure theory, convex analysis, and advanced probability. A new chapter on continuous time jump processes has also been introduced. The entire text has been reworked for clarity and accessibility.This book is an essential resource for active researchers and graduate students in the field of Markov Decision Processes.
