Markov Decision Processes in Artificial Intelligence
Search in google:
Markov Decision Processes (MDPs) are a mathematical framework for modeling sequential decision problems under uncertainty as well as Reinforcement Learning problems. Written by experts in the field, this book provides a global view of current research using MDPs in Artificial Intelligence. It starts with an introductory presentation of the fundamental aspects of MDPs (planning in MDPs, Reinforcement Learning, Partially Observable MDPs, Markov games and the use of non-classical criteria). Then it presents more advanced research trends in the domain and gives some concrete examples using illustrative applications.
List of AuthorsPt. 1 MDPs: Models and Methods 1Ch. 1 Markov Decision Processes Frederick Garcia Garcia, Frederick Emmanuel Rachelson Rachelson, Emmanuel 3Ch. 2 Reinforcement Learning Olivier Sigaud Sigaud, Olivier Frederick Garcia Garcia, Frederick 39Ch. 3 Approximate Dynamic Programming Remi Munos Munos, Remi 67Ch. 4 Factored Markov Decision Processes Thomas Degris Degris, Thomas Olivier Sigaud Sigaud, Olivier 99Ch. 5 Policy-Gradient Algorithms Olivier Buffet Buffet, Olivier 127Ch. 6 Online Resolution Techniques Laurent Peret Peret, Laurent Frederick Garcia Garcia, Frederick 153Pt. 2 Beyond MDPs 185Ch. 7 Partially Observable Markov Decision Processes Alain Dutech Dutech, Alain Bruno Scherrer Scherrer, Bruno 187Ch. 8 Stochastic Games Andriy Burkov Burkov, Andriy Laetitia Matignon Matignon, Laetitia Brahim Chaib-Draa Chaib-Draa, Brahim 229Ch. 9 Dec-Mdp/Pomdp Aurelie Beynier Beynier, Aurelie Francois Charpillet Charpillet, Francois Daniel Szer Szer, Daniel Abdel-Illah Mouaddib Mouaddib, Abdel-Illah 277Ch. 10 Non-Standard Criteria Matthieu Boussard Boussard, Matthieu Maroua Bouzid Bouzid, Maroua Abdel-Illah Mouaddib Mouaddib, Abdel-Illah Regis Sabbadin Sabbadin, Regis Paul Weng Weng, Paul 319Pt. 3 Applications 361Ch. 11 Online Learning for Micro-Object Manipulation Guillaume Laurent Laurent, Guillaume 363Ch. 12 Conservation of Biodiversity Iadine Chades Chades, Iadine 375Ch. 13 Autonomous Helicopter Searching for a Landing Area in an Uncertain Environment Patrick Fabiani Fabiani, Patrick Florent Teichteil-Konigsbuch Teichteil-Konigsbuch, Florent 395Ch. 14 Resource Consumption Control for an Autonomous Robot Simon Le Gloannec Le Gloannec, Simon Abdel-Illah Mouaddib Mouaddib, Abdel-Illah 413Ch. 15 Operations Planning Sylvie Thiebaux Thiebaux, Sylvie Olivier Buffet Buffet, Olivier 425Index 453
