Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

(6)
Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering) image
ISBN-10:

144715021X

ISBN-13:

9781447150213

Edition: 2nd ed. 2013
Released: Mar 20, 2013
Publisher: Springer
Format: Hardcover, 246 pages

Description:

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search.
This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes:
innovative material on MDPs, both in constrained settings and with uncertain transition properties;
game-theoretic method for solving MDPs;
theories for developing roll-out based algorithms; and
details of approximation stochastic annealing, a population-based on-line simulation-based algorithm.
The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.

Best prices to buy, sell, or rent ISBN 9781447150213




Related Books

Frequently Asked Questions about Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering)

You can buy the Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering) book at one of 20+ online bookstores with BookScouter, the website that helps find the best deal across the web. Currently, the best offer comes from and is $ for the .

The price for the book starts from $43.98 on Amazon and is available from 14 sellers at the moment.

If you’re interested in selling back the Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering) book, you can always look up BookScouter for the best deal. BookScouter checks 30+ buyback vendors with a single search and gives you actual information on buyback pricing instantly.

As for the Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering) book, the best buyback offer comes from and is $ for the book in good condition.

The Simulation-Based Algorithms for Markov Decision Processes (Communications and Control Engineering) book is in very low demand now as the rank for the book is 9,702,974 at the moment. A rank of 1,000,000 means the last copy sold approximately a month ago.

Not enough insights yet.