Markov Decision Processes and Stochastic Positional Games: Optimal Control on Complex Networks

Dmitrii Lozovanu · Stefan Wolfgang Pickl

Feb 2024 · International Series in Operations Research & Management Science Book 349 · Springer Nature

Ebook

396

Pages

Ratings and reviews aren’t verified Learn More

About this ebook

This book presents recent findings and results concerning the solutions of especially finite state-space Markov decision problems and determining Nash equilibria for related stochastic games with average and total expected discounted reward payoffs. In addition, it focuses on a new class of stochastic games: stochastic positional games that extend and generalize the classic deterministic positional games. It presents new algorithmic results on the suitable implementation of quasi-monotonic programming techniques. Moreover, the book presents applications of positional games within a class of multi-objective discrete control problems and hierarchical control problems on networks.

Given its scope, the book will benefit all researchers and graduate students who are interested in Markov theory, control theory, optimization and games.

About the author

Prof. Dmitrii Lozovanu is head of the department of Applied Mathematics at the Faculty of Mathematics and Computer Science, Moldova State University, Chisinau, Moldova. His main research interests are in discrete optimization, game theory, optimal control and stochastic decision-making processes.

Prof. Stefan Pickl is a Professor of Operations Research at Bundeswehr University Munich, Germany. He studied mathematics, electrical engineering, and philosophy at the TU Darmstadt, Germany and EPFL Lausanne, Switzerland. He is also associated with the Centre for the Advanced Study of Algorithms (CASA), USA and Center for Network Innovation and Experimentation (CENETIX), USA.

Rate this ebook

Tell us what you think.

Reading information

Smartphones and tablets

Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.

Laptops and computers

You can listen to audiobooks purchased on Google Play using your computer's web browser.

eReaders and other devices

To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.

Report illegal content