Description: Discrete-Time Markov Control Processes Please note: this item is printed on demand and will take extra time before it can be dispatched to you (up to 20 working days). Basic Optimality Criteria Author(s): Onesimo Hernandez-Lerma, Jean B. Lasserre Format: Paperback Publisher: Springer-Verlag New York Inc., United States Imprint: Springer-Verlag New York Inc. ISBN-13: 9781461268840, 978-1461268840 Synopsis This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.
Price: 103.81 GBP
Location: Aldershot
End Time: 2024-11-12T09:22:31.000Z
Shipping Cost: 38.72 GBP
Product Images
Item Specifics
Return postage will be paid by: Buyer
Returns Accepted: Returns Accepted
After receiving the item, your buyer should cancel the purchase within: 60 days
Return policy details:
Book Title: Discrete-Time Markov Control Processes
Number of Pages: 216 Pages
Language: English
Publication Name: Discrete-Time Markov Control Processes: Basic Optimality Criteria
Publisher: Springer-Verlag New York Inc.
Publication Year: 2012
Subject: Engineering & Technology, Mathematics
Item Height: 235 mm
Item Weight: 367 g
Type: Textbook
Author: Onesimo Hernandez-Lerma, Jean B. Lasserre
Series: Stochastic Modelling and Applied Probability
Item Width: 155 mm
Format: Paperback
