ISSN:
1432-5217
Keywords:
Key words: Markov decision chains
;
overtaking optimality criteria
Source:
Springer Online Journal Archives 1860-2000
Topics:
Mathematics
,
Economics
Notes:
Abstract. Brown [3] constructed an aperiodic Markov decision chain in which no overtaking policy (stationary or nonstationary) exists. However, in his example a strong overtaking optimal policy exists in the class of all stationary policies. We provide another example of an aperiodic and geometric ergodic Markov decision chain which shows that the existence of a strong overtaking optimal stationary policy may fail inclusively in the class of stationary policies. We also give a brief survey of the existing literature on overtaking optimality in Markov decision chains.
Type of Medium:
Electronic Resource
URL:
http://dx.doi.org/10.1007/s001860050059