ISSN:
1572-9338
Keywords:
Markov processes
;
numerical methods
;
left-skip-free transitions
;
Markov decision processes
;
queues
Source:
Springer Online Journal Archives 1860-2000
Topics:
Mathematics
,
Economics
Notes:
Abstract Recursive methods have been proposed for the numerical solution of equations arising in the analysis and control of Markov processes. Two examples are (i) solving for the equilibrium probabilities, and (ii) solving for the minimal expected cost or time to reach state zero, in a Markov process with left-skip-free transition structure. We discuss conditions under which recursive techniques are numerically stable and efficient, giving applications to descriptive and control models for queues.
Type of Medium:
Electronic Resource
URL:
http://dx.doi.org/10.1007/BF02187080
Permalink