Skip to main content
Log in

Solving linear systems by methods based on a probabilistic interpretation

Die Lösung linearer Systeme mit Hilfe eines probabilistischen Konzepts

  • Published:
Computing Aims and scope Submit manuscript

Abstract

In this paper it is demonstrated how the probabilistic concept of a stopping time in a random process may be used to generate an iterative method for solving a system of linear equations. Actually all known iterative approximation methods for solving linear equations are generated by various choices of a stopping time e. g. the point and block Jacobi methods, the point and block Gauss-Seidel Methods and overrelaxation methods are covered.

The probabilistic approach offers—in a natural way—the possibility of adapting the solution technique to the special structure of the problem. Moreover, posterior bounds for the solution are constructed, which lead to faster convergence of the approximations than with usual prior bounds.

Zusammenfassung

Es wird gezeigt, wie das probabilistische Konzept der Stoppzeit eines Zufallsprozesses für eine iterative Methode zur Lösung eines Systems linearer Gleichungen herangezogen werden kann. Alle bekannten iterativen Näherungsmethoden zur Lösung linearer Gleichungssysteme, wie z. B. die Blockmethoden nach Jakobi und Gauss-Seidel und Überrelaxationsmethoden, entsprechen verschieden gewählten Stoppzeiten.

Das probabilistische Verfahren bietet die Möglichkeit, Lösungstechniken für die spezielle Struktur des Problems zu adaptieren. Darüber hinaus führen die vorgeschlagenen Methoden zu einer schnelleren Konvergenz.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Hübner, G.: Improved procedures for eliminating suboptimal actions in Markov programming by the use of contraction properties. In: Transactions of the 7th Prague conference on stochastic processes, Vol. A, pp. 257–263. Prag: Academia 1977.

    Google Scholar 

  2. MacQueen, J.: A modified dynamic programming method for Markovian decision problems. J. Math. Anal. Appl.14, 38–43 (1966).

    Google Scholar 

  3. Morton, T., Wecker, W.: Discounting, ergodicity and convergence for Markov decision process. Man. Sci.23, 890–900 (1977).

    Google Scholar 

  4. Nunen, J. A. E. E. van: Contracting Markov decision processes. Mathematical centre tract no. 71. Math. Centre Amsterdam, 1976.

  5. Nunen, J. A. E. E. van: A set of successive approximation methods for discounted Markov decision problems. Zeitschrift für Oper. Res.20, 203–208 (1976).

    Google Scholar 

  6. Nunen, J. A. E. E. van, Stidham, jr., S.: Action dependent stopping times and Markov decisions, processes with unbounded reward (to appear in O. R. spectrum 1981).

  7. Porteus, E. L.: Bounds and transformations for discounted finite Markov decision chains. Oper. Res.23, 761–784 (1975).

    Google Scholar 

  8. Seneta, E.: Nonnegative matrices. Londen: Allyn and Bacon 1973.

    Google Scholar 

  9. Varga, R. S.: Matrix iterative analysis. Englewood Cliffs, N. J.: Prentice-Hall 1962.

    Google Scholar 

  10. Wessels, J.: Stopping times and Markov programming. In: Transactions of the 7th Prague conference on stochastic processes etc., Vol. A, pp. 575–585. Prag: Academia 1977.

    Google Scholar 

  11. Wessels, J.: Markov programming by successive approximate with aspect to weighted supremum norm. J. Math. Anal. Appl.58, 326–335 (1977).

    Google Scholar 

  12. Schweitzer, P.: Iterative solution of the functional equations of undiscounted Markov renewal programming. J. Math. Anal. Appl.34, 495–501 (1971).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

van Nunen, J., Wessels, J. Solving linear systems by methods based on a probabilistic interpretation. Computing 26, 209–225 (1981). https://doi.org/10.1007/BF02243479

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02243479

Keywords

Navigation