Improved Iterative Methods for Verifying Markov Decision Processes - Fundamentals of Software Engineering Access content directly
Conference Papers Year : 2015

Improved Iterative Methods for Verifying Markov Decision Processes

Jaber Karimpour
  • Function : Author
  • PersonId : 986123
Ayaz Isazadeh
  • Function : Author
  • PersonId : 986124
Mohammadsadegh Mohagheghi
  • Function : Author
  • PersonId : 999416
Khayyam Salehi
  • Function : Author
  • PersonId : 999417

Abstract

Value and policy iteration are powerful methods for verifying quantitative properties of Markov Decision Processes (MDPs). In order to accelerate these methods many approaches have been proposed. The performance of these methods depends on the graphical structure of MDPs. Experimental results show that they don’t work much better than normal value/policy iteration when the graph of the MDP is dense. In this paper we present an algorithm which tries to reduce the number of updates in dense MDPs. In this algorithm, instead of saving unnecessary updates we use graph partitioning method to have more important updates.
Fichier principal
Vignette du fichier
978-3-319-24644-4_14_Chapter.pdf (238.89 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01446601 , version 1 (26-01-2017)

Licence

Attribution

Identifiers

Cite

Jaber Karimpour, Ayaz Isazadeh, Mohammadsadegh Mohagheghi, Khayyam Salehi. Improved Iterative Methods for Verifying Markov Decision Processes. 6th Fundamentals of Software Engineering (FSEN), Apr 2015, Tehran, Iran. pp.207-214, ⟨10.1007/978-3-319-24644-4_14⟩. ⟨hal-01446601⟩
87 View
154 Download

Altmetric

Share

Gmail Facebook X LinkedIn More