### Abstract

Original language | English |
---|---|

Publisher | NTNU University Press |

Number of pages | 3 |

Place of Publication | Trondheim, Norway |

ISBN (Print) | not assigned |

Publication status | Published - Jun 2012 |

Externally published | Yes |

### Fingerprint

### Keywords

- METIS-287910
- IR-80763
- Large times
- EWI-22016
- Rewards
- Importance sampling
- Rare event simulation

### Cite this

*Trondheim, Norway: NTNU University Press*.

}

*Fast simulation for slow paths in Markov models*. NTNU University Press, Trondheim, Norway.

**Fast simulation for slow paths in Markov models.** / Reijsbergen, D.P.; de Boer, Pieter-Tjerk; Scheinhardt, Willem R.W.; Haverkort, Boudewijn R.H.M.

Research output: Other contribution › Other research output

TY - GEN

T1 - Fast simulation for slow paths in Markov models

AU - Reijsbergen, D.P.

AU - de Boer, Pieter-Tjerk

AU - Scheinhardt, Willem R.W.

AU - Haverkort, Boudewijn R.H.M.

PY - 2012/6

Y1 - 2012/6

N2 - Inspired by applications in the context of stochastic model checking, we are interested in using simulation for estimating the probability of reaching a specific state in a Markov chain after a large amount of time tau has passed. Since this is a rare event, we apply importance sampling. We derive approximate expressions for the sojourn times on a given path in a Markov chain conditional on the sum exceeding tau, and use those expressions to construct a change of measure. Numerical examples show that this change of measure performs very well, leading to high precision estimates in short simulation times.

AB - Inspired by applications in the context of stochastic model checking, we are interested in using simulation for estimating the probability of reaching a specific state in a Markov chain after a large amount of time tau has passed. Since this is a rare event, we apply importance sampling. We derive approximate expressions for the sojourn times on a given path in a Markov chain conditional on the sum exceeding tau, and use those expressions to construct a change of measure. Numerical examples show that this change of measure performs very well, leading to high precision estimates in short simulation times.

KW - METIS-287910

KW - IR-80763

KW - Large times

KW - EWI-22016

KW - Rewards

KW - Importance sampling

KW - Rare event simulation

M3 - Other contribution

SN - not assigned

PB - NTNU University Press

CY - Trondheim, Norway

ER -