Continuous-Time Semi-Markov Models in Health Economic Decision Making: An Illustrative Example in Heart Failure Disease Management

Cao, Q., Buskens, E., Feenstra, T., Jaarsma, T., Hillege, H. & Postmus, D., Jan-2016, In : Medical decision making : an international journal of the Society for Medical Decision Making. 36, 1, p. 59-71 13 p.

Research output: Contribution to journalArticleAcademicpeer-review

Copy link to clipboard


  • Continuous-Time Semi-Markov Models in Health Economic Decision Making

    Final publisher's version, 1.04 MB, PDF document


Continuous-time state transition models may end up having large unwieldy structures when trying to represent all relevant stages of clinical disease processes by means of a standard Markov model. In such situations, a more parsimonious, and therefore easier-to-grasp, model of a patient's disease progression can often be obtained by assuming that the future state transitions do not depend only on the present state (Markov assumption) but also on the past through time since entry in the present state. Despite that these so-called semi-Markov models are still relatively straightforward to specify and implement, they are not yet routinely applied in health economic evaluation to assess the cost-effectiveness of alternative interventions. To facilitate a better understanding of this type of model among applied health economic analysts, the first part of this article provides a detailed discussion of what the semi-Markov model entails and how such models can be specified in an intuitive way by adopting an approach called vertical modeling. In the second part of the article, we use this approach to construct a semi-Markov model for assessing the long-term cost-effectiveness of 3 disease management programs for heart failure. Compared with a standard Markov model with the same disease states, our proposed semi-Markov model fitted the observed data much better. When subsequently extrapolating beyond the clinical trial period, these relatively large differences in goodness-of-fit translated into almost a doubling in mean total cost and a 60-d decrease in mean survival time when using the Markov model instead of the semi-Markov model. For the disease process considered in our case study, the semi-Markov model thus provided a sensible balance between model parsimoniousness and computational complexity.

Original languageEnglish
Pages (from-to)59-71
Number of pages13
JournalMedical decision making : an international journal of the Society for Medical Decision Making
Issue number1
Early online date14-Jul-2015
Publication statusPublished - Jan-2016


  • continuous-time semi-Markov model, vertical modeling, heart failure disease management, COST-EFFECTIVENESS ANALYSIS, MULTISTATE MODELS, COMPETING RISKS, PATIENT HETEROGENEITY, SIMULATION, REGRESSION

ID: 22249332