Network Meta-Analysis with Competing Risk Outcomes

      This paper is only available as a PDF. To read, Please Download here.



      Cost-effectiveness analysis often requires information on the effectiveness of interventions on multiple outcomes, and commonly these take the form of competing risks. Nevertheless, methods for synthesis of randomized controlled trials with competing risk outcomes are limited.


      The aim of this study was to develop and illustrate flexible evidence synthesis methods for trials reporting competing risk results, which allow for studies with different follow-up times, and that take account of the statistical dependencies between outcomes, regardless of the number of outcomes and treatments.


      We propose a competing risk meta-analysis based on hazards, rather than probabilities, estimated in a Bayesian Markov chain Monte Carlo (MCMC) framework using WinBUGS software. Our approach builds on existing work on mixed treatment comparison (network) meta-analysis, which can be applied to any number of treatments, and any number of competing outcomes, and to data sets with varying follow-up times. We show how a fixed effect model can be estimated, and two random treatment effect models with alternative structures for between-trial variation. We suggest methods for choosing between these alternative models.


      We illustrate the methods by applying them to a data set involving 17 trials comparing nine antipsychotic treatments for schizophrenia including placebo, on three competing outcomes: relapse, discontinuation because of intolerable side effects, and discontinuation for other reasons.


      Bayesian MCMC provides a flexible framework for synthesis of competing risk outcomes with multiple treatments, particularly suitable for embedding within probabilistic cost-effectiveness analysis.



        • Nam I-S
        • Mengerson K
        • Garthwaite P
        Multivariate meta-analysis.
        Stat Med. 2003; 22: 2309-2333
        • Riley RD
        • Abrams KR
        • Lambert PC
        • et al.
        An evaluation of bivariate random-effects meta-analysis for the joint synthesis of two correlated outcomes.
        Stat Med. 2007; 26: 78-97
        • Berkey CS
        • Anderson JJ
        • Hoaglin DC
        Multiple-outcome meta-analysis of clinical trials.
        Stat Med. 1996; 15: 537-557
        • Berkey CS
        • Hoaglin DC
        • Antczak-Bouckoms A
        • et al.
        Meta-analysis of multiple outcomes by regression with random effects.
        Stat Med. 1998; 17: 2537-2550
        • Trikalinos T
        • Olkin I
        A method for the meta-analysis of mutually exclusive binary outcomes.
        Stat Med. 2008; 27: 4279-4300
        • Gilks WR
        • Richardson S
        • Spiegelhalter DJ
        Markov Chain Monte Carlo in Practice. Chapman & Hall/CRC, London1996
        • National Collaborating Centre for Mental Health
        Schizophrenia: The NICE Guidelines on Core Interventions in the Treatment and Management of Schizophrenia in Primary and Secondary Care. Updated edition. British Psychological Society and Royal College of Psychiatrists, Leicester & London2010
        • Cox DR
        • Oakes D
        Analysis of Survival Data. Chapman & Hall Ltd, London1984
        • Lu G
        • Ades AE
        Assessing evidence consistency in mixed treatment comparisons.
        J Am Stat Assoc. 2006; 101: 447-459
        • Lumley T
        Network meta-analysis for indirect treatment comparisons.
        Stat Med. 2002; 21: 2313-2324
        • Higgins JPT
        • Whitehead J
        Borrowing strength from external trials in a meta-analysis.
        Stat Med. 1996; 15: 2733-2749
        • Caldwell DM
        • Ades AE
        • Higgins JPT
        Simultaneous comparison of multiple treatments: combining direct and indirect evidence.
        BMJ. 2005; 331: 897-900
      1. Spiegelhalter DJ, Best N, Carlin BP. Bayesian deviance: the effective number of parameters, and the comparison of arbitrarily complex models. Division of Biostatistics: University of Minnesota, 1998.

        • Spiegelhalter DJ
        • Best NG
        • Carlin BP
        • et al.
        Bayesian measures of model complexity and fit.
        J R Stat Soc Series B Stat Methodol. 2002; 64: 583-616
        • Welton NJ
        • Ades AE
        A model of toxoplasmosis incidence in the UK: evidence synthesis and consistency of evidence.
        Appl Stat. 2005; 54: 385-404
        • Spiegelhalter D
        • Thomas A
        • Best N
        • Lunn D
        WinBUGS user manual version 1.4 January 2003. Upgraded to Version 1.4.3.
        ([Accessed July 20, 2010].)
        • Brooks SP
        • Gelman A
        Alternative methods for monitoring convergence of iterative simulations.
        J Comput Graph Stat. 1998; 7: 434-455
        • Cipriani A
        • Furukawa TA
        • Salanti G
        • et al.
        Comparative efficacy and acceptability of 12 new generation antidepressants: a multiple-treatments meta-analysis.
        Lancet. 2009; 373: 746-758
        • Sweeting MJ
        • Sutton AJ
        • Lambert PC
        What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data.
        Stat Med. 2004; 23: 1351-1375
        • Bradburn MJ
        • Deeks JJ
        • Berlin JA
        • Localio AR
        Much ado about nothing: a comparison of the performance of meta-analysis methods with rare events.
        Stat Med. 2006; 26: 53-77
        • Lu G
        • Ades A
        Modelling between-trial variance structure in mixed treatment comparisons.
        Biostatistics. 2009; 10: 792-805
        • Welton NJ
        • Ades AE
        Estimation of Markov chain transition probabilities and rates from fully and partially observed data: uncertainty propagation, evidence synthesis and model calibration.
        Med Decis Making. 2005; 25: 633-645
        • Lu G
        • Ades AE
        • Sutton AJ
        • et al.
        Meta-analysis of mixed treatment comparisons at multiple follow-up times.
        Stat Med. 2007; 26: 3681-3699
        • Welton NJ
        • Cooper NJ
        • Ades AE
        • et al.
        Mixed treatment comparison with multiple outcomes reported inconsistently across trials: evaluation of antivirals for treatment of influenza A and B.
        Stat Med. 2008; 27: 5620-5639