Biography
Richard Riley is a Professor of Biostatistics at Keele University, having previous held posts at the Universities of Birmingham, Liverpool and Leicester. He joined Keele in October 2014 and his role focuses on statistical and methodological research for prognosis and meta-analysis, whilst supporting clinical projects in these areas. He is also a Statistics Editor for the BMJ and a co-convenor of the Cochrane Prognosis Methods Group.
Richard co-leads a summer school in Prognosis Research Methods, and leads a number of statistical training courses for risk prediction and meta-analysis (see 'courses').
Research and scholarship
Richard is an expert on statistical methods for meta-analysis (the combination of results across multiple studies) and prognosis research (the study of future outcomes in those with existing disease). In meta-analysis, he specialises in methods for dealing with multiple correlated outcomes, and for synthesising individual participant data (IPD). In prognosis, Richard co-leads the PROGRESS initiative (PROGnosis RESearch Strategy), that seeks to improve the standards of prognosis research. This includes statistical methods to identify prognostic factors (markers), to develop and validate prognostic models (risk prediction models), and to identify predictors of treatment response for stratified medicine (predictive markers). He combines his meta-analysis and prognosis interests through the development and validation of prognostic models using IPD from multiple studies, and through meta-analysis of prognostic and predictive marker studies, especially in the cancer field. He has received numerous healthcare related grants, from funders including the MRC and NIHR, and has published over 100 applied and methodological research articles. He currently supervises 5 PhD students and co-supervises 3 others
Selected Publications
- 2022.
-
Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review. BMC Med Res Methodol, 101, vol. 22(1). link> doi> full text>2022.
-
Study protocol for the development and internal validation of Schizophrenia Prediction of Resistance to Treatment (SPIRIT): a clinical tool for predicting risk of treatment resistance to antipsychotics in first-episode schizophrenia. BMJ Open, e056420, vol. 12(4). link> doi> full text>2022.
-
MODERATORS OF THE EFFECT OF THERAPEUTIC EXERCISE FOR PEOPLE WITH KNEE AND/OR HIP OSTEOARTHRITIS: AN INDIVIDUAL PARTICIPANT DATA META-ANALYSIS. OSTEOARTHRITIS AND CARTILAGE (pp. S402-S403, vol. 30). link> doi> full text>2022.
-
Vitamin D supplementation for improving bone density in vitamin D-deficient children: a systematic review and individual participant data meta-analysis of randomized controlled trials. JOURNAL OF BONE AND MINERAL RESEARCH (p. 65, vol. 37). link> doi> full text>2022.
Full Publications Listshow
Journal Articles
- 2022.
-
Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review. BMC Med Res Methodol, 101, vol. 22(1). link> doi> full text>2022.
-
Study protocol for the development and internal validation of Schizophrenia Prediction of Resistance to Treatment (SPIRIT): a clinical tool for predicting risk of treatment resistance to antipsychotics in first-episode schizophrenia. BMJ Open, e056420, vol. 12(4). link> doi> full text>2022.
- 2022.
-
External validation of prognostic models to predict stillbirth using International Prediction of Pregnancy Complications (IPPIC) Network database: individual participant data meta-analysis. Ultrasound Obstet Gynecol, 209-219, vol. 59(2). link> doi> full text>2022.
- 2022.
-
Predicting relapse or recurrence of depression: systematic review of prognostic models. Br J Psychiatry, 1-11. link> doi> full text>2022.
-
Lessons learnt when accounting for competing events in the external validation of time-to-event prognostic models. Int J Epidemiol, 615-625, vol. 51(2). link> doi> full text>2022.
-
Minimum sample size calculations for external validation of a clinical prediction model with a time-to-event outcome. Stat Med, 1280-1295, vol. 41(7). link> doi> full text>2022.
-
GRADE concept paper 2: Concepts for judging certainty on the calibration of prognostic models in a body of validation studies. J Clin Epidemiol, 202-211, vol. 143. link> doi> full text>2022.
-
Case-finding and improving patient outcomes for chronic obstructive pulmonary disease in primary care: the BLISS research programme including cluster RCT. Programme Grants for Applied Research, 1-148, vol. 9(13). link> doi> link> full text>2021.
-
Risk of bias in studies on prediction models developed using supervised machine learning techniques: systematic review. BMJ, n2281, vol. 375. link> doi> full text>2021.
-
Developing clinical prediction models when adhering to minimum sample size recommendations: The importance of quantifying bootstrap variability in tuning parameters and predictive performance. Stat Methods Med Res, 2545-2561, vol. 30(12). link> doi> full text>2021.
-
Clinical Prediction Models in Sports Medicine: A Guide for Clinicians and Researchers. Journal of Orthopaedic and Sports Physical Therapy, 517-525, vol. 51(10). link> doi> link> full text>2021.
-
Predicting pain and function outcomes in people consulting with shoulder pain: the PANDA-S clinical cohort and qualitative study protocol. BMJ Open, e052758, vol. 11(9). link> doi> full text>2021.
-
A prognostic model, including quantitative fetal fibronectin, to predict preterm labour: the QUIDS meta-analysis and prospective cohort study. Health Technol Assess, 1-168, vol. 25(52). link> doi> full text>2021.
-
Applied meta-analysis with R and Stata. BIOMETRICAL JOURNAL, 1745-1746, vol. 63(8). link> doi> full text>2021.
-
A tutorial on individualized treatment effect prediction from randomized trials with a binary endpoint. Statistics in Medicine, 1-21. link> doi> link> full text>2021.
-
Prediction or causality? A scoping review of their conflation within current observational research. European Journal of Epidemiology. doi> full text>2021.
-
Research Note: Individual participant data (IPD) meta-analysis. J Physiother, 224-227, vol. 67(3). link> doi> full text>2021.
-
Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open, e048008, vol. 11(7). link> doi> full text>2021.
-
Development and validation of a risk prediction model of preterm birth for women with preterm labour symptoms (the QUIDS study): A prospective cohort study and individual participant data meta-analysis. PLoS Medicine, e1003686, vol. 18(7). link> doi> link> full text>2021.
-
Methods matter: clinical prediction models will benefit sports medicine practice, but only if they are properly developed and validated. Br J Sports Med, 1319-1321, vol. 55(23). link> doi> full text>2021.
-
The development and validation of a prognostic model to PREDICT Relapse of depression in adult patients in primary care: protocol for the PREDICTR study. Diagnostic and Prognostic Research, 12, vol. 5(1). link> doi> full text>2021.
-
Completeness of reporting of clinical prediction models developed using supervised machine learning: A systematic review. doi> full text>2021.
-
Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved. J Clin Epidemiol, 60-72, vol. 138. link> doi> full text>2021.
-
Diet and physical activity in pregnancy to prevent gestational diabetes: a protocol for an individual participant data (IPD) meta-analysis on the differential effects of interventions with economic evaluation. BMJ Open, e048119, vol. 11(6). link> doi> full text>2021.
-
External validation of a model to predict women most at risk of postpartum venous thromboembolism: Maternity clot risk. Thromb Res, 202-210, vol. 208. link> doi> full text>2021.
-
Methodology over metrics: Current scientific standards are a disservice to patients and society. Journal of Clinical Epidemiology. link> doi> full text>2021.
-
Predicting pain and function outcomes in people consulting with shoulder pain: The PANDA-S clinical cohort and qualitative study protocol (ISRCTN 46948079). doi> full text>2021.
-
Development and validation of a clinical prediction rule for development of diabetic foot ulceration: an analysis of data from five cohort studies. BMJ Open Diabetes Res Care, vol. 9(1). link> doi> full text>2021.
-
Minimum sample size for external validation of a clinical prediction model with a binary outcome. Stat Med, 4230-4251, vol. 40(19). link> doi> full text>2021.
-
PRIME-IPD SERIES Part 2. Retrieving, checking, and harmonizing data are underappreciated challenges in individual participant data meta-analyses. J Clin Epidemiol, 221-223, vol. 136. link> doi> full text>2021.
-
Developing more generalizable prediction models from pooled studies and large clustered data sets. Stat Med, 3533-3559, vol. 40(15). link> doi> full text>2021.
-
Prognostic models for predicting relapse or recurrence of major depressive disorder in adults. Cochrane Database Syst Rev, CD013491, vol. 5. link> doi> full text>2021.
-
Individual participant data meta-analysis for external validation, recalibration, and updating of a flexible parametric prognostic model. Statistics in Medicine, 3066-3084, vol. 40(13). link> doi> link> full text>2021.
-
Clinical prediction models: diagnosis versus prognosis. J Clin Epidemiol, 142-145, vol. 132. link> doi> full text>2021.
- 2021.
-
Community-based complex interventions to sustain independence in older people, stratified by frailty: a protocol for a systematic review and network meta-analysis. BMJ Open, e045637, vol. 11(2). link> doi> full text>2021.
-
External validation of clinical prediction models: simulation-based sample size calculations were more reliable than rules-of-thumb. J Clin Epidemiol, 79-89, vol. 135. link> doi> full text>2021.
-
Association between antihypertensive treatment and adverse events: systematic review and meta-analysis. BMJ, n189, vol. 372. link> doi> full text>2021.
-
Minimum sample size for external validation of a clinical prediction model with a continuous outcome. Stat Med, 133-146, vol. 40(1). link> doi> full text>2021.
-
Continual updating and monitoring of clinical prediction models: time for dynamic prediction systems?. Diagn Progn Res, 1, vol. 5(1). link> doi> full text>2021.
-
Sample sizes of prediction model studies in prostate cancer were rarely justified and often insufficient. J Clin Epidemiol, 53-60, vol. 133. link> doi> full text>2021.
-
A note on estimating the Cox-Snell R2 from a reported C statistic (AUROC) to inform sample size calculations for developing a prediction model with a binary outcome. Stat Med, 859-864, vol. 40(4). link> doi> full text>2021.
-
Penalization and shrinkage methods produced unreliable clinical prediction models especially when sample size was small. J Clin Epidemiol, 88-96, vol. 132. link> doi> full text>2021.
-
Validation and development of models using clinical, biochemical and ultrasound markers for predicting pre-eclampsia: an individual participant data meta-analysis. Health Technol Assess, 1-252, vol. 24(72). link> doi> full text>2020.
-
Protocol for a systematic review on the methodological and reporting quality of prediction model studies using machine learning techniques. BMJ Open, e038832, vol. 10(11). link> doi> full text>2020.
-
External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis. BMC Med, 302, vol. 18(1). link> doi> full text>2020.
-
Risk assessments and structured care interventions for prevention of foot ulceration in diabetes: development and validation of a prognostic model. Health Technology Assessment, 1-198, vol. 24(62). link> doi> link> full text>2020.
-
Clinical prediction models to predict the risk of multiple binary outcomes: a comparison of approaches. Stat Med, 498-517, vol. 40(2). link> doi> full text>2021.
-
Flaws in the development and validation of a covid-19 prediction model. Clinical Infectious Diseases. link> doi> link> full text>2020.
-
Can risk prediction models help us individualise stillbirth prevention? A systematic review and critical appraisal of published risk models. BJOG, 214-224, vol. 128(2). link> doi> full text>2021.
-
Testing small study effects in multivariate meta-analysis. Biometrics, 1240-1250, vol. 76(4). link> doi> full text>2020.
-
COVID-19 prediction models should adhere to methodological and reporting standards. Eur Respir J. link> doi> full text>2020.
-
The statistical importance of a study for a network meta-analysis estimate. BMC Med Res Methodol, 190, vol. 20(1). link> doi> full text>2020.
-
Doug Altman: Driving critical appraisal and improvements in the quality of methodological and medical research. Biom J, 226-246, vol. 63(2). link> doi> full text>2021.
-
Meta-analysis of continuous outcomes: using pseudo IPD created from aggregate data to adjust for baseline imbalance and assess treatment-by-baseline modification. Research Synthesis Methods. link> doi> link> full text>2020.
-
The Value of Preseason Screening for Injury Prediction: The Development and Internal Validation of a Multivariable Prognostic Model to Predict Indirect Muscle Injury Risk in Elite Football (Soccer) Players. Sports Med Open, 22, vol. 6(1). link> doi> full text>2020.
-
One-stage individual participant data meta-analysis models for continuous and binary outcomes: Comparison of treatment coding options and estimation methods. Stat Med, 2536-2555, vol. 39(19). link> doi> full text>2020.
-
Individual participant data meta-analysis to examine interactions between treatment effect and participant-level covariates: Statistical recommendations for conduct and planning. Stat Med, 2115-2137, vol. 39(15). link> doi> full text>2020.
-
Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ, m1328, vol. 369. link> doi> full text>2020.
-
Temporal recalibration for improving prognostic model development and risk predictions in settings where survival is improving over time. Int J Epidemiol, 1316-1325, vol. 49(4). link> doi> full text>2020.
-
Calculating the sample size required for developing a clinical prediction model. BMJ, m441, vol. 368. link> doi> full text>2020.
-
Individual participant data meta-analysis of intervention studies with time-to-event outcomes: A review of the methodology and an applied example. Res Synth Methods, 148-168, vol. 11(2). link> doi> full text>2020.
-
Predicting and preventing relapse of depression in primary care. Br J Gen Pract, 54-55, vol. 70(691). link> doi> full text>2020.
-
GRADE Guidelines 28: Use of GRADE for the assessment of evidence about prognostic factors: rating certainty in identification of groups of patients with different absolute risks. J Clin Epidemiol, 62-70, vol. 121. link> doi> full text>2020.
-
Galaxy Plot: A New Visualization Tool of Bivariate Meta-Analysis Studies. Am J Epidemiol. link> doi> full text>2020.
-
Accuracy of Vitalograph lung monitor as a screening test for COPD in primary care. npj Primary Care Respiratory Medicine, 2, vol. 30(1). link> doi> link> full text>2020.
-
Methods and reporting of systematic reviews of comparative accuracy were deficient: a methodological survey and proposed guidance. J Clin Epidemiol, 1-14, vol. 121. link> doi> full text>2020.
-
Prognostic models for predicting relapse or recurrence of depression. Cochrane Database of Systematic Reviews. doi> link> full text>2019.
-
Exercise treatment effect modifiers in persistent low back pain: an individual participant data meta-analysis of 3514 participants from 27 randomised controlled trials. Br J Sports Med, 1277-1278, vol. 54(21). link> doi> full text>2020.
-
Individual recovery expectations and prognosis of outcomes in non-specific low back pain: prognostic factor review. Cochrane Database Syst Rev, vol. 2019(11). link> doi> full text>2019.
-
Individual participant data validation of the PICNICC prediction model for febrile neutropenia. Arch Dis Child, 439-445, vol. 105(5). link> doi> full text>2020.
-
CORRECTION: Minimum sample size for developing a multivariable prediction model: Part II-binary and time-to-event outcomes by Riley RD, Snell KI, Ensor J, et al. (vol 38, pg 1276, 2019). STATISTICS IN MEDICINE. link> doi> full text>2019.
-
A study protocol for the development and internal validation of a multivariable prognostic model to determine lower extremity muscle injury risk in elite football (soccer) players, with further exploration of prognostic factors. Diagnostic and Prognostic Research, 19, vol. 3. link> doi> link> full text>2019.
-
Predictors of the effects of treatment for shoulder pain: protocol of an individual participant data meta-analysis. Diagnostic and Prognostic Research, 15, vol. 3. link> doi> link> full text>2019.
-
Development and validation of a prediction model for fat mass in children and adolescents: meta-analysis using individual participant data. BMJ, l4293, vol. 366. link> doi> full text>2019.
- 2019.
-
Model-based evaluation of the long-term cost-effectiveness of systematic case-finding for COPD in primary care. Thorax, 730-739, vol. 74(8). link> doi> link> full text>2019.
-
First-trimester ultrasound measurements and maternal serum biomarkers as prognostic factors in monochorionic twins: a cohort study. Diagn Progn Res, 9, vol. 3. link> doi> full text>2019.
-
Empirical comparison of univariate and multivariate meta-analyses in Cochrane Pregnancy and Childbirth reviews with multiple binary outcomes. Res Synth Methods, 440-451, vol. 10(3). link> doi> full text>2019.
-
Guide to presenting clinical prediction models for use in clinical settings. BMJ, l737, vol. 365. link> doi> full text>2019.
-
A guide to systematic review and meta-analysis of prognostic factor studies. BMJ, k4597, vol. 364. link> doi> full text>2019.
-
PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann Intern Med, W1-W33, vol. 170(1). link> doi> full text>2019.
-
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 51-58, vol. 170(1). link> doi> full text>2019.
-
Development and validation of prediction models to estimate risk of primary total hip and knee replacements using data from the UK: two prospective open cohorts using the UK Clinical Practice Research Datalink. Ann Rheum Dis, 91-99, vol. 78(1). link> doi> full text>2019.
-
Minimum sample size for developing a multivariable prediction model: PART II - binary and time-to-event outcomes. Stat Med, 1276-1296, vol. 38(7). link> doi> full text>2019.
-
Minimum sample size for developing a multivariable prediction model: Part I - Continuous outcomes. Stat Med, 1262-1275, vol. 38(7). link> doi> full text>2019.
-
Development and validation of prediction models to estimate risk of primary total hip and knee replacements using data from the UK: two prospective open cohorts using the UK Clinical Practice Research Datalink. Annals of the Rheumatic Diseases. doi> full text>2018.
-
Factors affecting local regrowth after watch and wait for patients with a clinical complete response following chemoradiotherapy in rectal cancer (InterCoRe consortium): an individual participant data meta-analysis. Lancet Gastroenterol Hepatol, 825-836, vol. 3(12). link> doi> full text>2018.
-
Factors affecting local regrowth after watch and wait for patients with a clinical complete response following chemoradiotherapy in rectal cancer (InterCoRe consortium): an individual participant data meta-analysis (vol 3, pg 825, 2018). LANCET GASTROENTEROLOGY & HEPATOLOGY, E1, vol. 4(2). link> doi> full text>2019.
-
Implementing systematic reviews of prognosis studies in Cochrane. Cochrane Database Syst Rev, ED000129, vol. 10. link> doi> full text>2018.
-
Persistent sex disparities in clinical outcomes with percutaneous coronary intervention: Insights from 6.6 million PCI procedures in the United States. PLoS One, e0203325, vol. 13(9). link> doi> full text>2018.
-
Protease activity as a prognostic factor for wound healing in venous leg ulcers. Cochrane Database Syst Rev, CD012841, vol. 9. link> doi> full text>2018.
-
Factor influencing local regrowth after watch-and-wait for clinical complete response following chemoradiotherapy in rectal cancer: an individual participant data meta-analysis (InterCoRe consortium). The Lancet Gastroenterology and Hepatology. link> doi> link> full text>
-
Individual participant data meta-analysis of continuous outcomes: A comparison of approaches for specifying and estimating one-stage models. Stat Med, 4404-4420, vol. 37(29). link> doi> full text>2018.
-
A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes. Stat Methods Med Res, 2768-2786, vol. 28(9). link> doi> full text>2019.
-
Temporal Changes in Co-Morbidity Burden in Patients Having Percutaneous Coronary Intervention and Impact on Prognosis. Am J Cardiol, 712-722, vol. 122(5). link> doi> full text>2018.
-
Measurement error and timing of predictor values for multivariable risk prediction models are poorly reported. J Clin Epidemiol, 38-49, vol. 102. link> doi> full text>2018.
-
Simulation-based power calculations for planning a two-stage individual participant data meta-analysis. BMC Med Res Methodol, 41, vol. 18(1). link> doi> full text>2018.
-
Periodic Health Examination and Injury Prediction in Professional Football (Soccer): Theoretically, the Prognosis is Good. Sports Med, 2443-2448, vol. 48(11). link> doi> full text>2018.
-
Study protocol: quantitative fibronectin to help decision-making in women with symptoms of preterm labour (QUIDS) part 2, UK Prospective Cohort Study. BMJ Open, e020795, vol. 8(4). link> doi> full text>2018.
-
Quantitative fibronectin to help decision-making in women with symptoms of preterm labour (QUIDS) part 1: Individual participant data meta-analysis and health economic analysis. BMJ Open, e020796, vol. 8(4). link> doi> full text>2018.
-
Random-effects meta-analysis of the clinical utility of tests and prediction models. Stat Med, 2034-2052, vol. 37(12). link> doi> full text>2018.
-
The role of secondary outcomes in multivariate meta-analysis. J R Stat Soc Ser C Appl Stat, 1177-1205, vol. 67(5). link> doi> full text>2018.
-
Does vitamin D supplementation improve bone density in vitamin D-deficient children? Protocol for an individual patient data meta-analysis. BMJ Open, e019584, vol. 8(1). link> doi> full text>2018.
-
Subgrouping and TargetEd Exercise pRogrammes for knee and hip OsteoArthritis (STEER OA): a systematic review update and individual participant data meta-analysis protocol. BMJ Open, e018971, vol. 7(12). link> doi> full text>2017.
-
An improved method for bivariate meta-analysis when within-study correlations are unknown. Res Synth Methods, 73-88, vol. 9(1). link> doi> full text>2018.
-
Detecting small-study effects and funnel plot asymmetry in meta-analysis of survival data: A comparison of new and existing tests. Res Synth Methods, 41-50, vol. 9(1). link> doi> full text>2018.
-
Guidance for deriving and presenting percentage study weights in meta-analysis of test accuracy studies. Res Synth Methods, 163-178, vol. 9(2). link> doi> full text>2018.
-
Meta-analysis of test accuracy studies using imputation for partial reporting of multiple thresholds. Res Synth Methods, 100-115, vol. 9(1). link> doi> full text>2018.
-
External validation, update and development of prediction models for pre-eclampsia using an Individual Participant Data (IPD) meta-analysis: the International Prediction of Pregnancy Complication Network (IPPIC pre-eclampsia) protocol. Diagn Progn Res, 16, vol. 1. link> doi> full text>2017.
-
Measuring the statistical validity of summary meta-analysis and meta-regression results for use in clinical practice. Stat Med, 3283-3301, vol. 36(21). link> doi> full text>2017.
-
Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples. BMJ, j3932, vol. 358. link> doi> full text>2017.
-
A matrix-based method of moments for fitting multivariate network meta-analysis models with multiple outcomes and random inconsistency effects. Biometrics, 548-556, vol. 74(2). link> doi> full text>2018.
-
Effects of antenatal diet and physical activity on maternal and fetal outcomes: individual patient data meta-analysis and health economic evaluation. Health Technol Assess, 1-158, vol. 21(41). link> doi> full text>2017.
-
A random effects meta-analysis model with Box-Cox transformation. BMC Med Res Methodol, 109, vol. 17(1). link> doi> full text>2017.
-
Effect of diet and physical activity based interventions in pregnancy on gestational weight gain and pregnancy outcomes: meta-analysis of individual participant data from randomised trials The International Weight Management in Pregnancy (i-WIP) Collaborative Group. BMJ-BRITISH MEDICAL JOURNAL, Article ARTN j3119, vol. 358. link> doi> full text>2017.
- 2017.
-
Association of maternal serum PAPP-A levels, nuchal translucency and crown rump length in first trimester with adverse pregnancy outcomes: Retrospective cohort study. Prenatal Diagnosis. link> doi> full text>2017.
-
Meta-analysis of prediction model performance across multiple studies: Which scale helps ensure between-study normality for the C-statistic and calibration measures?. Stat Methods Med Res, 962280217705678. link> doi> link> full text>2017.
-
Development and validation of Prediction models for Risks of complications in Early-onset Pre-eclampsia (PREP): a prospective cohort study. Health Technology Assessment, 1-100, vol. 21(18). link> doi> link> full text>2017.
-
Prediction of complications in early-onset pre-eclampsia (PREP): development and external multinational validation of prognostic models. BMC Med, 68, vol. 15(1). link> doi> full text>2017.
-
Is the first urinary albumin/creatinine ratio (ACR) in women with suspected pre-eclampsia a prognostic factor for maternal and neonatal adverse outcome? A retrospective cohort study. Acta Obstetricia et Gynecologica Scandinavica. link> doi> link> full text>2017.
-
Development and validation of prediction models for risk of adverse outcomes in women with early-onset pre-eclampsia: protocol of the prospective cohort PREP study. Diagn Progn Res, 6, vol. 1. link> doi> full text>2017.
-
Prognosis research ideally should measure time-varying predictors at their intended moment of use. Diagn Progn Res, 1, vol. 1. link> doi> full text>2017.
-
Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models. Stat Methods Med Res, 2885-2905, vol. 27(10). link> doi> full text>2018.
-
A guide to systematic review and meta-analysis of prediction model performance. BMJ, i6460, vol. 356. link> doi> full text>2017.
-
Development and validation of risk prediction model for venous thromboembolism in postpartum women: multinational cohort study. BMJ, i6253, vol. 355. link> doi> full text>2016.
-
One-stage individual participant data meta-analysis models: estimation of treatment-covariate interactions must avoid ecological bias by separating out within-trial and across-trial information. Stat Med, 772-789, vol. 36(5). link> doi> full text>2017.
-
Meta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ. Stat Med, 855-875, vol. 36(5). link> doi> full text>2017.
-
Random effects meta-analysis: Coverage performance of 95% confidence and prediction intervals following REML estimation. Stat Med, 301-317, vol. 36(2). link> doi> full text>2017.
- 2016.
-
Early clinical features in Systemic Lupus Erythematosus: can they be used to achieve earlier diagnosis? A risk prediction model. Arthritis care & research. doi> link> full text>2016.
-
Targeted case finding for chronic obstructive pulmonary disease versus routine practice in primary care (TargetCOPD): a cluster-randomised controlled trial. Lancet Respir Med, 720-730, vol. 4(9). link> doi> full text>2016.
-
Cohort Profile: The Birmingham Chronic Obstructive Pulmonary Disease (COPD) Cohort Study. Int J Epidemiol, 23, vol. 46(1). link> doi> full text>2017.
-
Predicting microbiologically defined infection in febrile neutropenic episodes in children: global individual participant data multivariable meta-analysis. Br J Cancer, e17, vol. 114(12). link> doi> full text>2016.
-
External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges. BMJ, i3140, vol. 353. link> doi> full text>2016.
-
Systematic review of prognostic models for recurrent venous thromboembolism (VTE) post-treatment of first unprovoked VTE. BMJ Open, e011190, vol. 6(5). link> doi> full text>2016.
-
Explicit inclusion of treatment in prognostic modeling was recommended in observational and randomized settings. J Clin Epidemiol, 90-100, vol. 78. link> doi> full text>2016.
-
Bayesian bivariate meta-analysis of correlated effects: Impact of the prior distributions on the between-study correlation, borrowing of strength, and joint inferences. Statistical methods in medical research. doi> link> full text>2016.
-
Risk of Late Relapse or Reinfection With Hepatitis C Virus After Achieving a Sustained Virological Response: A Systematic Review and Meta-analysis. Clin Infect Dis, 683-694, vol. 62(6). link> doi> full text>2016.
-
Predicting microbiologically defined infection in febrile neutropenic episodes in children: global individual participant data multivariable meta-analysis. British Journal of Cancer, 623-630, vol. 114(6). link> doi> link> full text>2016.
-
Self-management of health care behaviors for COPD: a systematic review and meta-analysis. Int J Chron Obstruct Pulmon Dis, 305-326, vol. 11. link> doi> full text>2016.
-
Prediction of risk of recurrence of venous thromboembolism following treatment for a first unprovoked venous thromboembolism: systematic review, prognostic model and clinical decision rule, and economic evaluation. Health Technol Assess, i-190, vol. 20(12). link> doi> full text>2016.
- 2016.
- 2015.
- 2015.
- 2017.
-
Bayesian meta-analytical methods to incorporate multiple surrogate endpoints in drug development process. Stat Med, 1063-1089, vol. 35(7). link> doi> full text>2016.
- 2015.
- 2015.
- 2015.
-
Multivariate meta-analysis of prognostic factor studies with multiple cut-points and/or methods of measurement. Stat Med, 2481-2496, vol. 34(17). link> doi> full text>2015.
-
Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use. PLoS Med, e1001855, vol. 12(7). link> doi> full text>2015.
-
Performance of methods for meta-analysis of diagnostic test accuracy with few studies or sparse data. Stat Methods Med Res, 1896-1911, vol. 26(4). link> doi> full text>2017.
-
Summarising and validating test accuracy results across multiple studies for use in clinical practice. Stat Med, 2081-2103, vol. 34(13). link> doi> full text>2015.
-
Multivariate meta-analysis using individual participant data. Res Synth Methods, 157-174, vol. 6(2). link> doi> full text>2015.
-
Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model. J Clin Epidemiol, 40-50, vol. 69. link> doi> full text>2016.
- 2015.
- 2015.
-
The prognostic utility of tests of platelet function for the detection of 'aspirin resistance' in patients with established cardiovascular or cerebrovascular disease: a systematic review and economic evaluation. Health Technol Assess, 1-366, vol. 19(37). link> doi> full text>2015.
- 2015.
- 2015.
- 2015.
- 2015.
-
Meta-analysis of test accuracy studies: an exploratory method for investigating the impact of missing thresholds. Syst Rev, 12, vol. 4. link> doi> full text>2015.
- 2015.
-
The science of clinical practice: disease diagnosis or patient prognosis? Evidence about "what is likely to happen" should shape clinical practice. BMC Med, 20, vol. 13. link> doi> full text>2015.
- 2014.
- 2014.
- 2014.
- 2015.
- 2015.
- 2014.
- 2014.
-
Individual recovery expectations and prognosis of outcomes in non-specific low back pain: prognostic factor exemplar review. Cochrane Database of Systematic Reviews. doi>
-
Improving the transparency of prognosis research: the role of reporting, data sharing, registration, and protocols. PLoS Med, e1001671, vol. 11(7). link> doi> full text>2014.
-
Feasibility trial of GP and case-managed support for workplace sickness absence. Primary Health Care Research and Development, 252-261, vol. 15(3). link> doi> link> full text>2014.
-
Red blood cell transfusion and mortality in trauma patients: risk-stratified analysis of an observational study. PLoS Med, e1001664, vol. 11(6). link> doi> full text>2014.
- 2014.
- 2014.
- 2014.
- 2014.
- 2014.
- 2014.
- 2013.
- 2014.
- 2013.
- 2013.
- 2013.
- 2013.
- 2013.
-
Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med, e1001381, vol. 10(2). link> doi> full text>2013.
- 2013.
- 2013.
- 2013.
- 2013.
- 2013.
- 2013.
- 2012.
-
2012. Diagnostic Accuracy of Spot Urinary Protein and Albumin to Creatinine Ratios for Detection of Significant Proteinuria or Adverse Pregnancy Outcome in Patients With Suspected Pre-eclampsia: Systematic Review and Meta-Analysis EDITORIAL COMMENT. OBSTETRICAL & GYNECOLOGICAL SURVEY, 681-682, vol. 67(11). link> doi>
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2012.
- 2011.
- 2011.
- 2011.
- 2011.
- 2011.
- 2011.
- 2010.
- 2010.
- 2010.
- 2010.
- 2010.
- 2009.
- 2009.
- 2004.
- 2009.
- 2009.
- 2009.
- 2008.
- 2008.
- 2007.
- 2008.
- 2007.
- 2007.
- 2006.
- 2006.
- 2007.
- 2005.
- 2005.
- 2004.
- 2004.
- 2003.
- 2003.
- 2001.
-
Can prognostic factors for indirect muscle injuries in elite football (soccer) players be identified using data from preseason screening? An exploratory analysis using routinely-collected periodic health examination records. doi> full text>
Other
-
MODERATORS OF THE EFFECT OF THERAPEUTIC EXERCISE FOR PEOPLE WITH KNEE AND/OR HIP OSTEOARTHRITIS: AN INDIVIDUAL PARTICIPANT DATA META-ANALYSIS. OSTEOARTHRITIS AND CARTILAGE (pp. S402-S403, vol. 30). link> doi> full text>2022.
-
Vitamin D supplementation for improving bone density in vitamin D-deficient children: a systematic review and individual participant data meta-analysis of randomized controlled trials. JOURNAL OF BONE AND MINERAL RESEARCH (p. 65, vol. 37). link> doi> full text>2022.
-
Why are Machine Learning-based prediction models still unpopular in clinical practice?. Diagnostic and Prognostic Research. doi> link> full text>2021.
- 2019.
- 2019.
- 2016.
-
782: Development and validation of a predication model for the risk of adverse outcomes in women with early onset preeclampsia (PREP): prospective cohort study. American Journal of Obstetrics and Gynecology. Elsevier. doi>2015.
-
Reviewing the evidence supporting predictive biomarkers in European medicines agency indications and contraindications using visual plots. TRIALS (vol. 16). link> doi> full text>2015.
- 2015.
-
The prognostic utility of platelet function testing for the detection of 'aspirin resistance' in patients with established cardiovascular disease. JOURNAL OF THROMBOSIS AND HAEMOSTASIS (p. 515, vol. 13). link>2015.
-
TargetCOPD: A Pragmatic Randomised Controlled Trial Of Targeted Case Finding For COPD Versus Routine Practice In Primary Care. AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE (vol. 191). link>2015.
- 2013.
-
Is it safe to wake up? Defining the prognostic value of the morning blood pressure surge in clinical practice. JOURNAL OF HUMAN HYPERTENSION (p. 647, vol. 27). link>2013.
-
Use of Liver Fibrosis biomarkers to predict clinical outcomes- A Systematic Review and Meta-analysis. HEPATOLOGY (pp. 1196A-1197A, vol. 58). link>2013.
-
Detecting undiagnosed COPD: Using routine primary care data to select and validate candidate variables for COPD risk prediction. EUROPEAN RESPIRATORY JOURNAL (vol. 42). link>2013.
- 2013.
-
EXCISION REPAIR CROSS-COMPLEMENTATION GROUP 1 (ERCC1) STATUS AND NON-SMALL CELL LUNG CANCER (NSCLC) OUTCOMES: A META-ANALYSIS OF PUBLISHED STUDIES AND RECOMMENDATIONS. JOURNAL OF THORACIC ONCOLOGY (pp. S438-S439, vol. 6). link>2011.
-
How to design a meta-analysis in biomarkers. JOURNAL OF THORACIC ONCOLOGY (pp. S78-S79, vol. 4). link>2009.
-
Where next for evidence synthesis of prognostic marker studies? Improving the quality and reporting of primary studies to facilitate clinically relevant evidence-based results. ADVANCES IN STATISTICAL METHODS FOR THE HEALTH SCIENCES: APPLICATIONS TO CANCER AND AIDS STUDIES, GENOME SEQUENCE ANALYSIS, AND SURVIVAL ANALYSIS (pp. 39-+). link> doi>2007.
Courses
Richard delivers five training courses:
(1) PROGNOSIS RESEARCH: CONCEPTS, METHODS AND CLINICAL APPLICATION
Prognosis research provides information crucial to understanding, explaining and predicting future clinical outcomes in people with existing disease or health conditions. This 3-day course is designed to introduce the key components of prognosis research to health professionals and researchers, including: (i) a framework of different prognosis research questions (overall prognosis, prognostic factors, prognostic models, and stratified medicine); (ii) key principles of study design and methods; (iii) interpretation of statistical results about prognosis; and (iv) the limitations of current prognosis research, and how the field can be improved. The course is based on 4 articles published in BMJ/PLOS Medicine (February 2013) and course combines seminars and lectures by international experts in the field (Prof. Harry Hemingway, Prof. Douglas Altman, Prof. Richard Riley, Prof. Danielle van der Windt, Dr. Kate Dunn, Dr. Pablo Perel) with group work and case studies. For more information and registration: http://progress-partnership.org/training/2016-summer-school/
(2) STATISTICAL METHODS FOR INDIVIDUAL PARTICIPANT DATA (IPD) META-ANALYSIS
The course covers the fundamental statistical methods and principles for meta-analysis when IPD (Individual Participant/Patient Data) are available from multiple related studies. The course considers continuous, binary and time-to-event outcomes. It focuses mainly on the synthesis of randomised trials of interventions, and how to estimate treatment effects and treatment-covariate interactions (effect modifiers). However, it also covers the issues for IPD meta-analysis of observational studies examining prognostic factors and risk prediction (prognostic) models. Methods for examining bias in IPD meta-analyses is also described, alongside approaches for combining IPD and non-IPD studies. Key messages are illustrated with real examples, and participants get the chance to conduct a variety of IPD analyses within STATA, to practice the key methods and to reinforce the learning points. The course assumes an understanding of regression methods (such as linear, logistic, and Cox) and the basic principles of traditional meta-analysis methods that synthesise only published results. This course is booked for December 6-7 2016. You can register for the course here .
(3) STATISTICAL METHODS FOR RISK PREDICTION & PROGNOSTIC MODELS
Patients and their care providers often want to know the risk of developing an (adverse) health outcome over time. Estimates of future risk ('prognosis') allow patients and their families to put a clinical diagnosis in context, and inform clinical decisions and treatment strategies. For this purpose there is a growing interest in risk prediction and prognostic models, which are statistical models that estimate an individual's outcome risk. This 3-day course provides a thorough foundation of statistical methods for developing and/or validating prognostic models in clinical research. For model development, we cover the use of logistic regression, Cox regression, and flexible parametric survival models; sample size, identification of candidate predictors, and selection procedures; handling missing data, including multiple imputation; handling of continuous predictors, including restricted cubic splines and fractional polynomial approaches; bootstrapping and shrinkage to adjust for optimism in apparent model performance; and complexities in the data, such as competing risks and recurrent events. For model validation, we cover internal and external validation; statistical measures of discrimination (including the C-statistic and D-statistic); statistical measures for calibration (such as the calibration slope and calibration-in-the-large); and re-calibration techniques. 'Hot topics' will also be covered on the final day, including the development and validation of prognostic models using large databases (e.g. from e-health records) or individual participant data from multiple studies; systematic reviews of prognostic model studies, including examining risk of bias; and meta-analysis methods for summarising the performance of prognostic models across multiple studies. The course is aimed at researchers who want to understand and implement core statistical methods for the development and validation of a prognostic model. There will be a mixture of lectures and computer practical work. Participants need to bring a laptop with STATA version 12 or above. The course is planned to run in April 2017, and the course will be announced formally in September 2016, but for more information contact: r.riley@keele.ac.uk
(4) AN INTROUDUCTION TO STATISTICAL METHODS FOR META-ANALYSIS
This course covers the basic principles for undertaking a meta-analysis of results extracted from the literature. It focuses mainly on the synthesis of results from randomised trials of interventions, but also includes discussion of prognostic factor studies and diagnostic test studies. The course covers the process of data extraction, and the concept of fixed-effect and random-effects meta-analysis models. Continuous, binary and time-to-event outcomes are covered, and the core meta-analysis methods are covered, such as inverse-variance, Dersimonian and Laird (random effects), and exact likelihood methods for binary data. It also explains how to interpret the summary results from a meta-analysis, and display them appropriately using forest plots, confidence intervals, and prediction intervals. Methods for examining potential publication bias are covered, including contour-enhanced funnel plots and tests for asymmetry. Meta-regression is also detailed, for examining treatment-covariate interaction, and the threat of ecological bias and potential advantages of individual participant data are discussed. The course is a mixture of lectures and small group practicals. STATA will be used to demonstrate the key methods. For more information or if you would like this course run for your team, contact: r.riley@keele.ac.uk
(5) AN INTRODUCTION TO MULTIVARIATE META-ANALYSIS
Many primary studies have more than one outcome of interest, such as disease-free survival and overall survival, and researchers usually meta-analyse each outcome separately. However, such multiple outcomes are often related to each other, i.e. they are correlated. For example, a patient’s time to recurrence of disease is generally associated with their time of death. By meta-analysing each outcome independently, researchers ignore this correlation and thus lose potentially valuable information. In this course, we show how a multivariate meta-analysis can jointly analyse multiple outcomes and account for their correlation. We show why this gets the most out of the available data, and leads to advantages over standard univariate methods (which analyse each outcome separately). The course covers topics such as: univariate & multivariate model specification, model estimation, obtaining within-study correlations, multivariate heterogeneity statistics, use of individual participant data, advantages, applications, and limitations. A full demonstration of the freely available 'mvmeta' module in STATA is also provided, so as to give researchers confidence to apply the multivariate approach in practice. Application areas include diagnostic tests, prognostic factors, treatment effects, multiple outcomes, trend estimation, and trials with outcome reporting bias. Use of multivariate meta-analysis for network meta-analysis (i.e. the joint synthesis of multiple treatments) is also briefly covered. A reasonable grounding in statistics is assumed. Some knowledge of meta-analysis and randomised controlled trials would be of help, but is not essential. The day begins with an overview of the basics of univariate meta-analysis methods, before then extending to the multivariate setting.
For more information or if you would like this course run for your team, please contact: r.riley@keele.ac.uk
School of Medicine
David Weatherall building
University Road
Keele University
Staffordshire
ST5 5BG
Tel: +44 (0) 1782 733937
Email: medicine.reception@keele.ac.uk
Admissions enquiries: enquiries@keele.ac.uk