Integrating Quality Assurance and Quality Improvement With Guidelines: Systematic Stakeholder-Driven Development of an Extension of the Guidelines International Network-McMaster Guideline Development Checklist

Ideas and OpinionsMay 2022Integrating Quality Assurance and Quality Improvement With Guidelines: Systematic Stakeholder-Driven Development of an Extension of the Guidelines International Network–McMaster Guideline Development ChecklistThomas Piggott, MD, MSc, Miranda W. Langendam, PhD, Elena Parmelli, PhD, Jan Adolfsson, MD, PhD, Elie A. Akl, MD, MPH, PhD, David Armstrong, MA, MB BChir, Jeffrey Braithwaite, PhD, Romina Brignardello-Petersen, DDS, MSc, PhD, Jan Brozek, MD, PhD, Markus Follmann, MD, MPH, MSc, Ina Kopp, MD, Joerg J. Meerpohl, MD, Luciana Neamtiu, PhD, Monika Nothacker, MD, MPH, Amir Qaseem, MD, PhD, MHA, Paolo Giorgi Rossi, PhD, Zuleika Saz-Parkinson, PhD, MS, Philip J. van der Wees, PhD, and Holger J. Schünemann, MD, PhD, MScThomas Piggott, MD, MScDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada (T.P., R.B., J.B.)Search for more papers by this author, Miranda W. Langendam, PhDDepartment of Epidemiology and Data Science, Amsterdam UMC, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands (M.W.L.)Search for more papers by this author, Elena Parmelli, PhDEuropean Commission, Joint Research Centre (JRC), Ispra, Italy (E.P., L.N., Z.S.)Search for more papers by this author, Jan Adolfsson, MD, PhDSwedish Agency for Health Technology Assessment and Assessment of Social Services, and Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden (J.A.)Search for more papers by this author, Elie A. Akl, MD, MPH, PhDDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada, and American University of Beirut, Beirut, Lebanon (E.A.A.)Search for more papers by this author, David Armstrong, MA, MB BChirFarncombe Family Digestive Health Research Institute and Department of Medicine, McMaster University, Hamilton, Ontario, Canada (D.A.)Search for more papers by this author, Jeffrey Braithwaite, PhDAustralian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia (J.B.)Search for more papers by this author, Romina Brignardello-Petersen, DDS, MSc, PhDDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada (T.P., R.B., J.B.)Search for more papers by this author, Jan Brozek, MD, PhDDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada (T.P., R.B., J.B.)Search for more papers by this author, Markus Follmann, MD, MPH, MScGerman Cancer Society, Berlin, Germany (M.F.)Search for more papers by this author, Ina Kopp, MDInstitute for Medical Knowledge Management, Association of the Scientific Medical Societies, Philipps-University, Marburg, Germany (I.K., M.N.)Search for more papers by this author, Joerg J. Meerpohl, MDInstitute for Evidence in Medicine, Medical Center and Faculty of Medicine, University of Freiburg, and Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany (J.J.M.)Search for more papers by this author, Luciana Neamtiu, PhDEuropean Commission, Joint Research Centre (JRC), Ispra, Italy (E.P., L.N., Z.S.)Search for more papers by this author, Monika Nothacker, MD, MPHInstitute for Medical Knowledge Management, Association of the Scientific Medical Societies, Philipps-University, Marburg, Germany (I.K., M.N.)Search for more papers by this author, Amir Qaseem, MD, PhD, MHAAmerican College of Physicians, Philadelphia, Pennsylvania (A.Q.)Search for more papers by this author, Paolo Giorgi Rossi, PhDEpidemiology Unit, Azienda Unità Sanitaria Locale - IRCCS di Reggio Emilia, Reggio Emilia, Italy (P.G.R.)Search for more papers by this author, Zuleika Saz-Parkinson, PhD, MSEuropean Commission, Joint Research Centre (JRC), Ispra, Italy (E.P., L.N., Z.S.)Search for more papers by this author, Philip J. van der Wees, PhDRadboud University Medical Center, Department of IQ Healthcare and Rehabilitation, Nijmegen, the Netherlands (P.J.V.)Search for more papers by this author, and Holger J. Schünemann, MD, PhD, MScDepartment of Health Research Methods, Evidence, and Impact and Department of Medicine, McMaster University, Hamilton, Ontario, Canada, Institute for Evidence in Medicine, Medical Center and Faculty of Medicine, University of Freiburg, Freiburg, Germany, and Dipartimento di Scienze Biomediche, Humanitas University, Milan, Italy (H.J.S.).Search for more papers by this authorAuthor, Article, and Disclosure Informationhttps://doi.org/10.7326/M21-3977 SectionsAboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail Practice guidelines and quality assurance and improvement (QAI) schemes are 2 sides of the same coin for improving health outcomes (1). One frequently cited set of characteristics specifies that a good quality indicator should be relevant, understandable, measurable, behaviorable, and achievable (the RUMBA rule) (2). However, we suggest that the characteristics of candidate quality indicators should include the following: 1) certainty, also known as scientific soundness (high-certainty evidence supporting selection is at low risk of bias, precise, direct, relevant, consistent, and without publication bias); 2) responsiveness or sensitivity to change; and 3) feasibility to measure, implement, and monitor. Thus, an ...References1. Parmelli E, Langendam M, Piggott T, et al. Guideline-based quality assurance: a conceptual framework for the definition of key elements. BMC Health Serv Res. 2021;21:173. [PMID: 33627092] doi:10.1186/s12913-021-06148-2 CrossrefMedlineGoogle Scholar2. Braun JP, Mende H, Bause H, et al; NeQuI (quality network in intensive care medicine). Quality indicators in intensive care medicine: why? Use or burden for the intensivist. Ger Med Sci. 2010;8:Doc22. [PMID: 21063472] doi:10.3205/000111 CrossrefMedlineGoogle Scholar3. MacLean CH, Kerr EA, Qaseem A. Time out—charting a path for improving performance measurement. N Engl J Med. 2018;378:1757-61. [PMID: 29668361] doi:10.1056/NEJMp1802595 CrossrefMedlineGoogle Scholar4. Schünemann HJ, Lerda D, Dimitrova N, et al; European Commission Initiative on Breast Cancer Contributor Group. Methods for development of the European Commission Initiative on Breast Cancer guidelines: recommendations in the era of guideline transparency. Ann Intern Med. 2019;171:273-80. [PMID: 31330534] doi:10.7326/M18-3445 LinkGoogle Scholar5. Piggott T, Langendam M, Parmelli E, et al. Bringing two worlds closer together: a critical analysis of an integrated approach to guideline development and quality assurance schemes. BMC Health Serv Res. 2021;21:172. [PMID: 33627104] doi:10.1186/s12913-020-05819-w CrossrefMedlineGoogle Scholar6. Langendam MW, Piggott T, Nothacker M, et al. Approaches of integrating the development of guidelines and quality indicators: a systematic review. BMC Health Serv Res. 2020;20:875. [PMID: 32938461] doi:10.1186/s12913-020-05665-w CrossrefMedlineGoogle Scholar7. Schünemann HJ, Wiercioch W, Etxeandia I, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186:E123-E142. [PMID: 24344144] doi:10.1503/cmaj.131237 CrossrefMedlineGoogle Scholar8. Nothacker M, Stokes T, Shaw B, et al; Guidelines International Network (G-I-N) Performance Measures Working Group. Reporting standards for guideline-based performance measures. Implement Sci. 2016;11:6. [PMID: 26772173] doi:10.1186/s13012-015-0369-z CrossrefMedlineGoogle Scholar9. Morgan RL, Florez I, Falavigna M, et al. Development of rapid guidelines: 3. GIN-McMaster guideline development checklist extension for rapid recommendations. Health Res Policy Syst. 2018;16:63. [PMID: 30005679] doi:10.1186/s12961-018-0330-0 CrossrefMedlineGoogle Scholar10. Petkovic J, Riddle A, Akl EA, et al. Protocol for the development of guidance for stakeholder engagement in health and healthcare guideline development and implementation. Syst Rev. 2020;9:21. [PMID: 32007104] doi:10.1186/s13643-020-1272-5 CrossrefMedlineGoogle Scholar Author, Article, and Disclosure InformationAffiliations: Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada (T.P., R.B., J.B.)Department of Epidemiology and Data Science, Amsterdam UMC, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands (M.W.L.)European Commission, Joint Research Centre (JRC), Ispra, Italy (E.P., L.N., Z.S.)Swedish Agency for Health Technology Assessment and Assessment of Social Services, and Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden (J.A.)Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada, and American University of Beirut, Beirut, Lebanon (E.A.A.)Farncombe Family Digestive Health Research Institute and Department of Medicine, McMaster University, Hamilton, Ontario, Canada (D.A.)Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia (J.B.)German Cancer Society, Berlin, Germany (M.F.)Institute for Medical Knowledge Management, Association of the Scientific Medical Societies, Philipps-University, Marburg, Germany (I.K., M.N.)Institute for Evidence in Medicine, Medical Center and Faculty of Medicine, University of Freiburg, and Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany (J.J.M.)American College of Physicians, Philadelphia, Pennsylvania (A.Q.)Epidemiology Unit, Azienda Unità Sanitaria Locale - IRCCS di Reggio Emilia, Reggio Emilia, Italy (P.G.R.)Radboud University Medical Center, Department of IQ Healthcare and Rehabilitation, Nijmegen, the Netherlands (P.J.V.)Department of Health Research Methods, Evidence, and Impact and Department of Medicine, McMaster University, Hamilton, Ontario, Canada, Institute for Evidence in Medicine, Medical Center and Faculty of Medicine, University of Freiburg, Freiburg, Germany, and Dipartimento di Scienze Biomediche, Humanitas University, Milan, Italy (H.J.S.).Acknowledgment: The authors thank the following workshop participants for their contributions to this work: Jane Beaumont (independent consultant for accreditation and certification), Jola Gore-Booth (EuropaColon [patient representative], United Kingdom), Zbigniew Les (formerly of EvidencePrime, Poland), Susan Norris (formerly of the World Health Organization, Switzerland), and Mariano Tomatis (freelance information technology specialist with a degree in computer science working for hospital quality assurance systems).Financial Support: This project was funded by the European Commission (CT-EX2016D289038-102) under the umbrella of the ECIBC and the ECICC. The funder supported travel to complete this work and reviewed the final manuscript.Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M21-3977.Corresponding Authors: Holger J. Schünemann, MD, PhD, MSc, Department of Health Research Methods, Evidence and Impact, McMaster University Health Sciences Centre, Room 2C16, 1280 Main Street West, Hamilton, ON L8N 4K1, Canada (e-mail, [email protected]ca); Elena Parmelli, PhD, European Commission, Joint Research Centre (JRC), Via E. Fermi 2749 – TP 127, I-21027 Ispra (VA)/Italy (e-mail, elena.[email protected]europa.eu).Author Contributions: Conception and design: M.W. Langendam, E. Parmelli, T. Piggott, H.J. Schünemann.Analysis and interpretation of the data: J. Adolfsson, E.A. Akl, J. Braithwaite, R. Brignardello-Petersen, P. Giorgi Rossi, M.W. Langendam, M. Nothacker, T. Piggott, A. Qaseem, Z. Saz-Parkinson, H.J. Schünemann, P.J. van der Wees.Drafting of the article: T. Piggott, H.J. Schünemann.Critical revision for important intellectual content: J. Adolfsson, E.A. Akl, D. Armstrong, J. Braithwaite, R. Brignardello-Petersen, J. Brozek, M. Follmann, P. Giorgi Rossi, I. Kopp, M.W. Langendam, J.J. Meerpohl, L. Neamtiu, M. Nothacker, E. Parmelli, T. Piggott, A. Qaseem, Z. Saz-Parkinson, H.J. Schünemann, P.J. van der Wees.Final approval of the article: J. Adolfsson, E.A. Akl, D. Armstrong, J. Braithwaite, R. Brignardello-Petersen, J. Brozek, M. Follmann, P. Giorgi Rossi, I. Kopp, M.W. Langendam, J.J. Meerpohl, L. Neamtiu, M. Nothacker, E. Parmelli, T. Piggott, A. Qaseem, Z. Saz-Parkinson, H.J. Schünemann, P.J. van der Wees.Provision of study materials or patients: T. Piggott, H.J. Schünemann.Statistical expertise: T. Piggott, A. Qaseem.Obtaining of funding: H.J. Schünemann.Administrative, technical, or logistic support: L. Neamtiu, E. Parmelli, T. Piggott, H.J. Schünemann.Collection and assembly of data: M.W. Langendam, T. Piggott, H.J. Schünemann.This article was published at Annals.org on 1 March 2022. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee AlsoBuilding Connections Between Guidelines and Quality Improvement Helen Burstin and Eric Schneider Metrics Cited byBuilding Connections Between Guidelines and Quality ImprovementHelen Burstin, MD, MPH and Eric Schneider, MD, MScThe ecosystem of health decision making: from fragmentation to synergy May 2022Volume 175, Issue 5Page: 735-739KeywordsPerformance measuresQuality improvementQuality indicatorsResearch reporting guidelinesTreatment guidelines ePublished: 1 March 2022 Issue Published: May 2022 Copyright & PermissionsCopyright © 2022 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...