Development and validation for evaluation of an evaluation tool for guideline implementation_Chinese Journal of Evidence-Based Medicine

Authors：

JIN Yinghui ¹ , ZHAO Zhihui ² , HUANG Canran ² , HUANG Di ¹ , WANG Yunyun ¹ , YAN Siyu ¹ , HUANG Qiao ¹ , LI Xuhui ¹ , HUANG Chao ³ ,  WANG Qiang ³ , ZENG Xiantao ¹

1. Center for Evidence-Based and Translational Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, P.R.China;
2. School of Health Sciences, Wuhan University, Wuhan 430071, P.R.China;
3. National Center for Medical Service Administration, National Health and Family Planning Commission, Beijing 100044, P.R.China;

Corresponding author：

WANG Qiang, Email: zengxiantao1128@163.com

Keywords：

Clinical practice guideline; Implementation; Evaluation tool

DOI：

10.7507/1672-2531.202106002

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Objective The ultimate goal of developing guidelines is for using them in clinical practice. In this study, an implementation evaluation tool was developed to promote the overall evaluation of guidelines and to improve their promotion and implementation. Methods The research group set up a team to formulate and establish a guideline implementation evaluation tool, through preliminary research, interviews, a systematic review of relevant literature, two expert consensus meetings and two Delphi expert consensus meetings to evaluate the guideline implementation tool. Experts were invited to give opinions and grades on the fields, items and overall implementation evaluation method of the tool. Results The evaluation tool for the implementation of guidelines included 5 fields, accessibility, communicability, performability, recognizability and applicability, with a total of 7 items. The scale-level CVIs in two rounds of Delphi expert consensus were 0.91 and 0.93. We collected opinions and suggestions and made some revisions and insertions without deleting any items based on the parameter that no items fulfilled the standard if mean <3.5, coefficient of variation >15% and I-CVI<0.78. Conclusion In this study, in order to provide a standard and method for the evaluation of guideline implementation, a guideline implementation evaluation tool has been developed and evaluated by clinically-related physicians and guideline formulation methodology experts. The guideline implementation evaluation tool presents satisfactory face and content validity. Empirical research is needed to verify the tool’s performance in evaluating guideline implementation.

Citation： JIN Yinghui, ZHAO Zhihui, HUANG Canran, HUANG Di, WANG Yunyun, YAN Siyu, HUANG Qiao, LI Xuhui, HUANG Chao, WANG Qiang, ZENG Xiantao. Development and validation for evaluation of an evaluation tool for guideline implementation. Chinese Journal of Evidence-Based Medicine, 2022, 22(1): 111-119. doi: 10.7507/1672-2531.202106002 Copy

1.	中华人民共和国中央人民政府. 关于加强卫生与健康科技成果转移转化工作的指导意见. Available at: http://www.gov.cn/xinwen/2016-10/12/content_5117948.htm.
2.	中华人民共和国中央人民政府. 中共中央国务院印发《“健康中国2030”规划纲要》. Available at: http://www.gov.cn/xinwen/2016-10/25/content_5124174.htm.
3.	Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington (DC): National Academies Press (US); 2011.
4.	Institute of Medicine (US) Committee on Clinical Practice Guidelines. Guidelines for clinical practice: from development to use. Washington (DC): National Academies Press (US); 1992.
5.	Jin Y, Li Z, Han F, et al. Barriers and enablers for the implementation of clinical practice guidelines in China: a mixed-method study. BMJ Open, 2019, 9(9): e026328.
6.	Jin YH, Tan LM, Khan KS, et al. Determinants of successful guideline implementation: a national cross-sectional survey. BMC Med Inform Decis Mak, 2021, 21(1): 19.
7.	吴明隆. 问卷统计分析实务——SPSS操作与应用. 重庆: 重庆大学出版社, 2010.
8.	靳英辉, 邓通, 曾宪涛, 等. 临床实践指南制订方法——指南的实施工具. 中国循证心血管医学杂志, 2019, 11(10): 1157-1161.
9.	靳英辉, 邓通, 曾宪涛, 等. 临床实践指南制订方法——指南的实施与转化. 中国循证心血管医学杂志, 2019, 11(9): 1040-1042,1046.
10.	史静琤, 莫显昆, 孙振球. 量表编制中内容效度指数的应用. 中南大学学报(医学版), 2012, 37(2): 152-155.
11.	华琳, 阎岩, 张建. 关于对诊断一致性Kappa系统的探讨. 数理医药学杂志, 2006, 19(5): 518-520.
12.	赵俊强. 引入复杂科学理念, 推动实施科学研究范式的多样化. 医学新知, 2020, 30(5): 364-375.
13.	Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 2017, 358: j4008.
14.	Vandvik PO, Brandt L, Alonso-Coello P, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest, 2013, 144(2): 381-389.
15.	Siemieniuk RA, Agoritsas T, Macdonald H, et al. Introduction to BMJ rapid recommendations. BMJ, 2016, 354: i5191.
16.	曾可. 基于本体技术的中文临床指南计算机化研究. 武汉: 华中科技大学, 2017.
17.	赵志娟, 赵玉虹. 文本临床指南转变为数字化临床指南发展现状及趋势. 中国数字医学, 2017, 12(1): 32-34.
18.	覃露, 徐晓巍, 丁玲玲, 等. 面向决策支持的临床指南知识表示方法研究. 中华医学图书情报杂志, 2020, 29(2): 1-8.

1. 中华人民共和国中央人民政府. 关于加强卫生与健康科技成果转移转化工作的指导意见. Available at: http://www.gov.cn/xinwen/2016-10/12/content_5117948.htm.
2. 中华人民共和国中央人民政府. 中共中央国务院印发《“健康中国2030”规划纲要》. Available at: http://www.gov.cn/xinwen/2016-10/25/content_5124174.htm.
3. Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington (DC): National Academies Press (US); 2011.
4. Institute of Medicine (US) Committee on Clinical Practice Guidelines. Guidelines for clinical practice: from development to use. Washington (DC): National Academies Press (US); 1992.
5. Jin Y, Li Z, Han F, et al. Barriers and enablers for the implementation of clinical practice guidelines in China: a mixed-method study. BMJ Open, 2019, 9(9): e026328.
6. Jin YH, Tan LM, Khan KS, et al. Determinants of successful guideline implementation: a national cross-sectional survey. BMC Med Inform Decis Mak, 2021, 21(1): 19.
7. 吴明隆. 问卷统计分析实务——SPSS操作与应用. 重庆: 重庆大学出版社, 2010.
8. 靳英辉, 邓通, 曾宪涛, 等. 临床实践指南制订方法——指南的实施工具. 中国循证心血管医学杂志, 2019, 11(10): 1157-1161.
9. 靳英辉, 邓通, 曾宪涛, 等. 临床实践指南制订方法——指南的实施与转化. 中国循证心血管医学杂志, 2019, 11(9): 1040-1042,1046.
10. 史静琤, 莫显昆, 孙振球. 量表编制中内容效度指数的应用. 中南大学学报(医学版), 2012, 37(2): 152-155.
11. 华琳, 阎岩, 张建. 关于对诊断一致性Kappa系统的探讨. 数理医药学杂志, 2006, 19(5): 518-520.
12. 赵俊强. 引入复杂科学理念, 推动实施科学研究范式的多样化. 医学新知, 2020, 30(5): 364-375.
13. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 2017, 358: j4008.
14. Vandvik PO, Brandt L, Alonso-Coello P, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest, 2013, 144(2): 381-389.
15. Siemieniuk RA, Agoritsas T, Macdonald H, et al. Introduction to BMJ rapid recommendations. BMJ, 2016, 354: i5191.
16. 曾可. 基于本体技术的中文临床指南计算机化研究. 武汉: 华中科技大学, 2017.
17. 赵志娟, 赵玉虹. 文本临床指南转变为数字化临床指南发展现状及趋势. 中国数字医学, 2017, 12(1): 32-34.
18. 覃露, 徐晓巍, 丁玲玲, 等. 面向决策支持的临床指南知识表示方法研究. 中华医学图书情报杂志, 2020, 29(2): 1-8.

Previous Article
Methodological quality assessment of clinical guidelines and consensus for lupus nephritis
Next Article
Classification and application of effectiveness-implementation hybrid designs

Chinese Journal of Evidence-Based Medicine

Development and validation for evaluation of an evaluation tool for guideline implementation

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content