Examining the false-positive results of meta-analysis of Cochrane urology group using trial sequential analysis_Chinese Journal of Evidence-Based Medicine

Authors：

WENG Hong ¹ , WANG Chaoyang ^2,3 , HE Dalin ⁴ , LI Sheng ¹ , PENG Shuanghe ⁵ ,  ZENG Xiantao ^1,6

1. Center for Evidence-Based and Transitional Medicine, Zhongnan Hospital of Wuhan University; Center for Evidence-Based and Transitional Medicine, Wuhan University; Department of Evidence-Based Medicine and Clinical Epidemiology, The Second Clinical Medical College of Wuhan University, Wuhan, 430071, P.R.China;
2. Center for Evidence-Based Medicine, Huaihe Hospital of Henan University, Kaifeng, 475000, P.R.China;
3. Department of General Surgery, Huaihe Hospital of Henan University, Kaifeng, 475000, P.R.China;
4. Department of Urology, The First Affiliated Hospital of Xi’an Jiaotong University, Xi’an, 710061, P.R.China;
5. Department of Urology, First Hospital of Peking University, Beijing, 100034, P.R.China;
6. Department of Urology, Zhongnan Hospital of Wuhan University, Wuhan, 430071, P.R.China;

Corresponding author：

ZENG Xiantao, Email: zengxiantao1128@163.com

Keywords：

Trial sequential analysis; Meta-analysis; False-positive; Cochrane systematic review

DOI：

10.7507/1672-2531.201607064

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Objective To detect the false-positive results of cumulative meta-analyses of Cochrane Urology Group with the trial sequential analysis (TSA). Methods The systematic reviews of Urology Group of The Cochrane Library were searched to collect meta-analyses with positive results. Two researchers independently screened literature and extracted data of included meta-analyses. Then, TSA was performed using TSA software version 0.9 beta. Results A total of 11 meta-analyses were included. The results of TSA showed that, 8 of 11 (72.7%) meta-analyses were potentially false-positive results for failing to surpass the trial sequential monitoring boundary and to reach the required information size. Conclusion TSA can help researchers to identify the false-positive results of meta-analyses.

Citation： WENG Hong, WANG Chaoyang, HE Dalin, LI Sheng, PENG Shuanghe, ZENG Xiantao. Examining the false-positive results of meta-analysis of Cochrane urology group using trial sequential analysis. Chinese Journal of Evidence-Based Medicine, 2017, 17(4): 458-462. doi: 10.7507/1672-2531.201607064 Copy

1.	曾宪涛, 邝心颖, 孙燕, 等. 什么是循证医学?. 湖北医药学院学报, 2013, 32(1): 1-5.
2.	曾宪涛, 冷卫东, 郭毅, 等. Meta 分析系列之一: Meta 分析的类型. 中国循证心血管医学杂志, 2012, 4(1): 3-5.
3.	Borm GF, Donders AR. Updating meta-analyses leads to larger type I errors than publication bias. J Clin Epidemiol, 2009, 62(8): 825-830.
4.	Pogue JM, Yusuf S. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials, 1997, 18(6): 580-593.
5.	Wetterslev J, Thorlund K, Brok J, et al. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol, 2008, 61(1): 64-75.
6.	Brok J, Thorlund K, Gluud C, et al. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol, 2008, 61(8): 763-769.
7.	Thorlund K, Devereaux PJ, Wetterslev J, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol, 2009, 38(1): 276-286.
8.	Wetterslev J, Thorlund K, Brok J, et al. Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol, 2009, 9(1): 1-12.
9.	Thorlund K, Engstrøm J, Wetterslev J, et al. User manual for trial sequential analysis (TSA). Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen, Denmark. 2011. Available at: .
10.	Wilt TJ, Ishani A. Pygeum africanum for benign prostatic hyperplasia. Cochrane Database Syst Rev, 1998, (1): CD001044.
11.	Schmitt B, Bennett C, Seidenfeld J, et al. Maximal androgen blockade for advanced prostate cancer. Cochrane Database Syst Rev, 1999, (4): CD001526.
12.	Hoffman RM, MacDonald R, Wilt TJ. Laser prostatectomy for benign prostatic obstruction. Cochrane Database Syst Rev, 2000, (1): CD001987.
13.	Shelley MD, Court JB, Kynaston H, et al. Intravesical bacillus Calmette-Guerin in Ta and T1 bladder cancer. Cochrane Database Syst Rev, 2000, (4): CD001986.
14.	Kumar S, Shelley M, Harrison C, et al. Neo-adjuvant and adjuvant hormone therapy for localised and locally advanced prostate cancer. Cochrane Database Syst Rev, 2006, (4): CD006019.
15.	Melnik T, Soares BG, Nasselo AG. Psychosocial interventions for erectile dysfunction. Cochrane Database Syst Rev, 2007, (3): CD004825.
16.	Wilt TJ, MacDonald R, Hagerty K, et al. 5-alpha-reductase inhibitors for prostate cancer prevention. Cochrane Database Syst Rev, 2008, (2): CD007091.
17.	Shang PF, Kwong J, Wang ZP, et al. Intravesical Bacillus Calmette-Guerin versus epirubicin for Ta and T1 bladder cancer. Cochrane Database Syst Rev, 2011, (5): CD006885.
18.	Zani EL, Clark OA, Rodrigues Netto Jr N. Antibiotic prophylaxis for transrectal prostate biopsy. Cochrane Database Syst Rev, 2011, (5): CD006576.
19.	Hoffman RM, Monga M, Elliott SP, et al. Microwave thermotherapy for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (9): CD004135.
20.	Kunath F, Grobe HR, Rucker G, et al. Non-steroidal antiandrogen monotherapy compared with luteinising hormone-releasing hormone agonists or surgical castration monotherapy for advanced prostate cancer. Cochrane Database Syst Rev, 2014, (6): CD009266.
21.	曾宪涛, 冷卫东, 李胜, 等. 如何正确理解及使用 GRADE 系统. 中国循证医学杂志, 2011, 11(9): 985-990.
22.	陈耀龙, 杨克虎, 姚亮, 等. GRADE 系统方法学进展. 中国循证儿科杂志, 2013, 8(1): 64-65.
23.	陈耀龙, 姚亮, Susan Norris, 等. GRADE 在系统评价中应用的必要性及注意事项. 中国循证医学杂志, 2013, 13(12): 1401-1404.
24.	Gordon H. Guyatt, Andrew D. Oxman, Regina Kunz, 等. GRADE 指南: Ⅵ.证据质量评价—不精确性(随机误差). 中国循证医学杂志, 2011, 11(12): 1435-1443.

1. 曾宪涛, 邝心颖, 孙燕, 等. 什么是循证医学?. 湖北医药学院学报, 2013, 32(1): 1-5.
2. 曾宪涛, 冷卫东, 郭毅, 等. Meta 分析系列之一: Meta 分析的类型. 中国循证心血管医学杂志, 2012, 4(1): 3-5.
3. Borm GF, Donders AR. Updating meta-analyses leads to larger type I errors than publication bias. J Clin Epidemiol, 2009, 62(8): 825-830.
4. Pogue JM, Yusuf S. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials, 1997, 18(6): 580-593.
5. Wetterslev J, Thorlund K, Brok J, et al. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol, 2008, 61(1): 64-75.
6. Brok J, Thorlund K, Gluud C, et al. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol, 2008, 61(8): 763-769.
7. Thorlund K, Devereaux PJ, Wetterslev J, et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol, 2009, 38(1): 276-286.
8. Wetterslev J, Thorlund K, Brok J, et al. Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol, 2009, 9(1): 1-12.
9. Thorlund K, Engstrøm J, Wetterslev J, et al. User manual for trial sequential analysis (TSA). Copenhagen Trial Unit, Center for Clinical Intervention Research, Copenhagen, Denmark. 2011. Available at: .
10. Wilt TJ, Ishani A. Pygeum africanum for benign prostatic hyperplasia. Cochrane Database Syst Rev, 1998, (1): CD001044.
11. Schmitt B, Bennett C, Seidenfeld J, et al. Maximal androgen blockade for advanced prostate cancer. Cochrane Database Syst Rev, 1999, (4): CD001526.
12. Hoffman RM, MacDonald R, Wilt TJ. Laser prostatectomy for benign prostatic obstruction. Cochrane Database Syst Rev, 2000, (1): CD001987.
13. Shelley MD, Court JB, Kynaston H, et al. Intravesical bacillus Calmette-Guerin in Ta and T1 bladder cancer. Cochrane Database Syst Rev, 2000, (4): CD001986.
14. Kumar S, Shelley M, Harrison C, et al. Neo-adjuvant and adjuvant hormone therapy for localised and locally advanced prostate cancer. Cochrane Database Syst Rev, 2006, (4): CD006019.
15. Melnik T, Soares BG, Nasselo AG. Psychosocial interventions for erectile dysfunction. Cochrane Database Syst Rev, 2007, (3): CD004825.
16. Wilt TJ, MacDonald R, Hagerty K, et al. 5-alpha-reductase inhibitors for prostate cancer prevention. Cochrane Database Syst Rev, 2008, (2): CD007091.
17. Shang PF, Kwong J, Wang ZP, et al. Intravesical Bacillus Calmette-Guerin versus epirubicin for Ta and T1 bladder cancer. Cochrane Database Syst Rev, 2011, (5): CD006885.
18. Zani EL, Clark OA, Rodrigues Netto Jr N. Antibiotic prophylaxis for transrectal prostate biopsy. Cochrane Database Syst Rev, 2011, (5): CD006576.
19. Hoffman RM, Monga M, Elliott SP, et al. Microwave thermotherapy for benign prostatic hyperplasia. Cochrane Database Syst Rev, 2012, (9): CD004135.
20. Kunath F, Grobe HR, Rucker G, et al. Non-steroidal antiandrogen monotherapy compared with luteinising hormone-releasing hormone agonists or surgical castration monotherapy for advanced prostate cancer. Cochrane Database Syst Rev, 2014, (6): CD009266.
21. 曾宪涛, 冷卫东, 李胜, 等. 如何正确理解及使用 GRADE 系统. 中国循证医学杂志, 2011, 11(9): 985-990.
22. 陈耀龙, 杨克虎, 姚亮, 等. GRADE 系统方法学进展. 中国循证儿科杂志, 2013, 8(1): 64-65.
23. 陈耀龙, 姚亮, Susan Norris, 等. GRADE 在系统评价中应用的必要性及注意事项. 中国循证医学杂志, 2013, 13(12): 1401-1404.
24. Gordon H. Guyatt, Andrew D. Oxman, Regina Kunz, 等. GRADE 指南: Ⅵ.证据质量评价—不精确性(随机误差). 中国循证医学杂志, 2011, 11(12): 1435-1443.

Chinese Journal of Evidence-Based Medicine

Examining the false-positive results of meta-analysis of Cochrane urology group using trial sequential analysis

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content