Real-world data (RWD) in clinical research on specific categories of medical devices can generate sufficient quality evidence which will be used in decision making. This paper discusses the limitations of traditional randomized controlled trials in clinical research of medical devices, summarizes and analyses the applicable conditions of real-world evidence (RWE) for medical devices, interprets the new FDA guidance document on the characteristics of RWD for medical devices, in order to provide evidence for the use of RWE in medical devices in our country.
Randomized double-blind controlled trials (RCTs) conduct researches in carefully selected populations to ensure results of RCTs are unaffected by external disturbances and provide evidence of safety and efficacy. Real-world researches further help to understand the real world effects of new technologies in different medical environments after-market authorization. RCTs are the evidence foundation of real-world researches, and real-world researches provide valuable complement to RCTs. Medical insurance database is one of the most important database in real-world researches. Now, China's national medical insurance is entering a new era and transits from passive payment and compensation into a value-based strategic purchase mechanism for its insured population to buy the most cost-effective services. It is necessary to establish a mature, well-organized and value-based mechanism. The core of such mechanism is values, which is the price/performance ratio of innovative medicines and technologies rather than looking at the price solely. Demonstrating innovative drug value is an essential part of health care assessment. The authors argue that the assessment of the overall value of innovative technologies or medicines should include and based on the following four dimensions: clinical value, economic value, patient value and society value.
Real-world evidence represents critical evidence to support post-marketing drug monitoring, assessment and policy decisions, and has received extensive attentions. However, an explicit over-arching design and conceptual framework for this specific area is lacking. Divergent opinions on the production of real world evidence are often present among researchers; and understanding about their implications also differ among policy makers and evidence users. In this article, we have proposed, from the regulatory and clinical perspectives, a conceptual framework on the use of real world data for post-marketing drug studies, assessment and policy decisions.
Real-world studies (RWSs) data are based on real medical scenes and reflect clinical facts. Besides, RWSs adapts to the characteristics of therapeutic principles of traditional Chinese medicine and the medical reality of the combination of Western and traditional Chinese medicine, which makes the safety assessment of herb-drug interaction more efficient and economical. During RWSs, more attention should be paid on the validity and reliability of data, especially the standardization of the data collection process and its contents. The safety assessment of herb-drug interaction will combine the methods of active surveillance study, big data analysis, and be based on precision medicine in the future
Diabetic retinopathy (DR), which is a common complication of diabetic and the main cause of blindness, brings not only a heavy economic burden to society, but also seriously threatens to the patients’ quality of life. Clinical researches on the therapies of DR are active at present, but how to perform a good clinical research with scientific design should be considered with high priority. The randomized controlled trial (RCT) is considered to be the gold standard for evidence-based medicine, but RCT is not always perfect. Limitations still exist in certain circumstance and the conclusions from RCTs also need to be interpreted by an objective point of view before clinical practice. Real world study (RWS) bridges the gap between RCT and clinical practice, in which the data can be easily collected without much cost, and results might be obtained within a short period. However, RWS is also faced with the challenge of not having standardized data and being susceptible to confounding bias. The standardized single disease database for DR and propensity score matching method can provide a wide range of data sources and avoid of bias for RWS in DR.
In recent years, real-world evidence data (RWD) and real-world evidence (RWE) have gained substantial attentions from healthcare practitioners and health authorities worldwide. In particular, the needs from regulatory bodies have promoted the production and use of real-world evidence. In the context of drug and device evaluation and regulation decisions, the pattern for using real world evidence may differ. This article aimed to discuss the potential uses of RWE for pre-approval clinical evaluation, post-approval monitoring and evaluation, and associated regulatory decisions, which may ultimately improve the production and use of RWE for regulatory decisions.
With the boom of information technology and data science, real-world evidence (RWE) which is produced using diverse real-world data (RWD) has become an important source for healthcare practice and policy decisions, such as regulatory and coverage decisions, guideline development, and disease management. The production of high-quality RWE requires not only complete, accurate and usable data, but also scientific and sound study designs and data analyses to enable the questions of interest to be reliably answered. In order to improve the quality of production and use of RWE, China REal world data and studies ALliance (ChinaREAL) has developed the first series of technical guidance for developing real-world data and subsequent studies. The efforts are ongoing which would ultimately inform better healthcare practice and policy decisions.
A patient registry database is an important source of real-world data, and has been widely used in the assessment of drug and medical devices, as well as disease management. As the second part of the serial technical guidance for real-world data and studies, this paper introduces the concept and scope of potential uses of patient registry databases, proposes recommendations for planning and developing a patient registry database, and compares existing health and medical databases. This paper further develops essential quality indicators for developing a patient registry database, in expect to guide future studies.
Observational studies based on real-world data are providing increasing amount of evidence for evaluating therapeutic outcomes, which is important for timely decision-making. Although time and costs for data collection could be saved using real-world data, it is significantly more complex to design real world researches with lower risk of bias. In order to enhance the validity of causal inference and to reduce potential risk of bias in real world studies, the Working Group of China Real world data and studies Alliance (China REAL) has formulated recommendations for designing observational studies to evaluate therapeutic outcomes based on real-world data. This guidance introduces design types commonly used in real world research; recommends key elements to consider in observational studies, including sample selection, specifying and allocating exposures, defining study entry and endpoints, and pre-designing statistical analysis protocols; and summarizes potential biases and corresponding control measures in real-world studies. These recommendations introduces key elements in designing observational studies using real-world data, for the purpose of improving the validity of causal inference. However, the application scope of these recommendations may be limited and warrant constant improvement.
Research of generating real-world evidence using real world data has attracted considerable attention globally. Outcome research of treatment based on existing health and medical data or registries has become one of the most important topics. However, there exists certain confusions in this line of research on how to design and implement appropriate statistical analysis. Therefore, in the fourth chapter of the series technical guidance to develop real world evidence by China REal world data and studies Alliance (ChinaREAL), we aim to provide an guidance on statistical analysis in the study to assess therapeutic outcomes based on existing health and medical data or registries.In this chapter, we first emphasize the significance of pre-specified statistical analysis plan, recommending key components of the statistical analysis plan. We then summarize the issue of sample size calculation in this content and clarify the interpretation of statistical p-value. Secondly, we recommend procedures to be considered to tackle the issue related to the selection bias, information bias and most importantly, confounding bias. We discuss the multivariable regression analysis as well as the popular causal inference models. We also suggest that careful consideration should be made to deal with missing data in real-world databases. Finally, we list core content of the statistical report.