Matt Vassar edited textbf_Introduction_In_order_for__.tex  almost 9 years ago

Commit id: f54dc0d6e4eb65c777a279aef7beb6f21758a12b

deletions | additions      

       

\textbf{Introduction}  In order for systematic reviews to make legitimate accurate  inferences concerning clinical therapy, the primary studies that constitute the review must provide credible valid  results. The Cochrane Handbook for Systematic Reviews states that assessment of validity is an “essential component” of a review thatshould  “should influence the analysis, interpretation, and conclusions of the review.” The internal validity of a review’s component primary  studies must be resolved considered  to ensure that bias has not compromised the results. results, leading to inaccurate estimates of summary effect sizes.  In ophthalmology, the there is a  need fora  closer examination of validity, the validity of primary studies comprising a review. As an illustrative example, Gupta et al. (2013) compared anti-vascular endothelial growth factor (VEGF) to laser treatment for proliferative diabetic retinopathy. commonly referred to as methodological  quality, and risk of bias assessment practices in systematic reviews is readily apparent. reviews.  Many systematic reviews in this specialty do not perform a measure of quality or risk of bias assessment (MQ/ROB), and, oftentimes, those that do continue to include studies with a high risk of bias or low quality. For example, in an article by Gupta et al (2013), the author writes that the use of anti-vascular endothelial growth factor for proliferative diabetic retinopathy is safer than laser treatment. Furthermore, they state that anti-VEGF is becoming the primary treatment for diabetic retinopathy. Eldaly et al (2014) conducted a systematic review of this anti-VEGF treatment for diabetic retinopathy. In this review, 18 randomized controlled trials were included in the final assessment. Of these 18 RCTs, seven were at high risk of bias while the rest were unclear in one or more domains (2014). The author goes on to conclude that, “there as very low or low quality evidence from RCTs for the efficacy and safety of anti-VEGF agents when used to treat PDR over and above current standard treatments. However, the results suggest that anti-VEGFs can reduce the risk of intraocular bleeding in people with PDR.” Validity and quality have been very heavily researched areas, particularly in recent years. Validity has been described as the ability of the instrument to measure what it is believed it is measuring (Moher 1995). Researchers have used many different methods to attempt to evaluate the validity and quality of primary studies. Initially, checklists and scales were developed to evaluate whether particular quality items, such as randomization, blinding, allocation concealment, etc., were addressed in the study. Although these are effective at evaluating specific components of study validity, they are often denounced for falsely elevating quality scores. Many of these scales and checklists include items that have no bearing on a study’s actual quality, such as whether there was informed consent or whether there was ethical approval (1995). Furthermore, it was suggested that the choice of scale or checklist could alter the results of systematic reviews (Jüni 1999), and because of this, two main tools emerged as the most accurate: the Jadad scale (Jadad 1996) and the Downs and Black checklist (Downs 1998). Reporting guidelines developed by the predominant review board at this time, QUORUM, necessitated the evaluation of methodological quality of the primary studies in systematic reviews. The Cochrane Collaboration decided there was a need for a new tool, and in 2008 it developed the Cochrane Risk of Bias Tool. Its development was based on a combination of empirical and theoretical considerations, leading to a focus on risk of bias rather than study 'quality' and a division of assessments into six bias domains (Stern 2013). The risk of bias was then ranked as low, high, or unclear with no score calculation. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), which provides the updated reporting guidelines, now calls for the evaluation of bias in all systematic reviews (Moher 2009).