Quality of systematic reviews in the top medical and endocrinology journals—should we have confidence in them? A meta-epidemiological study
摘要
To evaluate the methodological quality and the reporting quality of systematic reviews and meta-analyses (SR/MA) published in the highest-impact endocrinology and general medicine journals.
MethodsWe included SR/MA of healthcare interventions’ effects and diagnostic accuracy published in the top 5 journals of endocrinology and general medicine that publish SRs. The methodological quality of the articles was assessed with the AMSTAR tool, and the quality in the reporting was assessed by the PRISMA tool. Results were described with frequencies and percentages. To determine whether statistical differences exist, a chi-square test was performed.
ResultsA total of 147 SR/MA met the inclusion criteria. More than half of the included studies were from a journal of general medicine (56%). Overall, most SRs had a low (31.97% (n = 47)) or critically low (25.85% (n = 38)) overall confidence in the results. None of AMSTAR’s domains was met by all the included reviews. Regarding PRISMA items, just 2 items were fully reported in all journals: “information sources” (item 6) and“Discussion – interpretation” (item 23a). The least fully reported item was“Abstract” (28.76%).
ConclusionThe use of AMSTAR and PRISMA has improved the quality of the SRs across different fields in medicine; however, until today, there is still an inconsistency in the report quality of systematic reviews, even when only evaluating the highest-ranking journals; thus, the development of new strategies is a must to generate better and more quality evidence.