RMP.7:11 - SoTA-Echoing
What counts as independent support? Cochrane chapter 5 explains how to identify several reports of one study and combine the information they contribute. Counting repeat reports as additional studies inflates the number of independent studies. One report can also describe several studies. Discarding all repeated reports can lose follow-up observations. Section 4.2 preserves A2’s fuller outcomes in §5.1 and counts A/A2 as one study. Recover underlying relationships where they could change an inference. New evidence of overlap, provenance or additional outcomes can change it.
Which numerical answer can this corpus support? Cochrane chapter 10 guides combination for a defined quantity under an appropriate dependence model. chapter 12 describes synthesis without meta-analysis. Sections 4.4 and 5.1–5.2 use the target and model to distinguish a justified combined estimate from a narrower comparison. Pooling all numerical results assumes they measure compatible quantities. Refusing every heterogeneous comparison would discard some useful estimates. Choosing groups and models takes judgement. Reconsider those choices if the target, dependence or a defensible alternative model changes. These chapters address intervention reviews.
How should missing contributions affect a finding? Cochrane chapter 13 examines missing evidence in a synthesis and its potential effect on a finding. Its meta-analysis tools have that scope. Sections 4.1 and 4.3 distinguish material unavailable, unreported, never sought or lost. Assuming completeness can conceal selective reporting. Rejecting every incomplete corpus would also discard answers supported within a narrower scope. Reconsider the affected finding when new material, a selective omission or evidence of its effect becomes known.
How can situated and mixed findings be related? For a review of intervention effectiveness, Harden and colleagues (2018) recommend synthesizing qualitative and quantitative evidence separately before integration. The archived Cochrane Handbook v6.0, §21.13 gives that recommendation in its original setting. In Sutcliffe and colleagues, Cochrane–Campbell Handbook, chapter 14 (February 2024 draft), the authors describe transformation for a shared question, comparison of separate syntheses and using one synthesis to guide another. JBI §8.3 distinguishes an integrated approach for evidence that answers the same question from separate syntheses of different aspects. Sections 4.4 and 5.3 use the question to choose among these operations, preserve context and show what a transformation loses. GRADE-CERQual assesses confidence in individual qualitative findings. Reconsider the choice if the question, research approach or evidence about those losses changes.
What can agreement between historical accounts establish? The AHA professional standards address the integrity and interpretation of source evidence. Sections 4.2–4.4 and 5.4 examine dependence, dates, purpose, contrary material and rival explanations. Counting the histories is quick, but they repeat one memoir. Source criticism establishes the chronology the dated decision record supports. It leaves the cause open. Reconsider that inference if new provenance, dating or a rival explanation affects its grounds.
These sources offer different ways to synthesize evidence. Choose the method appropriate to the research question and the relationships among the sources.