Improving transparency in synthesis without meta-analysis; moving from ‘narrative synthesis’ to SWiM

Summary

This webinar presentation discusses the importance of improving transparency and synthesis in systematic reviews, particularly focusing on the development of the SWiM (Synthesis Without Meta-Analysis) reporting guidelines. The speaker explains how transparency in data synthesis enhances the clarity and reliability of results, offering a solution for cases where meta-analysis isn't applicable. The SWiM guidelines aim to guide researchers in clearly reporting synthesis methods and findings. The guidelines, developed through expert consultation, are not prescriptive but serve to prompt clear, transparent reporting in systematic reviews. A dedicated website and online training resources are also introduced.

Takeaways

• 😀 Transparency in synthesis is essential, regardless of the synthesis method being used. Authors must clearly report the methods and link data to results in charts, graphs, and tables.
• 😀 The SWIM (Synthesis Without Meta-Analysis) guidelines were developed to improve transparency in synthesis methods that do not involve meta-analysis.
• 😀 SWIM emphasizes the need to clearly explain the methods used, how studies are grouped, and the standard metrics applied to the synthesis process.
• 😀 The development of SWIM involved collaboration with experts from various universities and institutions, including the University of Glasgow and Monash University.
• 😀 The SWIM reporting guidelines were informed by a Delphi consensus exercise, incorporating feedback from systematic reviewers and experts in synthesis methods.
• 😀 The SWIM guidelines are not prescriptive but instead offer prompts to help authors transparently report their synthesis processes and findings.
• 😀 The SWIM guidelines were created specifically for quantitative data synthesis, with an emphasis on studies where meta-analysis is not feasible or appropriate.
• 😀 These guidelines were not designed as quality assessment tools but to guide the reporting of synthesis methods, ensuring consistency and clarity in systematic reviews.
• 😀 A significant part of the SWIM initiative was ensuring that review authors clearly articulate the limitations of their synthesis and the results' applicability.
• 😀 A second webinar will provide a deeper dive into the nine key reporting items of SWIM, offering more specific guidance on their use and application.
• 😀 The SWIM website includes resources such as the British Medical Journal paper, an email discussion group, and an online training module to help authors implement the SWIM guidelines.

Q & A

What is the main focus of the webinar?

The webinar focuses on improving transparency and synthesis without meta-analysis, specifically through the introduction of the SWIM reporting guideline.

What does SWIM stand for, and why was it introduced?

SWIM stands for 'Synthesis Without Meta-Analysis.' It was introduced to improve the transparency of reporting in synthesis methods, particularly when meta-analysis of effect sizes cannot be conducted.

What are the key principles of synthesis that the webinar emphasizes?

The key principles include transparency in reporting methods, making clear links between data, charts, and conclusions, ensuring the synthesis is conceptually appropriate, and reflecting the quality of the included data.

Why did the project initially focus on narrative synthesis and later shift to synthesis without meta-analysis?

The project initially focused on narrative synthesis, but it became clear that 'narrative synthesis' was a vague term. The term 'Synthesis Without Meta-Analysis' was introduced to specifically address quantitative data synthesis when meta-analysis isn't conducted.

How were the SWIM reporting items developed?

The SWIM reporting items were developed through a Delphi consensus exercise involving an expert panel of systematic reviewers. The process included reviewing existing guidance, assessing current reporting practices, and conducting three rounds of surveys to refine the items.

What is the goal of the SWIM reporting items?

The goal of the SWIM reporting items is to prompt review authors to clearly explain the synthesis methods used, report how studies are grouped, how data are presented, summarize findings, and reflect on the limitations of the synthesis.

How do the SWIM reporting items relate to the Cochrane Handbook?

The SWIM reporting items are linked to several chapters of the Cochrane Handbook, especially those that cover synthesis using methods other than meta-analysis. They align with guidance in the Cochrane Handbook but are not prescriptive conduct guidelines.

What are the limitations of the SWIM reporting items?

The SWIM reporting items are not meant to be quality assessment measures. They are designed to guide authors in reporting their synthesis methods transparently, not to evaluate the quality of the synthesis itself.

What is the significance of the SWIM website?

The SWIM website provides further resources, including information about upcoming webinars, email discussion groups, and key resources like the open-access British Medical Journal paper that elaborates on the SWIM reporting items.

How can review authors use the SWIM reporting items effectively?

Review authors can use the SWIM reporting items as a checklist to ensure they are clearly reporting the synthesis methods used in their systematic reviews. The items help authors explain how studies were grouped, the metrics used, and how findings are presented and summarized.