The University of Melbourne · FACULTY OF HEALTH & MEDICINE

POPH90014 Chap.11 Systematic Reviews and Evidence Synthesis

- one subject, every graph, every model, every mark

5 Chapters2-page Bible

Our own words - no uploaded lecturer files

Updated for this semester

Chapter 11 of 12 · POPH90014

Systematic Reviews and Evidence Synthesis

Define systematic review

The course material gives this chapter a concrete anchor: Week 11 follows protocol registration through search, selection, appraisal, synthesis and certainty.

That systematic review anchor controls how meta-analysis is explained and how publication bias is tested in changed practice.

Systematic Reviews and Evidence Synthesis is a quantitative decision problem built from systematic review, meta-analysis and publication bias.

The aim is to build and appraise a systematic-review chain; a numerical result earns meaning only when the variables, units, assumptions and comparison are all explicit.

Begin with systematic review: state what quantity it represents, the scale on which it is measured and the condition under which it changes.

Then map every symbol in the Systematic Reviews and Evidence Synthesis formula checkpoint to systematic review before calculation begins.

Next connect meta-analysis to the calculation. Show the meta-analysis transformation line by line, preserve units and signs, and make any denominator or baseline visible.

A meta-analysis calculator output is not a method; the reader must be able to reconstruct why that operation answers the question.

Formula checkpoint: systematic review

Inverse-variance mean

\\hat\\theta=\\frac{\\sum_i w_i\\hat\\theta_i}{\\sum_i w_i}

Compatible study estimates are averaged using declared precision weights.

Trace meta-analysis

Use publication bias to interpret or stress-test the result.

Ask whether the publication bias magnitude is plausible, whether a boundary case behaves as expected and which conclusion would reverse if an assumption changed. This is where computation becomes analysis rather than arithmetic.

When the task is to build and appraise a systematic-review chain, separate inputs supplied by the problem from quantities you derive.

Then report the publication bias result in the language of the course and attach the relevant uncertainty, limitation or decision consequence.

Build a representation check before solving. Put systematic review, meta-analysis and publication bias into a small symbol-and-units table, mark which values are observed and which are calculated, and predict the direction of the result before doing arithmetic.

A sign, scale or unit mismatch in systematic review then becomes visible at setup instead of being hidden inside a polished final number.

Run one sensitivity test after the baseline answer. Change the input most closely connected to meta-analysis, hold the remaining assumptions fixed and recompute only the affected steps. Explain whether the movement in publication bias matches the mechanism.

This meta-analysis sensitivity shows which assumption controls the conclusion and prevents a single scenario from being presented as universal.

Test with publication bias

Use a three-column systematic review error log for POPH90014: translation error, calculation error and interpretation error.

Record the exact line where the meta-analysis solution first diverged, rewrite that line, and check it with a limiting case or an independent calculation.

Correcting the first failed meta-analysis move is more useful than copying the complete solution again.

A complete response should make the task visible before the detail: identify what must be decided, define the relevant terms, connect the evidence to meta-analysis, and use publication bias to test the result.

The final sentence about publication bias should answer the question actually asked rather than merely repeat the topic.

The controlling limit is specific: a pooled estimate cannot repair biased studies or incompatible questions.

Keep that publication bias limit beside the worked example, because it separates a careful POPH90014 answer from one that sounds confident but claims more than the task or evidence supports.

For revision, retrieve systematic review, meta-analysis and publication bias without notes, explain their relationship aloud, then complete a changed version of the application: build and appraise a systematic-review chain.

Record the first failed meta-analysis reasoning move and repair it before attempting another case.

In this chapter

What this chapter covers

01
Systematic review
02
Meta-analysis
03
Publication bias
04
Applying systematic review
05
Limits of meta-analysis and publication bias

Worked example · free

Weight two study estimates

Q [4 marks]. AskSia-authored practice. Two compatible log-effect estimates are 0.10 and 0.30 with inverse-variance weights 3 and 1. The mark allocation shown here is a study aid created for this example, not a University assessment scheme.

1Multiply each estimate by its weight.
1Sum weighted estimates.
1Divide by total weight 4.
1Interpret model dependence.

The fixed weighted mean is (3×0.10 + 1×0.30)/4 = 0.15 on the log scale, before heterogeneity and bias assessment.

Sia tip — Pooling precision does not erase design flaws.

Glossary

Key terms

Systematic review: Review using explicit methods to identify, select, appraise and synthesise studies for a question. This chapter uses the concept when students build and appraise a systematic-review chain. Use this definition when the task is to build and appraise a systematic-review chain.
Meta-analysis: Statistical combination of compatible study estimates under a stated model. It helps explain the reasoning required to build and appraise a systematic-review chain. Use this definition when the task is to build and appraise a systematic-review chain.
Publication bias: Distortion when dissemination depends on study results or direction. Its limit matters because a pooled estimate cannot repair biased studies or incompatible questions. Use this definition when the task is to build and appraise a systematic-review chain.

FAQ

Systematic Reviews and Evidence Synthesis FAQ

Which constraints shape the work needed to build and appraise a systematic-review chain?

Build and appraise a systematic-review chain. Week 11 follows protocol registration through search, selection, appraisal, synthesis and certainty. Review using explicit methods to identify, select, appraise and synthesise studies for a question. This chapter uses the concept when students build and appraise a systematic-review chain.

Can a pooled estimate repair biased studies or incompatible questions?

A pooled estimate cannot repair biased studies or incompatible questions. Statistical combination of compatible study estimates under a stated model. It helps explain the reasoning required to build and appraise a systematic-review chain.

If unpublished null studies were removed, how should a student predict how the pooled result may shift?

The fixed weighted mean is (3×0.10 + 1×0.30)/4 = 0.15 on the log scale, before heterogeneity and bias assessment. A pooled estimate cannot repair biased studies or incompatible questions. Review using explicit methods to identify, select, appraise and synthesise studies for a question. This chapter uses the concept when students build and appraise a systematic-review chain.

Study strategy

Exam move

Reconstruct the relationship among systematic review, meta-analysis and publication bias; complete the chapter application without notes; then test the result against this limit: a pooled estimate cannot repair biased studies or incompatible questions.

Working through Systematic Reviews and Evidence Synthesis in POPH90014? Sia is AskSia’s AI Health and Medicine tutor — ask any POPH90014 Systematic Reviews and Evidence Synthesis question and get a clear, step-by-step explanation grounded in how POPH90014 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

Keep going — explore the course

A+Everything unlocked

Unlocks this Bible + all 46 of your The University of Melbourne subjects - and 1,000+ Bibles across every Australian university.

Sia - your POPH90014 tutor, unlimited, worked the way the exam marks it

The full 2-page Bible + practice bank with worked solutions

Chrome extension - sync your LMS so Sia knows your deadlines

Bilingual EN / Chinese on every Bible and every Sia answer

$0.99 Trial

30-day money-back · cancel in one tap · how it works