King's College London · FACULTY OF STATISTICS

7SSGN110 Chap.6 Comparing Two or More Groups

- one subject, every graph, every model, every mark
7 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 6 of 8 · 7SSGN110

Comparing Two or More Groups

Route from design to comparison

A group comparison starts with the observational structure, not a list of test names. Identify the response and its unit, the grouping variable, the number of groups and whether observations are independent or paired. Check the sample size in each group and preserve the reference order used for contrasts.

These decisions determine the error structure and the meaning of every reported sign.

Distinguish independent and paired evidence

Measurements from different sampled units can support an independent comparison. Before-and-after values from the same site instead produce within-site differences and require a paired analysis.

Treating paired observations as independent discards the matching and can misstate uncertainty; pairing unrelated sites invents dependence. Inspect the differences themselves because their distribution, rather than each marginal group alone, governs a paired mean comparison.

Modify the mean route when assumptions change

An equal-variance t-test pools spread across two groups.

Welch's method allows separate variances and adjusts the standard error and degrees of freedom, making it suitable when independent groups have unequal spread. A rank-based method changes the analytical target by using order rather than raw distance.

It should be chosen because that target and its conditions suit the data, not because it happens to produce a smaller p-value.

Use an omnibus sequence for several groups

One-way ANOVA compares variation associated with group means against residual variation within groups.

A significant omnibus result supports at least one difference, but it does not identify which pair differs or show that all groups are distinct. Planned contrasts or multiplicity-controlled post-hoc intervals locate the evidence.

Repeating unadjusted t-tests increases the family-wise chance of a false positive and obscures the intended inferential sequence.

Keep the conclusion aligned with the method

Ranked alternatives such as Kruskal-Wallis support conclusions about ordered distributions under their assumptions, not automatic claims about raw means. Report original-scale summaries and plots alongside the test.

For every route, give the response, groups, subtraction order, estimate where available, uncertainty, statistic and p-value.

Finish with the sampled population and a design-aware limitation so the output becomes environmental evidence rather than a software label.

Report follow-up comparisons coherently

After an omnibus result, list the complete family of planned or post-hoc contrasts rather than selecting only significant pairs.

State the adjustment, present estimates and intervals in one consistent subtraction order and retain the original unit. A pairwise interval that crosses zero remains uncertain even if the omnibus test rejected equal means.

The overall and pairwise conclusions answer different questions, so both should appear without implying that every group differs from every other group.

For revision, begin with a design description and choose a route before seeing any p-value. Change independence to pairing, equal spread to unequal spread, or two groups to three, then identify exactly which method and interpretation change.

This keeps test choice anchored in evidence structure.

In this chapter

What this chapter covers

  • 01

    Independent t-test

  • 02

    Paired t-test

  • 03

    Welch's t-test

  • 04

    Wilcoxon-Mann-Whitney

  • 05

    ANOVA

  • 06

    Kruskal-Wallis

  • 07

    Post-hoc comparisons

Worked example · free

Choose Welch for unequal spread

Q [8 marks]. AskSia-authored practice. The marks shown support revision and are not an official university marking scheme. Two independent habitat samples are roughly symmetric but have standard deviations 0.9 and 0.3. Explain the test route and interpret p = 0.036 for an estimated difference of 0.7.
Group-comparison route.Group-comparison route. The number of groups starts the choice, while pairing, independence, distribution and variance determine the appropriate branch.Compare groupsTwo groupsThree or moret / Welch / rankANOVA / rankdesign and assumptions choose the branch
Group-comparison route. The number of groups starts the choice, while pairing, independence, distribution and variance determine the appropriate branch.
  • 2Confirm independent groups and continuous response.
  • 3Use Welch because spreads differ.
  • 3Report direction, estimate and scope.
Welch's two-sample t-test avoids imposing equal variance. At alpha 0.05, p = 0.036 leads to rejecting equal means. The first habitat is estimated 0.7 percentage points higher, subject to the small samples and design limitations.
Sia tip — Choose the variance model before reading the p-value; method shopping invalidates the decision rule.
Glossary

Key terms

Paired Comparison
A Paired Comparison analyses within-unit differences between matched measurements.
Welch's Test
Welch's Test compares independent means without assuming equal group variances.
Omnibus Test
An Omnibus Test evaluates whether any difference exists across a set of groups without locating the pair.
FAQ

Comparing Two or More Groups FAQ

When is a paired test required?

Use a paired analysis when each observation in one condition is linked to a specific observation in the other, such as before and after measurements at the same site. The analysis then targets within-pair differences rather than treating records as independent.

Why use Welch's t-test?

Welch's procedure is appropriate for independent mean comparisons when equal variance is doubtful. It adjusts the standard error and degrees of freedom instead of forcing a pooled variance, while still requiring a defensible design and suitable distributional conditions.

What does a significant ANOVA show?

It supports the claim that not all population means are equal under the model. It does not identify the differing groups. Use planned or multiplicity-controlled post-hoc contrasts, and report estimates and intervals for the comparisons actually interpreted.

Study strategy

Assessment move

Draw a test-routing tree from memory using group count, pairing, variable scale, distribution and variance. Practise explaining why every rejected branch answers a different question. For multi-group output, separate the omnibus decision from the pairwise location step.

Working through Comparing Two or More Groups in 7SSGN110? Sia is AskSia’s AI Statistics tutor — ask any 7SSGN110 Comparing Two or More Groups question and get a clear, step-by-step explanation grounded in how 7SSGN110 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

A+Everything unlocked
Unlocks this Bible + all 18 of your subjects at King's College London, plus 1,000+ more Bibles across the AskSia library.
Sia - your 7SSGN110 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works