University of Toronto · FACULTY OF STATISTICS

PSYB06H3 Chap.7 Independent and Paired Samples t Tests

- one subject, every graph, every model, every mark
6 Chapters3-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 7 of 8 · PSYB06H3

Independent and Paired Samples t Tests

Two samples, no known population

Most psychology studies know nothing about the population beyond the samples collected. The two-sample t tests handle that situation by comparing groups with each other rather than with a known mean. The first decision is structural: did different people supply the two sets of scores, or did the same people supply both?

Separate people call for an independent samples t test, while repeated or matched measurements call for a paired samples t test.

Independent samples

The independent test divides the difference between the two sample means by an error term built from both sample variances, each divided by its own group size.

Degrees of freedom equal the two sample sizes added together minus two, and groups of different sizes are acceptable.

Before testing, compare the variances with Hartley's F max, the larger variance over the smaller, and check the ratio against the tabled threshold for two conditions.

Paired samples

The paired test subtracts each participant's first score from the second, then asks whether the mean of those differences departs from zero.

Because the analysis runs on differences, any participant missing one score must be removed, and degrees of freedom count the remaining pairs minus one.

Pairing removes stable individual differences from the error term, which is why a modest average change can still be significant.

Beyond the decision

A complete answer states the assumptions, checks homogeneity of variance, screens for impossible or extreme scores and, where helpful, draws the means with standard error bars.

Effect size d expresses the mean difference in pooled standard deviation units, with 0.20, 0.50 and 0.80 marking small, medium and large effects. When the test fails to reject the null, the next step is a power analysis rather than a claim that the groups are the same.

In this chapter

What this chapter covers

  • 01

    Choosing Independent or Paired Designs

  • 02

    Hartley's F Max Check

  • 03

    Independent Samples t Statistic

  • 04

    Pooled Variance and Effect Size d

  • 05

    Paired Difference Scores

  • 06

    Deleting Incomplete or Impossible Data

Worked example · free

A paired test from summary values

Q [4 marks]. AskSia-authored practice. Ten participants rate their mood before and after a short walk. The mean of the after minus before differences is 1.8 points and the standard deviation of the differences is 2.4. Test for a change at alpha .05, two-tailed, reporting values to four decimal places. The four marks are an AskSia practice allocation, not a University marking scheme.
Bar heights show the two group means from the spaced versus massed example, and each whisker spans one standard error above and below its mean, so the bars do nBar heights show the two group means from the spaced versus massed example, and each whisker spans one standard error above and below its mean, so the bars do not overlap.0102016.375Spaced13.000MassedRecall score
Bar heights show the two group means from the spaced versus massed example, and each whisker spans one standard error above and below its mean, so the bars do not overlap.
  • 1Hypotheses: the population mean difference equals zero versus does not equal zero.
  • 1Standard error of the differences: 2.4 / √10 = 0.7589.
  • 1Statistic: t = (1.8 − 0) / 0.7589 = 2.3717 with df = 10 − 1 = 9.
  • 1Compare with the two-tailed critical value 2.262 for df = 9 and reject the null.
Working from the differences turns the problem into a one-sample t test against zero. The standard error equals the differences' standard deviation divided by the square root of the number of pairs, 2.4 / 3.1623 = 0.7589. The obtained statistic is 1.8 / 0.7589 = 2.3717 on 9 degrees of freedom. Because 2.3717 exceeds the critical 2.262, the probability of a change this large under the null is below .05. Mood ratings rose after the walk, t(9) = 2.37, p < .05.
Sia tip — Count degrees of freedom from pairs, not scores: ten people measured twice give df = 9, not 18.
Glossary

Key terms

Independent Samples
Two groups made of different participants, so each person contributes a score to only one condition.
Paired Samples
Two sets of scores from the same or matched participants, analysed as one column of difference scores.
Homogeneity of Variance
The assumption that the compared groups have similar variances, checked by hand with Hartley's F max.
Hartley's F Max
The ratio of the largest group variance to the smallest, compared with a tabled critical threshold.
Difference Score
One participant's second measurement minus the first, the unit a paired t test analyses.
Cohen's d
The mean difference divided by the pooled standard deviation, with 0.80 or more classed as a large effect.
FAQ

Independent and Paired Samples t Tests FAQ

How do I decide between an independent and a paired t test?

Ask who produced each score. If every participant appears in only one condition, the groups are independent. If each participant, or each matched pair, contributes one score to both conditions, the design is paired and the analysis uses difference scores. Group sizes are a clue too: paired data always have equal counts once incomplete pairs are removed.

What happens to participants with a missing score?

In a paired design, a participant missing either measurement cannot produce a difference score, so the whole pair is deleted before analysis. In an independent design the remaining scores are kept and the groups simply end up with unequal sizes. Scores that are impossible, such as recall above the number of items shown, are removed in either design.

Why check the variances before an independent t test?

The comparison assumes the two populations spread similarly. Hartley's F max divides the larger sample variance by the smaller; a ratio below the tabled value for two conditions supports that assumption. Reporting the check shows the marker the test was appropriate, which the practice answers treat as part of a full solution.

Is a large t value the same as a large effect?

No. The t statistic grows as samples grow, so a tiny difference can become significant with enough participants. Effect size d divides the mean difference by the pooled standard deviation instead, which keeps it on the same scale whatever the sample size. Report both so a reader knows whether the difference is reliable and whether it is substantial.

Study strategy

Exam move

Build a two-column habit for every problem: first decide the design and write the matching formula, then run the variance check before the main test. Practise one raw-data and one summary-statistic problem for each test, and time yourself on reading the critical t for the right degrees of freedom.

Finish each solution with direction, significance and effect size in one sentence, and mark any nonsignificant result as needing a power analysis.

Working through Independent and Paired Samples t Tests in PSYB06H3? Sia is AskSia’s AI Statistics tutor — ask any PSYB06H3 Independent and Paired Samples t Tests question and get a clear, step-by-step explanation grounded in how PSYB06H3 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

A+Everything unlocked
Unlocks this Bible + all 21 of your University of Toronto subjects - and 1,000+ Bibles across every Australian university.
Sia - your PSYB06H3 tutor, unlimited, worked the way the exam marks it
The full 3-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works
PSYB06H3 · Applied Statistical Analysis for Psychology & Neuroscience - independent study guide on the AskSia Library. More University of Toronto subjects · Microeconomics across all universities