The Education University of Hong Kong · FACULTY OF EDUCATION

PES6252 Chap.5 Systematic Observation as a Working Method

- one subject, every graph, every model, every mark
6 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 5 of 11 · PES6252

Systematic Observation as a Working Method

Why a record, rather than a judgement

The published course content lists analysis of coaching behaviours as a topic in its own right, and this chapter is the method behind it. The argument for the method runs in three steps.

Teaching is the core of the job: a coach also feeds, manages and mentors a squad, yet in most sports it is the teaching that comes first, which makes the training session the place where athletes are actually made.

No coach can report on their own teaching: sessions move at dozens of acts a minute, recollection keeps what already fits, asking a coach yields intentions rather than actions, and the athletes in the room saw something different again, so one session leaves three accounts of itself behind.

And with no record, a sentence like I am always positive with them is not a claim anyone can check.

The definition is a list of requirements

The definition the course uses sets four conditions at once. Somebody trained, working to written rules, watches what happens, writes it down, and then interprets it, and the whole thing counts only if another person watching the same passage would produce the same record.

Every clause in that sentence is a requirement. A trained person means tested against a criterion before any real data are collected. Stated guidelines means categories written in advance with decision rules for borderline cases. Observe, record and analyse are three distinct acts, and collapsing the first two produces impressions dressed as counts.

Others would agree is the condition that makes the data mean anything, and it is why a coach who codes a season alone has produced numbers with no more authority than his impressions had.

In this chapter

What this chapter covers

  • 01

    Instruction as the priority coaching role, and the practice session as the unit

  • 02

    Three versions of the same practice: claimed, observed and perceived

  • 03

    Four uses of a behaviour record, from description to theory testing

  • 04

    The definition, clause by clause, as a set of requirements

  • 05

    Exhaustive and mutually exclusive categories, and why uncodable exists

  • 06

    The five stage observation cycle, and where the reliability check sits

Worked example · free

Design a two session comparison and state its limits

Q [10 marks]. AskSia authored practice. You have two recordings of one rugby coach, a forty minute Tuesday skills session and a seventy five minute Saturday pre match session, and one question: does he give more corrective feedback when the stakes are higher? Set the study up and say what the result will not be able to claim. The marks shown are an AskSia study allocation and are not the University marking scheme.
  • 3Build a category set that satisfies both required properties.
  • 3Assign a recording method per behaviour, not per study.
  • 4Handle the unequal session lengths, and state three limits.
The category set can be small because the question names one behaviour, but it must still be exhaustive and mutually exclusive: corrective feedback, other instruction, praise or encouragement, management, silence or monitoring, plus uncodable to absorb what cannot be heard. Without the last two, everything ambiguous inflates whichever category the coder prefers. Corrective feedback, praise and management are discrete acts and are event recorded; silence and monitoring is a state with a length and is duration recorded; interval recording would be added only if the question were about how session time was distributed. Train against a criterion on a third recording that will not be analysed, code both sessions, and re establish agreement partway rather than at the end. Because the sessions are forty and seventy five minutes, report rate per minute, since a raw comparison would report the length of the Saturday session as though it were the coach behaviour. The result can say the rate of corrective feedback differed between these two sessions. It cannot say why, because observation does not reach intention; it cannot say the feedback was good, because the categories count occurrences; and with one coach and two sessions it cannot say anything about stakes in general.
Sia tip — Choose the recording method per behaviour rather than per study. A single method applied to everything will either miss the states or inflate the acts, and both errors show up only after the coding is done.
Glossary

Key terms

Exhaustive Categories
A category set in which every behaviour that can occur has somewhere to be coded, which is why published instruments include an uncodable option.
Mutually Exclusive Categories
A category set in which no behaviour can legitimately be coded in two places, so that two trained coders reach the same decision.
Interval Recording
A recording method that codes what is happening at fixed time points rather than counting occurrences, which produces a picture of how session time was distributed.
FAQ

Systematic Observation as a Working Method FAQ

What is the difference between systematic and casual observation?

Four differences, and the second is the one that matters. Systematic observation uses predefined written categories, codes every occurrence equally, produces quantified reproducible output, and makes agreement between observers testable. Casual watching has no predefined categories, drifts toward dramatic moments, is impressionistic and unverifiable, and gives different observers different stories.

The drift toward the dramatic is not merely imprecision: one furious moment and forty quiet corrections do not weigh equally in anyone memory, and a coded record is the only thing that puts them on the same scale.

Why must the reliability check happen during data collection?

Because definitions loosen or tighten over time and the person whose definitions are moving cannot feel it. If agreement is measured only at the start, every session after the first rests on an assumption; if only at the end, a fall in agreement cannot be located in time.

The practical damage is largest in before and after designs, where a loosening definition will manufacture exactly the change an intervention was meant to produce. One extra double coded session partway through is what makes the rest interpretable.

Study strategy

Assessment move

Code twenty minutes of any coaching video with a five category set of your own before you read the instrument chapters. The exercise fails, reliably and instructively, on the exhaustive and mutually exclusive requirements, and having felt that failure once is what makes the published category lists read as solutions rather than as arbitrary lists to memorise.

Working through Systematic Observation as a Working Method in PES6252? Sia is AskSia’s AI Education tutor — ask any PES6252 Systematic Observation as a Working Method question and get a clear, step-by-step explanation grounded in how PES6252 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

A+Everything unlocked
Unlocks this Bible + all 3 of your The Education University of Hong Kong subjects - and 1,000+ Bibles across every Australian university.
Sia - your PES6252 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works