INT6067 Chap.5 Critically Reviewing a Journal Article
Critically Reviewing a Journal Article
The most precisely specified task in the course
In groups of five or six you are given a fifteen minute slot to deliver a critical review of one article from the indexed literature in artificial intelligence or educational technology. The assessment instruction lists what the talk must contain and the marking sheet says what each part is worth, so between them almost nothing is left to interpretation.
The internal split is where the planning starts: two per cent for introduction and background, twenty for the review and discussion of the article's components, five for conclusion and reflections, and three for overall structure and presentation skills.
Groups routinely spend five minutes introducing the article and three on the methods, which inverts the allocation exactly.
What each required part is really asking
The cover page names the members and the specific role and responsibility of each, which means who prepared which component rather than a list of names.
The introduction gives the article's title, authors, source and date, and explains why this article was chosen, with the rationale being the graded half.
The core is a review and discussion of the article's components: the background literature and how the article contributes to existing knowledge, the theoretical framework and its applicability, the research methods and whether they address the research questions, and the findings, conclusions and implications compared with related studies.
Conclusion and reflections asks for strengths, weaknesses and a reflection on the review process itself, and it is worth five per cent and frequently skipped. References use a consistent citation style.
Six probes that work on any empirical article
The twenty mark item rewards discussion rather than description, and the difference is whether you asked the study a question.
Six probes cover nearly everything a reader can legitimately raise: what the design was and who allocated participants; how many participants there were, who they were and who was left out; whether the instrument was built or borrowed and validated on whom; how long the study ran and how often it measured; whether the analysis matches the design; and whether the discussion claims more than the design allows.
All six are answerable from the method section alone, which is why a group that reads that section first finishes its preparation in an evening.
Two judgements the brief asks for separately
Appropriate asks whether a method could answer the question at all, since an interview study cannot establish an effect however well it is conducted.
Effective asks whether it was executed well enough to be believed, which is about sample size, instrument quality, attrition and analysis. A method can be appropriate and ineffective, or effective and inappropriate, and saying which you mean is the clearest marker of a critique that has read the study rather than skimmed it.
What this chapter covers
- 01
The published internal split of the thirty mark task
- 02
Budgeting fifteen minutes the way the marks are budgeted
- 03
Choosing an empirical article rather than a review
- 04
Specific roles on the cover page
- 05
Rationale for selection as the graded half of the introduction
- 06
Six probes for design, participants, instrument, duration, analysis and claim
- 07
Appropriate against effective as two separate judgements
- 08
What to present when the article states no theoretical framework
- 09
Comparing findings with related studies as a requirement, not a flourish
A methods critique written from the design alone
- 3State what the design earns.
- 3State what it costs.
- 3State where it stops.
Key terms
- Critical Review
- A discussion of a study's components that judges them rather than reporting them: what the design supports, what it costs and where the claim stops.
- Theoretical Framework
- The account of learning or behaviour a study works inside. Where a study names none, the assumptions its design implies can still be analysed, and the absence is itself reportable.
- Method Appropriateness
- Whether a method could answer the stated research question at all, independently of how well it was carried out.
- Method Effectiveness
- Whether a method was executed well enough for its result to be believed, judged on sample size, instrument quality, attrition and the fit of the analysis.
- Attrition
- Participants lost between the start of a study and its final measurement. Uneven attrition between conditions can produce a difference that has nothing to do with the intervention.
- Between-subject Design
- A comparison in which each participant experiences only one condition, so the conditions are compared across different people rather than within the same person.
Critically Reviewing a Journal Article FAQ
How do we divide a fifteen minute talk between six people?
Divide it by component rather than by minutes, since the marks are allocated that way. One person takes the introduction and rationale, which is about a minute; the four components of the central item take roughly ten between them; conclusions and reflections take two. The cover page has to name the specific role and responsibility of each member anyway, so deciding the division is not optional preparation.
All members are expected to contribute to the discussion, drafting and finalisation as well as to the delivery.
What if our article does not state a theoretical framework?
Report the absence as a finding and then analyse what the design assumes anyway: a study measuring recall after repeated practice assumes one account of learning, and one measuring group talk assumes another. Then place the absence in context, since reviews of this literature report weak connections to pedagogical theory as a field wide pattern.
That answer earns the framework marks, whereas saying the authors do not mention theory leaves them on the table.
Do we submit anything after presenting?
Yes. The slide deck is submitted separately from the talk, a few days afterwards, and one member uploads it on behalf of the group. Which of the two slide deadlines applies depends on which sitting your group presents in, so check that early. The slides also have to carry the statement on any artificial intelligence tools used, in the same way the individual report does.
Assessment move
Read the method section of your chosen article before anything else and answer the six probes in writing, one line each. If two or three probes cannot be answered from the article, that is your critique rather than a problem: a study that does not say who allocated participants or how long it ran has told you something about its own limits.
Then rehearse once with the slides advancing, because the section that overruns is always the one carrying the marks.
Working through Critically Reviewing a Journal Article in INT6067? Sia is AskSia’s AI Education tutor — ask any INT6067 Critically Reviewing a Journal Article question and get a clear, step-by-step explanation grounded in how INT6067 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.
