University of Sydney · FACULTY OF HEALTH & MEDICINE

CEPI5215 Chap.9 Reviewing a Medical Paper

- one subject, every graph, every model, every mark
6 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 9 of 9 · CEPI5215

Reviewing a Medical Paper

Peer reviewers advise editors by evaluating contribution, validity, reporting and ethical issues. This chapter begins with expertise, time, conflicts and confidentiality before acceptance, then uses layered reading to distinguish major scientific concerns from minor presentation points.

A constructive report summarises the manuscript, prioritises numbered comments, explains why each issue matters and states what adequate repair would require. The recommendation should follow the documented evidence and journal criteria. Review quality depends on proportionality. A fatal validity problem, a limitation requiring narrower interpretation and a stylistic preference should not receive equal weight.

Explicit prioritisation helps authors allocate revision effort and helps editors understand whether the manuscript can become reliable.

In this chapter

What this chapter covers

  • 01

    The function and limitations of peer review in editorial decision-making

  • 02

    Expertise, workload, conflicts of interest and confidentiality before acceptance

  • 03

    Layered appraisal of question, design, methods, results and interpretation

  • 04

    Major and minor comments, evidence, feasibility and priority

  • 05

    Ethical concerns, confidential editor communication and professional tone

  • 06

    Report structure and proportionate publication recommendation

Worked example · free

Review a trial with selective-reporting concerns

Q [4 marks]. AskSia-authored practice. A polished trial paper omits participant flow, does not explain allocation concealment, switches the registered primary outcome and makes a causal subgroup claim. Build a four-part review. The structure is independent practice, not an official marking scheme.
The review balance weighs several obligations.The review balance weighs several obligations. Scope, validity, reporting clarity and publication ethics inform a proportionate recommendation; no single attractive result can cancel a fundamental design or integrity concern. ScopeValidityClarityEthicsDecision
The review balance weighs several obligations. Scope, validity, reporting clarity and publication ethics inform a proportionate recommendation; no single attractive result can cancel a fundamental design or integrity concern.
  • +1State the research question, design and claimed contribution neutrally before criticism.
  • +1Prioritise allocation and participant-flow information needed to assess selection and attrition.
  • +1Request a comparison with registration and transparent labelling and justification of outcome changes.
  • +1Require exploratory subgroup labelling, uncertainty and a recommendation proportionate to whether the record is repairable.
The report should prioritise validity and selective-reporting concerns over prose polish. Each major comment states the missing evidence and consequence, and the recommendation follows whether reliable appraisal remains possible.
Sia tip — Make each major comment state the problem, its consequence and the evidence or revision needed for appraisal.
Glossary

Key terms

Peer review
Expert assessment that informs, but does not replace, an editor’s publication decision.
Reviewer conflict
A relationship or interest that may compromise, or appear to compromise, independent evaluation.
Major comment
A concern affecting validity, interpretability, ethics or essential reporting.
Minor comment
A local clarity or presentation point that does not change the central scientific judgment.
Confidentiality
The obligation not to share or use unpublished manuscript information without permission.
Recommendation
The reviewer’s proportionate advice to the editor based on the documented report and journal criteria.
FAQ

Reviewing a Medical Paper FAQ

When should a review invitation be declined?

Decline promptly when the topic or method is outside your competence, the deadline is unrealistic, or a conflict prevents independent evaluation. Disclose uncertain relationships to the editor rather than deciding privately that they do not matter.

What makes criticism constructive?

Identify the specific manuscript issue, explain its consequence for validity or understanding, and state what information or revision would address it. Comment on the work rather than the authors and distinguish requirements from personal preferences.

Should ethical concerns be sent only to the editor?

Specific suspected misconduct may need confidential communication under journal procedure, but ordinary scientific concerns should also be stated clearly enough for authors to respond. Avoid public accusation and provide the factual basis without conducting an unauthorised investigation.

Can a reviewer involve a colleague?

Only through the journal’s authorised process. Ask the editor before sharing confidential material, identify any co-reviewer as required and ensure conflicts and contributions are disclosed. Informal forwarding breaches the manuscript’s confidentiality.

Should reviewers correct every language error?

No. Identify representative patterns and explain when language prevents scientific appraisal. Major review effort belongs to validity, reporting and inference. Detailed copyediting is inefficient when the journal may require substantive revision or decline the paper.

How should suspected misconduct be described?

Document the specific observation and communicate it confidentially to the editor under journal procedure. Avoid definitive accusation without investigation, do not contact third parties independently and keep the manuscript confidential while the authorised process assesses it.

What should a reviewer do when a paper is outside the journal scope?

Explain the scope mismatch to the editor and still identify any central scientific concern needed for a fair decision if the review was undertaken. Do not demand unrelated expansion simply to force fit. The editor, not the reviewer, makes the final venue decision.

Study strategy

Assessment move

Read the manuscript in layers. On the first pass, capture the question, design and main claim. On the second, test participants, variables, analysis, flow and results. On the third, inspect interpretation, displays, references and clarity. Draft major comments in priority order with consequence and requested evidence, then add only useful minor points.

Remove hostile language and demands that redesign a sound study into your preferred project. Finally read the major comments beside the recommendation; the decision should be predictable from the report. Draft the review away from the submission form first. Use headings for summary, major comments and minor comments, and number every actionable point.

For each major comment, add one sentence explaining the consequence for validity or interpretation. Remove requests that are merely your preferred design, and check whether proposed analyses are possible with the collected data. Before submitting, verify that confidential comments do not contradict what authors are allowed to see and that the recommendation follows the report.

A+Everything unlocked
Unlocks this Bible + all 202 of your University of Sydney subjects - and 1,000+ Bibles across every Australian university.
Sia - your CEPI5215 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works