SOAD3021 Chap.9 Evaluation, Sustainability and Future Practice
Evaluation, Sustainability and Future Practice
Evaluation separates how an initiative operates from what it achieves. Formative evidence concerns participation, facilitation, inclusion and responsiveness, while summative evidence concerns outcomes. This chapter starts from the decision evidence must support, distinguishes activities, outputs and outcomes, and integrates community meaning with systematic inquiry.
Critical evaluation asks whose values define success and whether average findings conceal unequal benefit, burden or exclusion. A proportionate evaluation begins with use. Evidence may support adaptation during delivery, judgement about effectiveness, allocation of resources, accountability or a decision to continue, expand, pause or stop.
Naming the decision prevents indiscriminate data collection and clarifies whose interpretation must be included. Process questions examine reach, access, participation, facilitation, safety and responsiveness. Outcome questions examine the change the initiative sought.
Activities describe what the team does, outputs record what is delivered, and outcomes concern what changes for people, relationships, organisations or communities. Confusing these levels produces claims that exceed the evidence. Ten sessions demonstrate delivery, not improved wellbeing. Methods are selected for their contribution to the question.
Administrative records can show reach, observation can reveal interaction, short measures can track a defined change, and interviews or group interpretation can explain meaning and mechanism. Combining methods is valuable when their answers complement one another, not simply because mixed methods sound rigorous. Timing also matters: an early baseline, a process review and an outcome point answer different questions.
Community participation should extend to defining success and interpreting findings. An externally valid measure may still miss the change participants value, while an average result can conceal who benefited, who withdrew and who carried extra burden. Ethical evaluation limits collection, explains ownership and use, protects privacy and returns accessible findings. Uncertainty is part of the conclusion.
Alternative explanations, missing participation and design limits should shape the strength of the claim without making the report evasive. Sustainability is defined at the right level. The activity itself may end while knowledge, relationships, leadership, decision rights or an institutional practice continues.
A defensible recommendation names what should endure, what resources that requires, who owns the next decision and when the evidence will be reviewed again.
What this chapter covers
- 01
formative evaluation
- 02
summative evaluation
- 03
outputs
- 04
outcomes
- 05
community-defined success
- 06
sustainability
Worked example · free
Evaluating connection and access
- 1Separate reach from intended outcomes.
- 1Choose process and outcome evidence.
- 1Include community interpretation and equity.
- 1State a review decision and uncertainty.
Key terms
- Formative evaluation
- Evidence about implementation and how an initiative can improve while operating.
- Summative evaluation
- Evidence about achieved outcomes and the confidence attached to them.
- Outcome
- A change in condition, capacity, behaviour, relationship or access linked to an objective.
Evaluation, Sustainability and Future Practice FAQ
Why is attendance not an outcome?
Attendance shows reach or engagement with delivery. It does not by itself establish that wellbeing, connection, knowledge or access changed, so outcome evidence and interpretation are still required.
What makes evaluation critical?
Critical evaluation examines who defined success, whose knowledge shaped measures, whether methods fit context and whether average findings conceal unequal benefit or harm across groups.
What should sustainability mean?
Specify what should endure, such as relationships, leadership, knowledge, governance or institutional practice. Continuing the same funded activity is only one possible form of sustainability.
Assessment move
For one initiative, write a process question, an outcome question, a community-defined indicator and a decision the evidence could change. Add one alternative explanation and one privacy or burden check. Sort proposed evidence into activity, output, process and outcome before choosing methods. Reject any measure that cannot inform a real decision.
Practise writing a conclusion with four parts: finding, uncertainty, community interpretation and named next action. Finally, specify what sustainability means in that case and the resource or governance condition needed to maintain it. Create an evaluation matrix with purpose, question, indicator, method, timing, interpretation partner and decision.
Begin with a real choice such as adapt, continue, expand, pause or stop; avoid collecting a measure that cannot affect any choice. Correct five output claims by replacing sessions, attendance or materials delivered with evidence of the intended change. Keep outputs where they genuinely answer implementation questions.
Select methods because their strengths fit different parts of the question, then justify why combining them adds meaning instead of burden. Include people who withdrew where safe and feasible, because end-point feedback from remaining participants may conceal barriers. Write one alternative explanation for every outcome pattern and state what additional evidence could test it.
Review privacy, consent, ownership and how results will be returned accessibly. Disaggregate only where groups remain protected and the comparison supports a useful equity question. Define sustainability precisely as continuation of an activity, relationship, leadership capacity, knowledge or institutional change.
End by assigning the next action to a named role, giving a review time and stating the finding that would prompt a different decision.
