SALC60101 Chap.4 Heritage, Sustainability and Impact Evidence
Heritage, Sustainability and Impact Evidence
Heritage, Sustainability and Impact Evidence turns broad goals into measures that can inform action. Cultural heritage and tourism projects can support participation, identity, income and regional development while also creating congestion, exclusion or pressure on heritage resources.
Policy-level indicators help decision-makers adapt instruments and priorities, while project-level indicators support operational management. Neither level can treat an easy output as proof of a distant outcome. Attendance, contracts and revenue may be useful, but they need interpretation against the intended social, cultural, environmental or economic change.
This chapter builds causal chains from resources and activities to outputs and outcomes, examines distribution and unintended effects, and shows how qualitative evidence can reveal mechanisms and affected voices that totals cannot capture.
What this chapter covers
- 01
Policy and project indicator levels
- 02
Heritage and tourism sustainability
- 03
Inputs, outputs and outcomes
- 04
Distribution and affected communities
- 05
Qualitative and quantitative evidence
- 06
Indicator limits, adaptation and review
Worked example · free
Evaluate an augmented-reality heritage trail
- 1Define the intended outcomes across engagement, local benefit, representation and visitor pressure.
- 2Select policy measures for local commissioning, capacity and geographic access, then project measures for use, barriers, learning and resident experience.
- 2Combine usage data with structured community and participant feedback, including governance of stories and user data.
- 1Set review actions for congestion, misrepresentation, accessibility barriers and weak local benefit.
Key terms
- Impact indicator
- A measure selected to observe progress toward a defined change or public goal.
- Causal chain
- A reasoned sequence linking resources and activities to outputs, outcomes and wider effects.
- Target substitution
- The displacement of an underlying goal by the easier task of improving a measured number.
Heritage, Sustainability and Impact Evidence FAQ
What is the difference between an output and an outcome?
An output is the immediate product of activity, such as events delivered or participants registered. An outcome is a change for people, organisations or places, such as improved access or learning. Outputs can contribute to outcomes but do not prove them automatically.
Why separate policy and project indicators?
Policy indicators inform choices about instruments, priorities and enabling conditions across a wider system. Project indicators guide delivery and operations in a specific intervention. The same broad goal may require different measures and decision thresholds at those two levels.
How should qualitative evidence be used?
Use interviews, observation or participant accounts to explain mechanisms, variation and unintended effects. Select them systematically and connect them to the claim. A vivid quotation can illustrate an experience, but one comment cannot establish a community-wide outcome.
Assessment move
For every policy or project case, draw a causal chain from resources to activities, outputs, outcomes and wider goals. Under each arrow, write the assumption that makes the next step plausible. Choose one indicator for the intended outcome and one balancing indicator for an unintended effect. Distinguish the population affected from the population easiest to measure.
Practise turning broad terms such as sustainability, participation and regional benefit into observable constructs while preserving their cultural meaning. Compare policy-level evidence with project-level evidence and state which decision each can inform. When reading an evaluation, mark whether the design measures volume, quality, distribution, duration or mechanism.
Add a limitation at the exact claim boundary rather than using a generic data caveat. Use qualitative material to investigate why an outcome changed and quantitative material to assess pattern, scale or distribution where appropriate. Watch for target substitution after a measure becomes linked to funding or reputation.
In recommendations, specify continue, revise, scale or pause, then name the evidence driving that choice and the next review point. This keeps evaluation connected to management and policy instead of ending with a dashboard. Create an indicator card for every important measure.
Include the construct, operational definition, population, data source, collection responsibility, timing, comparison, decision threshold and known limitation. If two indicators share a label but use different definitions, keep them separate rather than combining the results. Add one distribution question to each card: whose outcome could an average conceal?
For heritage work, pair visitor or usage data with evidence about resident experience, representation, conservation pressure and community authority. For economic claims, distinguish spending from retained local value and contract counts from work quality. Practise explaining why an output does not prove an outcome by writing the missing causal assumption between them.
Then identify a form of evidence that could test that assumption. Build a short methods note for qualitative evidence covering selection, consent, interpretation and variation, so quotations become evidence of mechanism rather than decoration. When reviewing a dashboard, remove measures that have no plausible decision attached and add a balancing measure where target pursuit could distort delivery.
End each case with a review calendar: who interprets the evidence, who can challenge it, what action follows and when the outcome is reassessed. This routine connects measurement to governance while preserving uncertainty. It also helps distinguish a responsible recommendation from an attractive but unsupported impact story.