The Hong Kong University of Science and Technology · FACULTY OF ARTS & HUMANITIES

MAIE5103 Chap.8 Beyond Bias: Targets, Boundaries and Abstraction Traps

- one subject, every graph, every model, every mark
8 Chapters3-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 8 of 14 · MAIE5103

Beyond Bias: Targets, Boundaries and Abstraction Traps

A fair model, an unfair outcome

The Beyond Bias lecture begins with a selector that has equal error rates across two groups and asks whether it should be deployed, and whether there is enough information to say.

The point is that a metric describes a bounded test, while an outcome depends on the whole decision process around the model and on the institution around that: who can apply, what capacity exists, what incentives operate and whether anyone can challenge a result.

Widening the boundary is the first move of the lecture and of this chapter.

Where harm enters, and what the target really is

Following Suresh and Guttag, harm can enter through history, representation, measurement, aggregation, learning, evaluation and deployment, and the right intervention depends on which.

The lecture then separates five layers of a target: the construct an institution cares about, the label actually recorded, the model's prediction, the decision taken and the impact on the person.

Accuracy against a label says nothing about whether the label is valid for the construct, and the care-cost algorithm, which predicted spending rather than need, is the lecture's demonstration of how much that gap can cost.

Five traps and the labels nobody collects

Selbst and colleagues name five abstraction traps: framing that leaves institutions out, portability that assumes fairness travels, formalism that turns a contested value into a number, ripple effects of deployment on behaviour, and solutionism that assumes technology is the answer.

The remedy is a better boundary, not no abstraction. Selective labels add a final problem: once a system decides who is selected, the outcomes of those rejected are never observed, so the training data narrows to the people it already chose.

In this chapter

What this chapter covers

  • 01

    The opening poll and what a metric cannot tell you

  • 02

    Model, decision pipeline and institution as nested boundaries

  • 03

    Seven places harm can enter the life cycle

  • 04

    Construct, label, prediction, decision and impact

  • 05

    Predicting cost is not predicting need

  • 06

    A larger harm map beyond allocation and representation

  • 07

    Five abstraction traps

  • 08

    Feedback and selective labels

Worked example · free

Separate the construct from the label in a scholarship rule

Q [5 marks]. AskSia-authored practice. A foundation awards research scholarships to the students a model predicts will publish within two years, trained on which past scholars published. Its goal statement says the scholarship exists to develop research potential. Lay out the five target layers for this scheme and identify the gap that matters most. The marks shown are an AskSia study allocation, not a University marking scheme.
A metric is measured in the innermost frame; an outcome is lived in the outermost.A metric is measured in the innermost frame; an outcome is lived in the outermost. The model sits inside a pipeline of data, score, action and outcome, which sits inside an institution that controls access, capacity, incentives and remedy.Institutionaccess, capacity, remedyDecision pipelinedata, score, action, outcomeModelwhere metrics live
A metric is measured in the innermost frame; an outcome is lived in the outermost. The model sits inside a pipeline of data, score, action and outcome, which sits inside an institution that controls access, capacity, incentives and remedy.
  • 2State the construct and the observed label.
  • 1State the prediction, the decision and the impact.
  • 2Identify the construct-to-label gap and who it misses.
The construct is research potential; the observed label is whether past scholars published within two years. The prediction is a probability of early publication, the decision is the award, and the impact is funded time and mentoring that themselves make publication more likely. The gap that matters is between potential and early publication: early publishing tracks access to established labs, supervisors with spare capacity and fields with short publication cycles, so the label rewards prior advantage. Students in slower-publishing fields or without lab access may have high potential and a low score. Because winners receive the resources that produce publications, the scheme's own data will keep confirming the proxy.
Sia tip — Write the construct in the institution's own words before you look at the label; if the two sentences describe different things, that difference is your main finding.
Glossary

Key terms

System Boundary
The line an analysis draws around what it treats as the system, which decides whether institutions, incentives and remedies are inside the question.
Construct Validity
Whether a measured label actually captures the concept a decision is meant to serve, such as need rather than spending.
Abstraction Trap
One of five ways a technical framing loses the social context it needs: framing, portability, formalism, ripple effect and solutionism.
Selective Labels
The problem that outcomes are observed only for people a system selected, so the outcomes of those rejected never enter the data.
Solutionism
The assumption that technology is the right intervention, answered by asking whether a problem should be automated at all.
FAQ

Beyond Bias: Targets, Boundaries and Abstraction Traps FAQ

What does it mean to go beyond bias in AI ethics?

It means treating fairness metrics as necessary but not sufficient. A system can meet every metric and still cause harm through an invalid target, exclusion from the process, lack of recourse, privacy exposure, concentrated power or material costs such as energy, water and labour. The lecture's phrase is that going beyond bias is not going beyond fairness: the metrics stay, and the boundary around them widens.

What is target validity and why does it matter?

It is the question of whether the label a model predicts actually represents what the institution cares about. A model can predict its label accurately while the label is the wrong thing, as when health spending stood in for health need. The lecture separates construct, label, prediction, decision and impact so that an analysis can say exactly where the mismatch lies.

What are the abstraction traps in sociotechnical systems?

Selbst and colleagues describe five. Framing leaves institutions outside the system. Portability assumes a fair system stays fair in a new setting. Formalism reduces a contested value to a metric. The ripple effect ignores how deployment changes behaviour. Solutionism assumes technology is the right intervention. Each comes with a diagnostic question, such as asking which human decisions the framing hid.

Study strategy

Assessment move

For any case you study, write the five target layers in a column before reading anyone's analysis, then run the five trap questions against it. The two lists together take ten minutes and almost always surface a problem the metrics missed. They also give a case study analysis a structure that markers can follow, because each paragraph answers one named question.

Working through Beyond Bias: Targets, Boundaries and Abstraction Traps in MAIE5103? Sia is AskSia’s AI Arts and Humanities tutor — ask any MAIE5103 Beyond Bias: Targets, Boundaries and Abstraction Traps question and get a clear, step-by-step explanation grounded in how MAIE5103 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

A+Everything unlocked
Unlocks this Bible + all 13 of your subjects at The Hong Kong University of Science and Technology, plus 1,000+ more Bibles across the AskSia library.
Sia - your MAIE5103 tutor, unlimited, worked the way the exam marks it
The full 3-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works