City University of Hong Kong · FACULTY OF INFORMATION TECHNOLOGY

IS6400 Chap.2 Multivariate Regression for Prediction

- one subject, every graph, every model, every mark
6 Chapters2-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 2 of 10 · IS6400

Multivariate Regression for Prediction

Coefficients are conditional changes

A multivariate regression prediction adds a baseline and feature contributions. A coefficient states the expected target change for one unit of its feature while the other listed features are held fixed.

The units must be translated before business meaning is discussed, and predictive association must not be presented as a causal effect.

Residuals locate missing structure

Residual equals observed minus predicted. Positive residuals are under-predictions and negative residuals are over-predictions. Plot them against fitted values, time and business segments.

Curvature, widening spread or runs of one sign suggest different repairs, such as nonlinear terms, variance treatment or a time feature.

Build a prediction from named contributions

Write the model as ŷ = β₀ + Σβⱼxⱼ and annotate every term with its unit. The intercept describes the reference case implied by the coding, while each coefficient-feature product moves that prediction.

Categorical indicators require a stated reference group, and interactions mean one coefficient cannot be interpreted without the level of another variable. Substitution should be shown before rounding so a reader can audit signs and scaling.

Protect the intended prediction time

For a store-week forecast, a field measured at the end of the week is unavailable to a decision made before the week begins.

Split by time when deployment predicts the future, and fit scaling, imputation and feature selection inside the training portion. Compare against a simple mean, trend or operational rule on identical rows.

A complex equation earns use only if its gain survives the same horizon and the same information boundary.

Diagnose before extending the equation

Plot residuals by fitted value, calendar time and relevant segment. A curve suggests a missing nonlinear relationship; a fan suggests changing variance; repeated positive misses suggest bias or drift.

Extreme observations should be checked for data error and influence rather than deleted automatically. After a repair, rerun the held-out comparison and state where the model has little support. Prediction beyond the represented feature range is extrapolation, not an ordinary application of the fitted coefficients.

In this chapter

What this chapter covers

  • 01

    Row definition and feature availability

  • 02

    Baseline plus feature contributions

  • 03

    Coefficient units and conditional interpretation

  • 04

    Observed minus predicted residuals

  • 05

    Residual plots by time and segment

  • 06

    Prediction versus causal claims

Worked example · free

Predict weekly demand and explain the residual

Q [8 marks]. AskSia-authored practice. The listed marks are AskSia study allocations, not a University rubric. A fitted rule is 90 + 30 promotion - 4 price gap + 3 traffic index. For promotion 1, price gap 2 and traffic index 5, actual demand is 131. Compute and interpret.
Each step changes the running prediction.Each step changes the running prediction. A 120-unit baseline gains 60 from promotion, loses 10 from price and gains 24 from footfall, ending at 194.Predicted weekly sales: 120 + 60 - 10 + 24 = 194120+60-10+24baselinepromotionpricefootfall194 units
Each step changes the running prediction. A 120-unit baseline gains 60 from promotion, loses 10 from price and gains 24 from footfall, ending at 194.
  • 3Substitute the feature values with signs. The weighting used here is not a published University assessment scheme.
  • 2Compute the residual using observed minus predicted.
  • 3State the safe business interpretation.
The prediction is 90 + 30 - 4(2) + 3(5) = 90 + 30 - 8 + 15 = 127. The residual is 131 - 127 = +4, so the model under-predicted by four units. The promotion coefficient says promoted weeks are associated with thirty more expected units after controlling for the listed variables; it does not prove the promotion caused the increase. Check whether promotions were selected for already-strong weeks before using the coefficient as a return estimate.
Sia tip — Say residual equals actual minus predicted aloud before calculating; the sign then explains the direction of the miss.
Glossary

Key terms

Regression Coefficient
The conditional expected change in a target for a one-unit feature change under the fitted model.
Intercept
The fitted baseline when all encoded predictors equal their reference or zero value.
Residual
The observed target minus the model prediction for one row.
Interaction Term
A feature allowing one predictor's fitted effect to change with another predictor.
Extrapolation
Applying a fitted relationship beyond the feature range represented in training.
FAQ

Multivariate Regression for Prediction FAQ

Why is a regression coefficient not automatically a causal effect?

Other factors can influence both the predictor and target, and the business may choose the predictor based on expected outcomes. Regression conditions on listed variables but does not by itself create the comparison required for causality.

What does a positive residual mean?

Because residual is actual minus predicted, a positive value means the observation exceeded the prediction and the model under-predicted. A negative residual means the model predicted too much.

Which residual patterns matter most?

Curvature suggests missing nonlinear structure, widening spread suggests changing variance, and long runs of one sign suggest drift or an omitted time effect. Segment-specific patterns can reveal a model that works only for part of the business.

Study strategy

Exam move

For each practice equation, write target units above the intercept and feature units under every coefficient. Compute a prediction, then an actual-minus-predicted residual, and finish with one sentence separating association from causation. Create three residual sketches: random scatter, curved pattern and widening fan. For each, name the first repair you would investigate and the deployment risk if it were ignored.

Add a fourth sketch with a run of one-sided errors over time and distinguish drift from a reversed residual sign. Practise changing a feature unit, such as dollars to hundreds of dollars, and update the coefficient interpretation without changing the underlying prediction. Finally compare the fitted rule with a baseline on the same held-out rows and state the feature range beyond which the answer would become extrapolation.

A+Everything unlocked
Unlocks this Bible + all 31 of your subjects at City University of Hong Kong, plus 1,000+ more Bibles across the AskSia library.
Sia - your IS6400 tutor, unlimited, worked the way the exam marks it
The full 2-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works