City University of Hong Kong · FACULTY OF ARTIFICIAL INTELLIGENCE

BMS5010 Chap.1 How Machines Learn from Health Science Data

- one subject, every graph, every model, every mark
7 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 1 of 7 · BMS5010

How Machines Learn from Health Science Data

Three words that are not synonyms

Artificial intelligence is the outer scope, described in the course through a definition attributed to John McCarthy as the science and engineering behind machines that behave intelligently. Machine learning is one route to it, distinguished by the fact that the behaviour is learned automatically from accumulated data rather than written down as rules.

Deep learning is a branch of machine learning in which the system learns its own representation of the input. Each inner term is a narrower claim rather than a newer one, and a deep learning claim is always also a machine learning claim.

Getting this ordering wrong makes several later arguments impossible to state, which is why the chapter fixes it before anything else.

The training loop, in the three steps the course gives

A model receives an example whose correct output is known, calculates the difference between its own prediction and that correct output, and changes the weights on its inputs so the difference shrinks, repeating until the weights stop improving.

The quality of the predictions improves with experience, and more data usually helps up to a point. Two consequences follow immediately and both are examinable. A model needs a number that says how wrong it currently is, which is why a whole later chapter is devoted to choosing that number.

And the loop optimises exactly what you measure, so a model scored on overall correctness will become correct in the easy majority and useless in the minority that matters, without telling you.

Who supplies the features

Traditional machine learning takes raw input, has a person extract features, and hands those features to an algorithm.

Deep learning removes the human step and learns the features from the data through multiple non-linear transformations. The course is clear that this was a response to failure rather than an aesthetic preference: speech recognition and object detection in images resisted the first pipeline because nobody could write down what a good feature was. The trade is real.

Learned features need far more examples and far more computation, and they leave you with a representation nobody can inspect, so on a clinical table with a few thousand rows and twenty well-understood measurements the first pipeline is usually the better engineering decision.

What the course says these systems cannot do

Five limits are published and they are listed in an order that reflects how often each one bites.

Superficial features and patterns are identified while meanings and concepts are not. Correlations are found while causal relations are not. There is no common sense, no general intelligence and no integration of domain knowledge unless somebody supplies it. Explainability is poor and identified faults are hard to repair. And a model is only as good as its training data, so generalising beyond that data is difficult.

The second limit is the one that reaches print most often, usually as a sentence claiming a model has shown that one thing causes another. The fifth is the one an entire later chapter exists to test.

The benefit case, and how to state it so it survives

The upside is framed in terms of scale rather than cleverness.

These systems derive insight about biological, diagnostic and therapeutic processes from data, accelerate the interpretation of large and diverse information, and enable options that were not previously available. The supporting figure in the course materials is an estimate that a fifth of unmet clinical demand could be addressed this way, against a projection in which clinician supply falls behind demand.

Notice the shape of that argument, because your project introduction needs one like it: it claims a gap between demand and supply rather than superiority over a clinician, and an argument built that way survives the obvious objection while a superiority claim does not.

Why adoption fails even when the model works

Seven obstacles are named: ordinary teething problems, data privacy, compliance with the regulations governing patient data, the black box difficulty, the number of stakeholders who can each refuse, caution around clinical decision support, and the requirement that the output be easy to use with a clear result.

Read as complaints they are forgettable; read as a checklist they are the questions a discussion section has to answer. Set against them the course gives one case where adoption worked, a screening workflow whose output says within about a minute whether the image was adequate, whether the patient is clear, or whether onward review is needed.

The difference is not model quality but whether the output slots into a decision somebody was already making.

In this chapter

What this chapter covers

  • 01

    Artificial intelligence, machine learning and deep learning as nested scopes

  • 02

    The three-step training loop and what it implies about measurement

  • 03

    Feature extraction by a person against representation learned from data

  • 04

    When the extra cost of learned features is and is not worth paying

  • 05

    Five published limits, and which one produces the commonest false sentence

  • 06

    The demand-gap form of the benefit argument

  • 07

    Seven obstacles to adoption and the four conditions for success

Worked example · free

Separate the learning problems from the labelling projects

Q [8 marks]. AskSia-authored practice. A respiratory clinic wants four things: flagging referrals that need an urgent appointment, grouping existing patients to see whether one service or three is being run, reading spirometry traces automatically, and choosing between two follow-up intervals. Which are learning problems, and of those, which kind? The marks shown are an AskSia study allocation and are not the University's marking scheme.
  • 3Say for each request whether a recorded outcome exists to learn from.
  • 3Name the task type for those that are learnable.
  • 2Identify the request that is not a prediction at all, and say why.
The first is supervised and the target is discrete, so it is classification: past referrals carry the outcome that becomes the label. The second has no label anyone recorded, so it is unsupervised and specifically clustering, whose whole output is a group identifier. The third is supervised too, and the interesting point is that its label exists only because clinicians already annotated traces; without that annotation it is a labelling project rather than a learning problem. The fourth is a choice between actions whose consequences arrive later, which is the shape reinforcement learning addresses, and the clinic has no mechanism for delivering the reward signal. Three of the four are learnable and two are ready today.
Sia tip — Before naming a method, ask which column would be the label and who wrote it down. If nobody did, the project is annotation, not modelling.
Glossary

Key terms

Representation Learning
Learning the features of the input as part of training rather than receiving them from a person, which is the property that distinguishes deep learning from the pipeline before it.
Training Loop
The repeated cycle of seeing a known answer, measuring the gap to it and adjusting the input weights until the gap stops shrinking.
Black Box Difficulty
The inability of a model to answer the question why, which leaves the reasoning behind a decision unavailable and is the obstacle most often cited by clinicians asked to act on one.
Clinical Decision Support
The use of a system to inform a decision a clinician is already making, which the course names both as a major application area and as a site of significant professional caution.
FAQ

How Machines Learn from Health Science Data FAQ

Is deep learning always better than the older approach?

No, and the course frames the difference as a trade rather than an upgrade. Learning the features instead of receiving them needs far more examples, far more computation, and produces a representation nobody can inspect. That price is worth paying when the input is an image, a waveform or a sequence, because nobody can write down what a good feature would be.

It is usually not worth paying on a clinical table of a few thousand rows with twenty measurements that clinicians already defined, which is exactly the shape of the individual assignment.

What is the difference between a limit and an obstacle here?

The five limits are properties of the technology: it finds patterns without meanings, correlation without causation, and it does not transfer well beyond the data it saw. The seven obstacles are properties of the setting: privacy, regulation, stakeholders, caution, usability. The distinction matters in a discussion section because the repairs are different.

A limit is addressed by scoping the claim you make, and an obstacle is addressed by changing something outside the model, which is the part a notebook cannot do for you.

Can I write that a model showed one factor causes an outcome?

Not from a model of this kind. The published limit is explicit that these systems identify correlations and not causal relations, so a sentence of that form is wrong before it finishes. The defensible form names what was predicted, from what, and for whom: the model identified patients at higher risk using measurements available at the clinic visit.

If a causal claim is genuinely wanted, it requires a design that varies the factor rather than a model that observes it, and saying so is a stronger answer than hedging.

Study strategy

Assessment move

Take one deployment you actually know something about and write four sentences: what is learned, from what data, who supplied the features, and which of the five published limits would bite it first. Then write the demand-gap version of its benefit argument in two sentences. The exercise takes fifteen minutes, and it produces the opening of a project introduction as a by-product.

Working through How Machines Learn from Health Science Data in BMS5010? Sia is AskSia’s AI Artificial Intelligence tutor — ask any BMS5010 How Machines Learn from Health Science Data question and get a clear, step-by-step explanation grounded in how BMS5010 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.

A+Everything unlocked
Unlocks this Bible + all 6 of your City University of Hong Kong subjects - and 1,000+ Bibles across every Australian university.
Sia - your BMS5010 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works
BMS5010 · Artificial Intelligence for Health Science Research and Management - independent study guide on the AskSia Library. More City University of Hong Kong subjects · Microeconomics across all universities