University of Sydney · FACULTY OF ARTS & HUMANITIES

ARIN6906 Chap.3 Machine Intelligence and Language Models

- one subject, every graph, every model, every mark
6 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 3 of 10 · ARIN6906

Machine Intelligence and Language Models

Artificial intelligence is treated as both technical architecture and philosophical problem. Training data, pretraining, fine-tuning, alignment, context and inference explain how contemporary language models behave. The critical question is what fluent performance warrants and how institutions reorganise cognition around outputs that may be persuasive without being grounded.

In this chapter

What this chapter covers

  • 01

    Turing and performance-based intelligence

  • 02

    Tokens, training data and model weights

  • 03

    Pretraining and supervised fine-tuning

  • 04

    Alignment and reinforcement methods

  • 05

    Context windows and inference

  • 06

    Grounding, authority and distributed cognition

Worked example · free

A museum chatbot without grounded authority

Q [4 marks]. AskSia practice: a museum chatbot gives a convincing interpretation but invents an artefact provenance. Analyse capability, grounding and institutional responsibility.
Evidence becomes stronger as varied task tests, grounded sources and accountable review supplement the first impression created by fluent output.Evidence becomes stronger as varied task tests, grounded sources and accountable review supplement the first impression created by fluent output.Fluent outputTask testsGrounded sourcesInstitutional review
Evidence becomes stronger as varied task tests, grounded sources and accountable review supplement the first impression created by fluent output.
  • +1This practice weighting is not an official University mark allocation. Recognise the demonstrated ability to sustain context and produce an appropriate explanatory genre.
  • +1Separate linguistic competence from warranted knowledge by checking retrieval and citations.
  • +1Explain how interface and museum branding lend institutional authority to the answer.
  • +1Recommend curated retrieval, visible sources and escalation of uncertain provenance claims.
The model is a capable language component, but the false provenance reveals an epistemic governance failure. Authority should remain conditional on curated evidence and a review process rather than flowing automatically from fluent style.
Sia tip — Never use confidence, empathy or self-reference as automatic evidence of an inner state. First describe the observable capability.
Glossary

Key terms

Imitation Game
Turing's performance test that shifts attention from defining thought to evaluating conversational behaviour.
Pretraining
Large-scale adjustment of model weights through patterns in training data before task-specific adaptation.
Fine-tuning
Additional training that shapes a model toward preferred tasks, examples or behaviours.
Inference
The generation of an output from a trained model in a particular context.
Grounding
Connection between a generated claim and reliable external evidence, data or observation.
FAQ

Machine Intelligence and Language Models FAQ

Does fluent language prove that a model thinks?

It demonstrates a significant performance that needs explanation, but it does not settle every philosophical question about understanding or consciousness. A careful answer distinguishes observable behaviour from inferred inner states and then considers how the system reorganises cognition in practice.

What technical layers should I name in an AI answer?

Start with training data and token patterns, then distinguish pretraining, fine-tuning or alignment, and inference in a context window. Add retrieval, tools or institutional review when they are part of the deployed system. This prevents the model from being treated as one undifferentiated mind.

Why does deployment matter to AI authority?

An identical output can carry different consequences when presented as casual assistance, professional advice or an institutional statement. Interfaces, branding, retrieval systems and review duties decide how much epistemic authority users are likely to grant the model.

How should I discuss the Turing test?

Use it to explain a shift toward observable performance rather than as a final proof of intelligence. The test is valuable because it challenges simple behavioural distinctions, but interpretation remains open. Connect it to the specific capability being assessed and avoid claiming that one exchange settles understanding or consciousness.

What is the difference between grounding and alignment?

Grounding connects claims to reliable external evidence or observation. Alignment shapes behaviour toward selected goals, preferences or constraints. An aligned answer can still be factually ungrounded, while a retrieved fact can still be presented in a way that conflicts with institutional duties or user needs.

How can I analyse AI without technical overreach?

Describe only the architecture needed for your argument, define uncertain terms and distinguish system documentation from promotional claims. Technical precision does not require pretending to know an inaccessible inner process. It requires locating the evidence and limiting the conclusion to what that evidence supports.

Study strategy

Assessment move

Maintain two parallel columns: technical operation and philosophical interpretation. For each case, describe what the model demonstrably does, what evidence would be needed for a stronger claim, and how the surrounding institution allocates verification. Practise conclusions that avoid both hype and dismissal. The goal is to judge an epistemic arrangement, not to guess at a hidden mind from one exchange.

Prepare a layered sketch that separates training data, pretraining, adaptation, inference, retrieval and deployment. Use it to locate every claim. If an output is persuasive but false, ask which layer made the association available and which institutional layer allowed the answer to carry authority.

Practise comparing three interpretations of the same performance: evidence of task competence, evidence about cognition and evidence of organisational dependence. In oral assessment, state which interpretation you are defending and which you are leaving open. For project work, include a verification boundary in the system description.

That boundary often supplies the most interesting analytical tension because it shows where automated production ends and accountable judgement must begin. Build an evidence ladder for each claim you intend to make about a language model. Place the observed output on the first rung, repeated task performance on the second, grounding or source checks on the third, and institutional review on the fourth.

Do not let evidence from one rung answer a different question: fluent prose is not a consciousness test, and a citation is not proof that the source was understood correctly. Create two failure cards for rehearsal, one involving confident fabrication and another involving a defensible refusal. Explain what each reveals about the model, the prompt, the surrounding data and the human workflow.

During Q&A, narrow metaphysical claims when evidence is weak, but remain specific about practical reliance. State which use is permitted, which verification step is mandatory and what result would cause withdrawal. This turns uncertainty into a governable deployment condition rather than a vague warning that the technology is complicated.

A+Everything unlocked
Unlocks this Bible + all 196 of your University of Sydney subjects - and 1,000+ Bibles across every Australian university.
Sia - your ARIN6906 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works