The University of Manchester · FACULTY OF ENGINEERING

AERO61021 Chap.1 Why Engineers Experiment

- one subject, every graph, every model, every mark
7 Chapters4-page Bible
Our own words - no uploaded lecturer files
Updated for this semester
Chapter 1 of 10 · AERO61021

Why Engineers Experiment

Why Engineers Experiment sets out where physical testing fits among the three ways engineers gather information: analysis, modelling and simulation, and experimentation. Analytical theory is elegant but reaches only simpler systems, and simulation is limited by computing power, so small-scale physics such as turbulence is usually modelled rather than resolved.

Experiments supply what neither can guarantee: benchmark data, certification evidence, a first look at a new concept and, increasingly, the validation of numerical models. The chapter separates verification, which checks that a model has been built and solved correctly, from validation, which checks that it represents reality well enough within its intended domain.

It explains why confidence in a model becomes expensive as it approaches certainty, why testing therefore clusters at the edges of an operating envelope, and how aircraft and motorsport examples showed models drifting where conditions were extreme.

It closes with practical habits: search earlier experimental papers, handbooks and databases before building a rig, estimate the expected answer in advance, and reject any result that breaks physical limits whatever produced it. Together these ideas justify the time and money a physical test demands.

In this chapter

What this chapter covers

  • 01

    Analysis, simulation and experimentation as information routes

  • 02

    The stages of a typical experiment from rig to conclusion

  • 03

    Verification versus validation of models

  • 04

    Why confidence in a model costs more near certainty

  • 05

    Testing at the edges of an operating envelope

  • 06

    Finding prior experiments, handbooks and data sources

  • 07

    Plausibility checks against physical limits

Worked example · free

Estimate the cost of extra model confidence

Q [4 marks]. A simulation has been validated over 80% of its operating envelope for £25,000. Using the illustrative relation cost = k/(1 - c), find the cost of 90% and 96% confidence and the extra spend between them, then say what the result implies for test planning. The mark allocation is our own study aid and is not an official University scheme.
Confidence that a model is valid runs along the horizontal axis; the orange cost curve passes x at 80% and 2x at 90% and then turns upward without limit, while Confidence that a model is valid runs along the horizontal axis; the orange cost curve passes x at 80% and 2x at 90% and then turns upward without limit, while the purple value curve flattens towards a ceiling.x2x0%100%confidence in modelrelative cost80% costs x90% costs 2xcost divergesvalue levels off
Confidence that a model is valid runs along the horizontal axis; the orange cost curve passes x at 80% and 2x at 90% and then turns upward without limit, while the purple value curve flattens towards a ceiling.
  • 1Fix the constant from the known point: k = 25,000 x (1 - 0.80) = 5,000.
  • 1At 90% confidence the cost is 5,000/0.10 = £50,000, twice the 80% figure, matching the proportion quoted in the module notes.
  • 1At 96% confidence the cost is 5,000/0.04 = £125,000.
  • 1The six points from 90% to 96% add £75,000, three times the whole cost of the first 80%, so test effort is best spent where the model is weakest, usually at the envelope edges.
Reaching 90% costs about £50,000 and 96% about £125,000, so the last six points add £75,000. The relation is a planning illustration that reproduces the two proportions in the notes, not a law. The mark allocation shown is AskSia practice weighting and is not a University marking scheme.
Sia tip — Fix the constant from the one known point before computing any other confidence level, then check that 90% comes out at twice the 80% cost.
Glossary

Key terms

Verification
Checking that a program or analytical model is implemented correctly and solves the problem it was intended to solve.
Validation
Showing that a model is accurate enough for its intended use within its domain of applicability.
Independent variable
A parameter the experimenter changes deliberately in order to observe its effect on measured quantities.
Operating envelope
The full range of conditions over which a vehicle or system is designed to work.
FAQ

Why Engineers Experiment FAQ

Why run experiments when CFD and FEA are so capable?

Simulations resolve only part of the physics and are limited by computing power, so they tend to depart from reality at the edges of a design envelope and on genuinely new problems. Experiments provide benchmark data, certification evidence and the comparison needed to validate a model, which is why most modern projects combine both.

Is matching one wind tunnel result enough to validate a model?

No. Agreement at a single operating condition shows the model is acceptable there, but it says nothing about other conditions. Validation builds confidence over a domain step by step, and the cost of adding confidence rises steeply as complete coverage is approached.

Where should I look before designing a new experiment?

Start with earlier experimental papers and reviews in journals such as Experiments in Fluids or Experimental Mechanics, then handbooks of experimental fluid and solid mechanics, the ESDU engineering data collection and National Physical Laboratory guidance. Experienced experimentalists can save weeks if you arrive with specific questions.

Study strategy

Assessment move

Treat this chapter as the frame that every later technique hangs on, and practise explaining it in your own words rather than memorising definitions. Start by drawing the experiment chain from memory: building the rig, installing and calibrating sensors, running the test, watching the reading respond, digitising and saving the signal, then analysing it and drawing a conclusion.

For each link, write one thing that can go wrong and how you would detect it; later chapters on calibration, sampling and acquisition give you the detail for each failure. Next, build a short list of contrasting statements about verification and validation and sort them quickly. Good practice items describe a real activity, such as a mesh study, a code review or a comparison with tunnel data, and ask which question it answers.

Work the confidence and cost relation with two or three invented budgets so the runaway near full confidence becomes intuitive, but remember it is an illustration that reproduces the proportions in the notes rather than a published formula.

When you read the guest lecture topics on industrial and structural testing, note where the speakers chose a physical test because a model could not be trusted, and keep those cases as evidence for coursework discussion. For the group report, prepare a paragraph that justifies your experiment against the alternatives of analysis and simulation, names what you will validate and states the limits of that validation.

Finally, adopt the plausibility habit now: before each lab session write the value you expect, the sign it should have and the physical limits it cannot cross, such as negative absolute pressure or temperatures below absolute zero. Compare the logged data with that note before you analyse anything.

This small routine catches reference mistakes, wiring faults and unit errors early, and it gives you a ready sentence for the discussion section explaining why your results are credible.

A+Everything unlocked
Unlocks this Bible + all 41 of your subjects at The University of Manchester, plus 1,000+ more Bibles across the AskSia library.
Sia - your AERO61021 tutor, unlimited, worked the way the exam marks it
The full 4-page Bible + practice bank with worked solutions
Chrome extension - sync your LMS so Sia knows your deadlines
Bilingual EN / Chinese on every Bible and every Sia answer
$0.99 Trial
30-day money-back · cancel in one tap · how it works