DDES9902 Chap.1 Reality-Virtuality and Interaction Modes
Reality-Virtuality and Interaction Modes
The opening topic places immersive experiences on the reality-virtuality continuum and asks how people act within them. The practical goal is not to rank AR, mixed reality and VR, but to decide what physical information should remain available and what the system should mediate. Interaction is treated as a loop connecting a perceivable cue, a user action, sensed input, system response and feedback.
This frame helps a designer justify gaze, hand, voice, prop, body or controller input against the task, setting and user rather than choosing a modality for novelty. A continuum label becomes useful only when it changes a design obligation. An augmented experience must preserve registration with relevant physical objects and keep hazards visible.
A fully virtual setting controls more of the scene but must replace orientation, boundary and social cues that the physical environment would otherwise supply. Mixed arrangements require the report to state what remains real, what is represented and where the system can lose alignment. For any modality, trace the complete action loop.
The user needs a cue, an available action, reliable sensing, a system state change and feedback that distinguishes success, failure and uncertainty. Then test the loop under an adverse but plausible condition such as noise, low light, seated use, occupied hands or reduced reach. Voice may become unreliable, gaze may need confirmation and direct hand input may need a controller or switch alternative.
Comparing modalities through discoverability, precision, effort, privacy, accessibility and failure consequence produces a defensible choice. It also prevents familiar words such as intuitive or natural from substituting for observed behaviour.
What this chapter covers
- 01
Reality-virtuality as a continuum of mediated and physical information
- 02
Immersive systems as coordinated display, sensing, rules and feedback
- 03
Affordances as relationships between user capability and environmental cues
- 04
Interaction loops from discoverable cue through action to response
- 05
Choice of input modality according to task, body and context
- 06
Physical awareness and accessibility alternatives in mediated environments
Worked example · free
Classify and justify a museum interaction
- +1Keep the physical artwork visible, placing the concept near augmented reality rather than full virtual reality.
- +1Give the interaction a discoverable cue, such as a floor marker and a visible hover response.
- +1Use tracked hand movement to control image depth and provide immediate progress feedback.
- +1Provide a seated on-screen alternative and test whether both routes preserve attention on the artwork.
Key terms
- Reality-virtuality continuum
- A spectrum that locates experiences according to how physical and digitally generated information are combined.
- Affordance
- An actionable possibility perceived through the relationship between a user and an environment.
- Interaction loop
- The sequence linking a cue, user action, sensed input, system response and feedback.
- Mixed reality
- An experience in which physical and digital elements coexist and can be related through spatial interaction.
- Feedback
- A perceivable response that shows whether an action was detected and what changed.
Reality-Virtuality and Interaction Modes FAQ
How is augmented reality different from virtual reality?
Augmented reality keeps the physical environment available and adds digital information to it, while virtual reality replaces most of the immediate visual setting with a generated one. The distinction changes safety, alignment, input and attention requirements; it is not simply a difference in visual quality.
What makes an immersive interaction intuitive?
An interaction is easier to learn when its cue suggests an available action, the action matches bodily and cultural expectations, and feedback arrives quickly enough to confirm what happened. “Intuitive” should be tested with first-time users rather than asserted from the designer's familiarity with the control.
How should I justify an input method?
State the task, user capability, environment and consequence of failure. Then explain what the input senses, how users discover it, what feedback confirms it and what alternative route exists. Compare it with at least one plausible modality so the choice reads as a decision, not a preference.
Assessment move
Draw the reality-virtuality continuum and place several familiar experiences on it, explaining what physical information remains and what the system generates. For each experience, trace a complete interaction loop in five parts: cue, action, sensed input, response and feedback.
Change one condition, such as seated use, low light, noisy surroundings or reduced hand mobility, and redesign the input while preserving the task outcome. This practice turns broad labels into design consequences. In assessment writing, avoid calling a feature intuitive without evidence. Describe the observable behaviour that would support the claim and the failure that would refute it.
Use the chapter figure as a retrieval prompt, then apply the same reasoning to your own prototype and record where the continuum classification changes its safety or access requirements.
