Index

A

A-Frame, 330

Accelerometers, 34–36

Accessibility

multimodal, 80–81, 163

in overall design, 160–167

researching, 347–348

Acronyms, extended reality, 4

Adaptive distance field, 216

Affordances, 68–72, 145

Agency, user, 122, 141–142, 153

Agile workflow, 331–336

AirPods, 16–17

Amazon Sumerian, 330

Ambisonic recordings, 308, 309

Anchored type, 263

Apple Watch, 137

Approachable design, 136–150

Apps, stand-alone AR, 28–30

Architecture, 120–121

Attention, overt vs. covert, 125

Audience, 155–159

Audio. See sound design

Augmented reality (AR)

AR Cloud, 352–353

augmented audio, 313–317

brainstorming, 50

defined, 4, 5

feature integration, 28

history of, 22–23

HMDs for, 40, 43–44

and MR, 5–6

real time examples, 12

rendering for, 64–65

tagAR app, 87–89

triggers for, 363–365

typography for. See typography

Axes, coordinate, 54

Axonometric drawing, 119

B

Babylon.JS, 330

Background

figure-ground relationship, 230–237

location of viewer, 237–240

variables in, 224–230, 243

Binaural recordings, 308

Binocular disparity, 205, 206

Bose AR glasses, 313–317

Brainstorming, physical, 114–128

Bugs, fixing, 337–339

C

Cameras

to set perspective, 60, 61

smart, 32–34

Capture-first experiences, 204

Cerebral hemispheres, 100

Closure, 207, 210

Cloud space, 8, 352–353

Coding, 326–331

Cohesion, 149–150

Collaborative XR, 242–243

Common fate, 207, 211

Composition, 237

Context, information in, 165–166

Continuation, 207, 209–210

Convergent thinking, 97–99

Coordinate axes, 54

Covert attention, 125

Creativity, 220

Cueing, 125

Customization, type, 268–270

D

Deadlines, 94

Debugging, 337

Design challenges

AR brainstorming, 50

eye chart, 272–273

full design process, 358

game playing, 168

mind map, 106

for mobile technology, 8

on/off switches, 193

paper airplane, 133

paper cube, 221

sound localization, 324

3D icon, 244

3D models, 82

Design sprint, 334

The Design of Everyday Things (Norman), 69–70

Developers, collaboration with, 328

Diegetic/non-diegetic elements, 139

Display evolution, 246–250

Display type, 259, 365

Divergent thinking, 95

E

8th Wall, 31, 330, 331

Electricity, 19

Elements, position of, 214–215

Emotional connection, 240–243

Empathy, 200–202

Environmental zone, 260, 261

Environments, 62

Ethics, 349–357

Evolution of displays, 246–250

Exits, 154

Experience

positive user, 139–150

replicating physical, 2–3, 73–79

sharing, 370

virtual, 15

wireframes, 130

Extended reality. See XR (extended reality)

Extrusion, 55

Eye chart, 272–273

F

Face space, 136

Facial recognition, 355–357

Feature integration, 28

Feedback, 144, 189, 307

Field of view, 43, 215

Figure-ground relationship, 230–237

File formats, 65–68

Filters, 14

1st & Ten graphics system, 10–11

Flow, user, 122–128

Focal length, 238–239

Focal zone, 260, 261

Focus, 162–163, 372

Fonts, 250

Functionality, 219

Future of XR

beyond rectangular displays, 365–371

to expand our physical space, 376–377

ideation for, 360–363

need for a, 372–375

triggering new users, 363–365

G

Geometric type, 252

Geometry, generating, 56

Gestalt principles, 207–211

Goals, 84–91

Google Glass, 102–104

GRASP taxonomy, 147

Greenwold, Simon, 45

Greetings, 136–139

Grocery stores, 196–197

Guides, 148–149

Gyroscopes, 34–36

H

Haptics, 76–78

Head-mounted displays (HMD), 39–44, 138

Head-up displays (HUDs), 11

Hierarchy in 3D, 212–220

History

of displays, 246–250

of XR, 22–26

Holistic empathy, 200–202

Holographic games, 368

Human factors

hierarchy in 3D, 212–220

human-centered ideas, 102–105

in overall design, 196–204, 220

replicating the physical, 2–3, 73–79

theories of perception, 205–211

I

Ideation

identifying the why, 84–91

innovation and practicality, 92–94

inspiration for, 192

mind map for, 106

outside influence for, 94–101

user-focused, 7, 102–105

Immersive experiences

affordances, 68–72

multimodal, 72–81

to replicate the physical, 3

3D models, 52–68

Immersive typography, 262

Imposter syndrome, 108

Innovation, 92–94

Inspiration, 192

Interactions

as indicated by design, 70

micro, 188–191

point of view of, 122

in positive UXs, 139, 146

triggers for, 363–365

voice vs. visual, 318

K

Kinesthetic sense, 78–79

L

Layout and composition, 237

Learning

benefit of XR to, 9, 16

to code, 326, 327

disabilities, AR for, 161, 162, 164, 166

prosthetic knowledge, 18–20

user flow for children, 124

via projection mapping, 38

via UX research, 341

by voice-activated systems, 318, 321

Legibility/readability of type, 246–258

LiDAR technology, 32–34, 46

Light

for 3D scenes, 60–62

for photogrammetry, 49

and type changes, 264

Lightform, 36–37

Loudness, 304

M

Magic Leap 1 headset, 45, 46

Materials, choice of, 58–60, 85–87

Meetings, remote, 374–375

Mental model, 152

Mesh, 55–58

Microinteractions, 188–191

Mind map, 106

Minimization of copy, 270

Minimum viable product, 333

Mistakes, 154

Mixed reality (MR)

defined, 4, 5–6

HMDs for, 43–44

mobile, 7–8

rendering for, 64–65

spatial computing, 45

workstation, 9

Mobile AR

future of, 367

gyroscopes and accelerometers for, 34–36

technology for, 7

via smart cameras, 32–34

via stand-alone apps, 28–30

video vs. optical, 27

web-based, 30–32

Motion parallax, 240

Motion tracking, 34–35

Multimodal experiences, 72–81, 163–164

Multiple users, 242–243

N

Names, remembering, 87–89

Narrative-first experiences, 203

Needs, hierarchy of, 218–220

NLP (natural language processing), 318

O

Observations

for future projects, 362–363

in ideation phase, 99

in UX research, 341–344

Ocular dominance, 205

Olfactory experience, 75–76

On/off switches, 193

Onboarding tutorial, 138–139

Open-ear audio, 313–317

Optical see-through, 27

Orientation, 215

Outside influence, 94–101

Overt attention, 125

P

Packaging, 197–199

Paper airplane design, 133

Paper cube design, 221

Paradise case study, 310–312

Paralax, 240

Passion projects, 361–362

Perceived affordances, 70–71

Perception, theories of, 205–211

Perfection, 104–105

Permissions, pop-up, 352

Personal devices, 137

Personal space, 140–141

Personalization, 164–165, 323

Personas, user, 156–159

Perspective, 238, 267–268

Photogrammetry, 46–49

Physical brainstorming, 114–128

Physical experience

personal space extensions, 376–377

replicating, 2–3, 73–79

Pitch, 304

Point of view. See viewpoint (presence)

Polygons, 57, 58, 66

Practicality, innovation and, 92–94

Prägnanz, 207, 210

Primitive shapes, 52–55

Privacy, 349–357

Problem solving, 84–85

Processing power, 8, 57, 66

Product design, 199–200

Proficiency, 220

Programming, 326–331, 339

Projection mapping, 36–39

Proprioceptic sense, 78–79

Prosthetic knowledge, 18–20

Prototypes

experimentation with, 108–111

physical brainstorming, 114–128

transparent sketches, 111–114

using previous knowledge, 128–131

Proximity, 207, 209

Purpose, 84–91

Q

Qualitative/quantitative research, 340–348

R

Random ideation, 96–97

Rapid prototyping, 115, 118

Readability, type, 246–258

Real affordances, 70

Real time, 12, 203–204

Realism, 240

Reality

accessibility of, 160–166

merging realities, 90–91

sound ambience for, 306

Refresh, 154

Regularity, 207

Relationship of elements, 218

Reliability, 219

Rendering, 64–65

Research, 94–101, 339–348

Responsive type, 263

Rotation, 215

S

Safety, 146–148

Save feature, 154

Science fiction, 22

Screen evolution, 246–250

Scrum, 334–336

Sensory experience, 73

Shapes, primitive, 52–55

Shared experiences, 242–243, 370

Showrooms, virtual, 13

Sight. See visual ability

Similarity, 207, 209

Sketches, transparent, 111–114

Smartphones

as AR stepping stones, 7, 16–17

cameras on, 32–34

photogrammetry via, 46, 48

Smell, 75–76

Social signifiers, 143

Social XR, 368

Software for photogrammetry, 49

Somatosensory perception, 79

Sound design

augmented audio, 313–317

cues from sound, 305–306

file formats for recording, 305

loudness and pitch, 304

mapping sound, 302–303

in multimodal experiences, 75

soundscape, 75

spatial sound, 307–312

use in XR, 306–307

voice experiences, 317–323

Sound localization, 303, 324

Space

personal, 140–141

prototyping, 115

scene creation, 62–64

Spatial computing, 44–49

Spatial sound, 307–312

Spatial web, 368

Spatial zones, 260–262

Splines, 55

Star Walk app, 12

Stories

for connected experiences, 202–204

user personas, 158–159

Symmetry, 207

T

Tactile sense, 76–78

TagAR app, 87–89, 265

Technology

AR to align, 372–374

chain of advancement in, 22–26

choice of, 85–87, 93–94

early XR, 10–17

future of, 360–365

learning new, 18–20

mobile, 7–8, 27–36

for projection mapping, 36–39

for spatial computing, 44–49

wearable, 39–44, 350, 365, 369

Testing a design

early and often, 331

for usability, 340

vs. debugging, 338–339

Text type, 259

Texture, 58

Theories of perception, 205–211

3D interface metaphors, 176–186

3D models

design challenge, 82

file formats, 65–68

materials, 58–60

mesh, 55–58

rendering, 64–65

scene creation, 62–64

shapes for, 52–55

via photogrammetry, 46–49

viewpoint on, 60, 61

3D web frameworks, 329–331

Three.JS, 330

Touch, sense of, 76–78

Tracking for HMDs, 41–42

Transparent sketches, 111–114

Tutorials, 138–139

Typefaces, 250–256

Typography

controls over, 265–271

efficient use of, 271

legibility and readability, 246–258

typeface selection, 250–254

visual contrast, 259–265

U

Unit testing, 338

Usability, 219, 340

User experience (UX). See also human factors

accessibility, 160–167

approachable design, 136–150

challenge, 166–167

know your audience for, 155–159

prototypes for, 129

research on, 339–348

seamless flow, 150–155

via persona and story, 156–159

User interface (UI)

flow and sequence for, 122–128

prototypes for, 129

templates for, 18

3D interface metaphors, 176–186

time and space considerations, 186–188

type for, 262

Z-axis, 170–174

zone, 260, 261

V

Variable fonts, 250

Vectary, 32

Vergence-accommodation conflict., 216–217

Vertices, 57

Video options for XR, 366

Video pass-through, 27

Viewing distance, 215

Viewpoint (presence)

and background, 237

and human sight, 74–75

interaction point, 122

in prototyping, 115

replicating physical, 3, 74

sound and, 309

Virtual reality (VR)

defined, 4, 5

experiences, 15

HMDs for, 40, 42–43

immobility of, 8

release/share options, 370–371

spatial computing for, 45

Visual ability

in the brain, 100–101

designing for, 74–75

eye tracking research, 346

and hierarchy of elements, 215–216

and typography contrast, 259–265

viewer/focal point relationship, 237–240

visual pathway, 205–206

Visual assets, 46–49

Voice experiences, 316, 317–323

VUI (voice user interface), 318

W

Walk-throughs, 116–118

Waterfall workflow, 331–332

Wearable technology, 350, 365, 369

WebAR, 30–32, 371

Wireframes, 130

Workflow, 38, 331–336

World wonders, natural, 2

X

X-height, 253

XR (extended reality)

architecture and, 120–121

defining elements of, 4–5

expanding use of, 363–365, 366–368

extant technologies, 10–17

future of, 360–371

history of, 22–26

need for, 372–375

sensory experience in, 3, 73

sound in, 306–307

technological familiarity for, 6–7

type made for, 255–256

Z

Z-axis, 170–174