start making sense o'reilly webcast december 2015

Start Making SenseFUNDAMENTALS OF SENSORY DESIGN

Introduction

Introduction

Who am I?

Alastair Somerville Sensory Design Consultant Museums, galleries and public spaces Speaking – SxSW, Generate Workshops – UXWeek, ConveyUX, UXLX

O’Reilly Design Conference San Francisco 19th-22nd January 2016

20th – Sense And Sensor Ability workshop

What do I care about?

Making stuff understandable so people can do the things they want to do

What’s the problem?

Tactile design

Look at your hand

Look at your finger

Look at your fingertip

Squeeze your fingertip between your thumb and finger

3mm

3mm Rule

Constraint of designs

Map layout:Pete Stonehouse

Simplify designs

3D design:Pete Stonehouse

Testing designs

Complexity is not the problem

Confusion is

Understand more about senses and how we make meaning

Organising this webcastFRAMING IDEAS

Organising this webcast

4 parts

Design for the mind

Design for the mind

Sensory order and

more senses

Design for the mind

Sensory order and

more senses

Emotions and

actions

Design for the mind

Sensory order and

more senses

Emotions and

actions

Making it personal

Design for the mindCOGNITIVE ACCESSIBILITY AND UNDERSTANDING THE STRUCTURE OF MEANING MAKING FOR EVERYONE

Design for the mind is also called Cognitive Accessibility

Design for the mind

Exhibition Road Shared Space, London

Design for the mind

Design for the mind

Design for the mind

Design for the mind

The shared space is not cognitively accessible

Why?Design for the mind

Cognitive Accessibility is Perceivable Intelligible Actionable

Design for the mind

Cognitive Accessibility is Perceivable

Open to an individual’s sensory capacities

Design for the mind

Exhibition Road Shared Space is not

Design for the mind

Cognitive Accessibility is Intelligible

Open to comprehension by an individual’s intellect

Design for the mind

Exhibition Road Shared Space is not

Design for the mind

Cognitive Accessibility is Actionable

Open to use by an individual

Design for the mind

Exhibition Road Shared Space is not

Design for the mind

Cognitive Accessibility is Perceivable Intelligible Actionable

Design for the mind

Cognitive Accessibility is Perceivable Intelligible All 3 together Actionable

Design for the mind

Sensory order and more sensesRECOGNISE HOW SENSORY ORDER AFFECTS US AND HOW MANY SENSES WE HAVE

Sensory order and

more senses

Sensory order and

more senses

Sensory order

Sensory order and

more senses

SensesSight

Hearing

Taste

Smell

Touch

Sensory order and

more senses

SensesSight

Hearing

Taste

Smell

Touch

Sensory order and

more senses

SensesSight

Hearing

Taste

Smell

Touch

4

1

2=

3

Sensory order and

more senses

Cognitive Slop Time

Sensory order and

more senses

Chion

Sensory order and

more senses

Chion

Sensory order and

more senses

Chion Audio framing

Sensory order and

more senses

More senses

Sensory order and

more senses

More SensesSight

VisionHearing

AuditionTaste

GustationSmell

OlfactionTouch

SomatosensoryBalance & accelerationEquilibrioceptionTemperature

ThermoceptionKinaesthetic senseProprioceptionPain

NociceptionTime

ChronoceptionOther internal sensesInteroception

Sensory order and

more senses

More SensesSight

VisionHearing

AuditionTaste

GustationSmell

OlfactionTouch

SomatosensoryBalance & accelerationEquilibrioceptionTemperature

ThermoceptionKinaesthetic senseProprioceptionPain

NociceptionTime

ChronoceptionOther internal sensesInteroception

Sensory order and

more senses

Proprioception

Sensory order and

more senses

Proprioception Chronoception

Sensory order and

more senses

Don’t add multimodal confusion to Cognitive Slop Time

Sensory order and

more senses

Emotions and actionsA FEEDBACK LOOP ADAPTING TO GROWING COMPLEXITY

Emotions and

actions

Simple things can have emotional meanings

Emotions and

actions

A simple structure of sensing & meaning

Sense Take action

Emotions and

actions

A simple structure of sensing & meaning

Sense

Make meaning

Take action Emotions

and actions

A simple structure of sensing & meaning

Senses

Emotions

Make meaning

Take action

Emotions and

actions

A simple structure of sensing & meaning

Senses

Emotions

Make meanings

Conscious Decision

Take action

Emotions and

actions

Emotions and consciousness are ways of enabling action

Emotions and

actions

We adapt

Emotions and

actions

We imagine

Emotions and

actions

Emotions and

actions

Emotions and

actions

Emotions and

actions

Imagination is adaption

Emotions and

actions

Complexity is not the problem

Emotions and

actions

Confusion is

Emotions and

actions

Understand how people make meaning iteratively with emotion

Emotions and

actions

Making it personalFOLLOWING THE SENSORY JOURNEY AND ENABLING HYPERPERSONALISATION

A sensory design framework

Making it personal

Sensory & emotional framework

Attention Action

Making it personal

Sensory & emotional framework

Attention Action

Senses

Making it personal

Sensory & emotional framework

Attention Action

Sensor

Avoider

Seeker

Bystander

Senses

Making it personal

Sensory & emotional framework

Attention Action

Sensor

Avoider

Seeker

Bystander

Senses Emotions

Making it personal

Sensory & emotional framework

Attention Action

Sensor

Avoider

Seeker

Bystander

Arousal

Non-arousal

Pleasure

Displeasure

Senses Emotions

Making it personal

Sensory & emotional framework

Attention Action

Sensor

Avoider

Seeker

Bystander

Arousal

Non-arousal

Pleasure

Displeasure

Senses Emotions

Making it personal

4 ways of enabling understanding

Making it personal

Timing

Making it personal

Mistimed sensory events cause confusion

Making it personal

Timing

Volume

Making it personal

Overloud/quiet sensory events cause confusion

Making it personal

Timing

Volume

Meaning

Making it personal

Metaphors cause confusion

Making it personal

Timing

Volume

Meaning

Load

Making it personal

Too much information causes confusion

Making it personal

Imperial War Museum, London

Making it personal

Casson Mann

Making it personal

Graphic design: Pete Stonehouse

Making it personal

IN

OUT

Making it personal

IN

OUT

A map of gaps

Making it personal

IN

OUT

A map of gaps

A map to enable personal agency Making it

personal

Designing for the future

Making it personal

Hyperpersonalisation

Making it personal

You can do it now…

Making it personal

…but we don’t have time

Making it personal

Hyperpersonalisation is…

Making it personal

Hyperpersonalisation is… Accessibility

Making it personal

Sensory design is recognising the need for accessibility for all of us

Making it personal

Use accessibility as framework

Listen to users

Making it personal

Ending this webcastIDEAS

Design for the mind

Sensory order and

more senses

Emotions and

actions

Making it personal

Design for the mind

Perceivable Intelligible Actionable

Design for the mind

Sensory order and

more senses

Emotions and

actions

Making it personal

Sensory order and

more senses

Don’t add multimodal confusion to

Cognitive Slop Time

Design for the mind

Sensory order and

more senses

Emotions and

actions

Making it personal

Emotions and

actions

Understand how people

make meaning iteratively with

emotion

Design for the mind

Sensory order and

more senses

Emotions and

actions

Making it personal

Making it personal

Use accessibility as

frameworkListen to users

Complexity is not the problem

Confusion is

Design with sensesDesign with emotionsDesign for individuals

Thank you

Questions?