cognitive aspects - university of rochester · 2013-02-05 · cognitive aspects chapter 3 anna...

37
2/5/2013 1 ©2011 1 www.id-book.com Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ©2011 2 www.id-book.com What is cognition? Set of mental processes relevant to knowledge • Ex: Thinking Remembering Learning Daydreaming Decision Making

Upload: others

Post on 09-May-2020

7 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

1

©2011 1 www.id-book.com

Cognitive aspects

Chapter 3

Anna Loparev Intro HCI

University of Rochester

01/31/2013

©2011 2 www.id-book.com

What is cognition?

• Set of mental processes relevant to knowledge

• Ex:

Thinking

Remembering

Learning

Daydreaming

Decision Making

Page 2: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

2

©2011 3 www.id-book.com

What is cognition?

Seeing

Reading

Writing

Talking

©2011 4 www.id-book.com

According to Norman

• Two modes

• Experiential

– Perceive, act, and react to external events

– Requires expertise and engagement

– Ex:

Page 3: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

3

©2011 5 www.id-book.com

According to Norman

• Reflective

– Involves thinking, comparing, decision making

– Leads to new ideas and creativity

– Ex:

©2011 6 www.id-book.com

For the future…

• Remember these words:

Ball

Critter

Page 4: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

4

©2011 7 www.id-book.com

Mental processes

©2011 8 www.id-book.com

Attention

• Selecting things to concentrate on

• Allows focus on relevant info

• Involves audio and/or visual senses

• Easy or hard? – Goals

– Info Presentation

Page 5: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

5

©2011 9 www.id-book.com

Attention: Goals

• Weak – Hard

– Allow info to guide attention

– Ex: Amazon – MP3 player

• Strong – Easy

– Match goal with available info

– Ex: Amazon – Cowon iAUDIO 9 (16GB)

©2011 10 www.id-book.com

Attention: Information presentation

• Digikey vs Adafruit

Page 6: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

6

©2011 11 www.id-book.com

Information presentation: Find price of double room at Holiday Inn in Bradley

©2011 12 www.id-book.com

Information presentation: Find price for double room Quality Inn in Columbia

Page 7: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

7

©2011 13 www.id-book.com

Multitasking and attention

• Effects on memory and attention

– Depends on tasks

– Depends on attention demands

• Ex:

– Gentle music tunes out background noise

– But loud music is distracting

• Light multitaskers better at allocating attention

©2011 14 www.id-book.com

Attention: Design implications

• Make important info noticeable

• Make things stand out

– Color

– Ordering

– Spacing

– Underlining

– Animation

Page 8: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

8

©2011 15 www.id-book.com

Attention: Design implications

• Avoid cluttering with too much info

©2011 16 www.id-book.com, http://arngren.net/

Attention: Design implications

• Avoid using too much just cuz

Page 9: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

9

©2011 17 www.id-book.com

Over-use of graphics

©2011 18 www.id-book.com

Perception

• How info acquired and transformed into experiences

• Complex; involves

– Memory

– Attention

– Language

• Vision > Hearing > Touch

Page 10: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

10

©2011 19 www.id-book.com

Perception: Gestalt laws

• Mind tends to perceive patterns

• Groupings based on certain rules

• Relative strength not really known

©2011 20 www.id-book.com, http://www.borisfx.com/tutorials/olympic_promo.php www.interaction-design.org/encyclopedia/gestalt_principles_of_form_perception.html

Perception: Gestalt laws

• Core principle:

• Pragnanz

– Regular, simple, orderly

Page 11: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

11

©2011 21 www.id-book.com, https://en.wikipedia.org/wiki/Principles_of_grouping, http://www.interaction-design.org/encyclopedia/gestalt_principles_of_form_perception.html

Perception: Gestalt laws

• Proximity – Close together

• Too much whitespace can be detrimental

©2011 22 www.id-book.com, http://www.scholarpedia.org/article/Gestalt_principles

Perception: Gestalt laws

• Similarity

Page 12: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

12

©2011 23 www.id-book.com, http://www.baycongroup.com/excel2007/04_excel.htm

Perception: Gestalt laws

• Similarity

©2011 24 www.id-book.com, https://en.wikipedia.org/wiki/Principles_of_grouping, www.interaction-design.org/encyclopedia/gestalt_principles_of_form_perception.html

Perception: Gestalt laws

• Closure – Incomplete shapes

Page 13: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

13

©2011 25 www.id-book.com, https://en.wikipedia.org/wiki/Gestalt_psychology#Gestalt_laws_of_grouping, www.interaction-design.org/encyclopedia/gestalt_principles_of_form_perception.html

Perception: Gestalt laws

• Symmetry

[ ] { } [ ]

©2011 26 www.id-book.com, https://en.wikipedia.org/wiki/Principles_of_grouping

Perception: Gestalt laws

• Common fate – All moving same way

Page 14: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

14

©2011 27 www.id-book.com, https://en.wikipedia.org/wiki/Principles_of_grouping

Perception: Gestalt laws

• Continuity– Continuous direction

©2011 28 www.id-book.com, http://www.scholarpedia.org/article/Gestalt_principles

Perception: Gestalt laws

• Past experience

Page 15: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

15

©2011 29 www.id-book.com, http://www.codesampler.com/d3dbook/chapter_02/chapter_02.htm

Perception: Gestalt laws

• Convexity

©2011 30 www.id-book.com, http://www.scholarpedia.org/article/Gestalt_principles

Perception: Gestalt laws

• Common region

Page 16: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

16

©2011 31 www.id-book.com, http://www.scholarpedia.org/article/Gestalt_principles

Perception: Gestalt laws

• Element connectedness

©2011 32 www.id-book.com

Perception: Is color contrast good?

Find Italian

Page 17: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

17

©2011 33 www.id-book.com

Perception: Borders and white space?

Find French

©2011 34 www.id-book.com

Perception: Which is easiest to read?

What is the time?

What is the time?

What is the time?

What is the time?

What is the time?

Page 18: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

18

©2011 35 www.id-book.com

Perception: Design implications • Icons

– Enable users to distinguish meaning

• Bordering and spacing are effective

• Sounds – Audible and distinguishable

• Speech output – Space out words

• Text – Legible

– Distinguishable from the background

• Tactile feedback – Allow users to recognize and distinguish meanings

©2011 36 www.id-book.com

Memory • Includes creating and retrieving memories

• Don’t remember everything

• During creation, affected by:

Attention Context (when, where)

Page 19: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

19

©2011 37 www.id-book.com, http://drafthouse.com/movies/total_recall_1990/austin

Memory

• Recall – Remember something without clues

– Can be hard to do • Passwords

• Recognition – Remember via reencounter

– Easier to do than recall

©2011 38 www.id-book.com

Recognition versus recall

• Command-based interfaces – Require recall

• GUIs – Provide visually-based options

– Users browse through until they recognize one

• Web browsers, MP3 players, etc. – Support recognition memory

– Provide lists of visited URLs, song titles etc.

Page 20: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

20

©2011 39 www.id-book.com, http://www.google.com

Memory: Search • Start with recall

• Move on to recognition

• Can improve via – Multiple encodings

– Autofill

– Searchbox AND history list

©2011 40 www.id-book.com

Memory: Activity

• Do you remember the words?

• Can you identify them in this list? – Basket

– Milk

– Ferret

– Ball

– Soda

– Shirt

– Coffee

– Staple

– Critter

Ball

Critter

Page 21: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

21

©2011 41 www.id-book.com

Memory: Activity

• Grandparents’ birthdays

• Cover of last two bought DVDs

• Which easiest? Why?

• Good at remembering visual cues – Color

– Location

– Marks

• Harder to remember arbitrary material – Birthdays

– Phone numbers

©2011 42 www.id-book.com, http://www.pawesome.net/2012/01/too-big-bulldog-and-the-too-small-box/

Memory: The classic ‘72’

• George Miller’s (1956)

• How much info people can remember

• Short-term memory capacity is limited

Page 22: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

22

©2011 43 www.id-book.com

Memory: What not to do

• Only 7 menu options

• Display only 7 tool bar icons

• No more than 7 bullets in a list

• Only 7 items on pull down menu

• Only 7 tabs at the top of a webpage

• Wrong because recognition, not recall!

©2011 44 www.id-book.com

Memory: Design implications

• Don’t require complicated procedures

• Promote recognition rather than recall

• Provide various ways of encoding info – Categories

– Color

– Flagging

– Time stamping

Page 23: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

23

©2011 45 www.id-book.com

Learning

• How to learn to use an application

• Use an application to understand a topic

• Hard to learn via manual

– Prefer to learn by doing

©2011 46 www.id-book.com, http://mcs.open.ac.uk/yr258/rthemes.html

Learning: Design implications

• Encourage exploration

• Constrain and guide learners

• Dynalinking

Page 24: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

24

©2011 47 www.id-book.com

Reading, speaking, and listening

• Sentences or phrases mean same thing

• Many prefer listening to reading

• Written is permanent, spoken is transient

• Reading quicker than speaking or listening

• Listening requires less cognitive effort

• Written grammatical, spoken not so much

©2011 48 www.id-book.com

RSL: Design implications

• Speech-based interfaces

– Short menus and instructions

– Accentuate intonation of artificial speech

• Allow text to be enlarged

– Zoom

– Actual change in size

Page 25: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

25

©2011 49 www.id-book.com

Problem-solving, planning, reasoning and decision-making

• Reflective cognition:

What to do Options

Consequences

©2011 50 www.id-book.com

Problem-solving, planning, reasoning and decision-making

• Often involves

– Conscious processes

– Discussion with others (or oneself)

– Use of artifacts

• May involve analyzing different scenarios

Page 26: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

26

©2011 51 www.id-book.com

Problem-solving, planning, reasoning and decision-making

• Extent depends on level of expertise

– Novices

• Make assumptions

• Similar situations

• Trial and error

• Slow and error prone

– Experts

• Optimal strategies

• Think ahead

©2011 52 www.id-book.com, http://stuffpoint.com/pringles/image/137454/pringles-picture/

Problem-solving, planning, reasoning and decision-making

• Overwhelming choice

– Simple heuristics

– Fast decisions that are ‘just good enough’

– Influences product packaging

Page 27: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

27

©2011 53 www.id-book.com

PS,P,R,DM: Design implications

• Additional info/functions for those who care

• Support rapid decision-making and planning

©2011 54 www.id-book.com

Cognitive Frameworks

Page 28: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

28

©2011 55 www.id-book.com

Framework

• Set of interrelated concepts

• Advice in the form of

– Steps

– Challenges

– Principles

– Etc.

• Help constrain and scope

©2011 56 www.id-book.com

Mental models

• Includes:

– How to use the system

– How the system works

• Use to infer how to carry out tasks

• Best if matches conceptual model

Page 29: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

29

©2011 57 www.id-book.com

Mental models: Examples

• More is more

– The more you turn/push, the greater the effect

Thermostat Oven Elevator

©2011 58 www.id-book.com

Mental models: Transparency

• Useful feedback

• Facilitate simple, intuitive interaction

• Clear, easy to follow instructions

• Appropriate help/tutorials

• Context-sensitive guidance

• Two types of users – Those who care about how system works

– Those who don’t

Page 30: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

30

©2011 59 www.id-book.com

Gulfs of execution and evaluation

• Gaps between the user and the interface

• Bridge to reduce required cognitive effort

Norman, 1986; Hutchins et al, 1986

©2011 60 www.id-book.com

Gulfs of execution and evaluation

• The gulf of execution – Input: Distance from user to system

• The gulf of evaluation – Output: Distance from system to user

Norman, 1986; Hutchins et al, 1986

Page 31: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

31

©2011 61 www.id-book.com

Information processing model

• Done to mental representations

– Images

– Mental models

– Rules

– Other forms of knowledge

©2011 62 www.id-book.com

Human processor model

• Card et al. (1983)

• Cognition = series of processing stages

• Three types of processes

Perceptual Cognitive Motor

Page 32: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

32

©2011 63 www.id-book.com

Human processor model: Pros and Cons

• The Good

– Predicts which processes involved

– Can calculate how long user will take

• The Bad

– Does not account for interactions in real world

©2011 64 www.id-book.com

External cognition

• Cognitive processes involved when interact with external representations

• Interaction includes

– Representations

– Tools

• Main goal is to analyze

– Cognitive benefits

– Processes involved

Page 33: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

33

©2011 65 www.id-book.com

External cognition: Reduce memory load

• Recall hard – Especially non-visual

• Recognition easy

• Individual notes – Many times with relevant or prominent location

• Note aggregates

©2011 66 www.id-book.com

External cognition: Reduce memory load

• Remind need to do something – Buy something for Christmas

• Remind what to do – Buy llamas

• Remind when to do – Order llamas by certain date

Page 34: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

34

©2011 67 www.id-book.com

External Cognition: Computational offloading

• Tool + external representation for computation

• Ex:

©2011 68 www.id-book.com

External Cognition: Annotation

• Modifying existing representations

• Ex:

– Underlining

Page 35: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

35

©2011 69 www.id-book.com, http://www.pearldrummersforum.com/showthread.php?87973-A-fun-Scrabble-hand-I-got-tonight

External Cognition: Cognitive tracing

• Manipulate into different orders or structures

• Ex:

©2011 70 www.id-book.com, www.amazon.com

External Cognition: Design implication

• Provide external representations that

– Reduce memory load

– Facilitate computational offloading

• Ex:

Page 36: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

36

©2011 71 www.id-book.com

Distributed cognition

• Nature of cognitive phenomena across

Individuals

Artifacts

Internal Representations

External Representations

©2011 72 www.id-book.com

Distributed cognition

• Propagation across representational state

• Info transformed through different media

• Ex:

Page 37: Cognitive aspects - University of Rochester · 2013-02-05 · Cognitive aspects Chapter 3 Anna Loparev Intro HCI University of Rochester 01/31/2013 ... –Color –Ordering –Spacing

2/5/2013

37

©2011

• Different from other frameworks – More extensive than external cognition

– Focus on system of people and artifacts

73 www.id-book.com

Distributed cognition

©2011 74 www.id-book.com

Distributed cognition analysis: What’s involved

• Distributed problem-solving

• Role of verbal and non-verbal behavior

• Coordinating mechanisms that are used – Rules

– Procedures

• Communication

• How knowledge shared and accessed