yahoo mail fail – an interactive approach to designhkhaki/hci-research/iat201_yahoomail.pdf ·...

Yahoo Mail Fail – An Interactive Approach

To Design

Nilou Kou 301158837

Hasti Khaki 301156456

Alicia Wong 301187621

John Nguyen 301186883

Table of content

Chapter One: Introduction 2 -15

Abstract 2

Introduction 3

Motivation and Purpose

Problem Statement and User Goals 3 - 4

Redesign Objectives

Users

Description of User Base 4 - 5

Persona 5 - 6

Context of Use, Scenario & Task

Heuristic Evaluation 6 - 8

User Study

Goals, Questions/Hypothesis Addressed 9

Methods 10 - 11

Materials & Procedures 11 - 14

Results 13 - 14

Requirements Statement

Functional Requirement 14 - 15

Non-Functional Requirement 15

Chapter Two: Design 16 - 20

Prioritization Worksheet 17

Design Inspirations and Comparison 18

Conceptual Design A 19

Overview & Description

Design Hypothesis

Interaction Paradigm

Conceptual Design B 20

Overview & Description

Design Hypothesis

Interaction Paradigm

Comparison of Conceptual Designs A & B 21

Chapter Three: Prototyping 22 - 32

Illustration of Task Pursued 22 - 29

Insights & lesson Learned 30

Storyboard 31 - 32

Chapter Four : Evaluation 33 - 47

Goals of Evaluation Study 33

Questions, Hypothesis Addressed

Design Evaluation Methods 34

Participants

Materials

Instructions & Task Description 35 - 36

Experimental Design & Procedure 36

Results 37 - 44

Quantitative Data

Qualitative Data 45 - 46

Comparative Data

Discussion & Conclusion - Implications for Future Design 47

Abstract

Two overall issues we as group noticed with Yahoo Mail is its design and functionality. In the

issue with design, we found that the Yahoo Mail homepage is seemingly unorganized and layered

with ambiguous icons. And in terms of its functionality we feel that Yahoo Mail is lacking in providing

a more efficient interface to manage multiple emails in a timely manner.

It is with the notions of design and functionality that we took into consideration when conducting our

two part user study; the study was executed by way of observation where users were given a list of

pre-‐determined tasks to be followed and then the users were interviewed about their overall

experience.

In our study, we found that in general, those that are not familiar with using different email

interface’s took more time than those who are in completing the given tasks.

These were examples of a few findings that came about our user study; it highlights overall that there

are some issues with the layout and design which users do not find easily navigable. In the last

section of our interview we has ask users what were some areas in which Yahoo Mail could improve

on. One user, a Teacher Assistant felt that she was unable to efficiently manage her emails to

students in a timely manner.

What our findings had revealed is that the majority our participants voiced the opinion that

Yahoo Mail does have much room to improve its usability and interface design.

Introduction

The interface that my group members and I have decided to re evaluate and redesign is Yahoo Mail,

one of the first popular free email service to be widely used. Today, the number of current users

stands at over 200 million users worldwide. The primary operation of Yahoo Mail is to provide an

electronically asynchronous communication outlet. This involves the ability for users to compose,

send and receive electronic mail (email) and data at any given time; furthermore, the interface

provides a digital space to manage and organize the users’ information.

Motivation and purpose

Problem Statement

Lack of innovation in design has made Yahoo’s email lack in efficiency and user appeal. Problems

with the current interface stems from an arbitrary hierarchy in layout and ambiguity of icons. For

example, there are more icons/tabs, of which are too subjective than need be. Icons and tools are

similar in design and layout which makes for its functions indistinct from others. In combination

with its two tone gray/purple colour scheme Yahoo Mail is uniformly bland and uninviting. In such,

we feel that users are more likely not to engage with the possibilities of the tools that are provided.

Redesign Objectives

Our redesign objective is to create a more efficient email interface that enables users to

compose and receive mail in a more timely manner. In terms of visibility, we find that Yahoo Mail

lacks reorganize and re-‐map its interface for it to be more navigable. In contrast to its current

interface, we will implement a design that will encourage users to make use of the current tools

available but are rarely used enough such as the ‘folder’ tool. Simple but critical tasks such as to

sign-‐out and compose an email need to be more apparent than it is currently. Our aim is to create

distinct and visible design that will invite users to take advantage of the possible tools at hand. The

two tone color of Yahoo Mail layers itself as another detriment to users as it causes an unnecessary

uniformity between icons and tabs where we feel that colour coded icons may result in a more

recognizable and distinctive layout.

Users

As each generation has become more tech savvy, the use of email by users of different

background and age has increase as well. It is nearly a ubiquitous tool today. From public school

students in elementary to high school, university students and companies, email serves a number of

purposes for different groups. It can be fair to note that email use at the younger ages would be

primarily for social purposes. Teenagers in high school and university students will find themselves

contacting a more variety of individuals. For example this is the age where along with social

purposes students will be emailing their teachers, counsellors and also potential employers. And for

any business venture to succeed, it can be argued that email use is a must. In such, the user base of

emails varies across a range of individuals in terms of age, sex, ethnicity etc. And considering at what

stage one is in their lives their use of emails will be likely either for social or professional purposes.

As mentioned earlier, email use has become a near ubiquitous tool in the new media age.

Personas

Persona 1

Kim is a 21 years old business student at Simon Fraser University and is currently interning as

a PR with Blackberry. Not only does Kim juggle homework and work but also involves herself as the

president of the SFU Business Club which has 47 members and volunteers at a youth clinic on the

weekends. She’s highly driven by the desire to succeed and thus time management is critical. There

are always deadlines to be met and meetings not only to attend to but arrange as well. With these

responsibilities Kim finds herself constantly on the move communicating with colleagues, classmates

and club members; her main communication device, the Samsung galaxy receives over 100 emails

and messages on a given day. With the high rate of communicating via emails and text messages, Kim

sometimes confuses between the vast number of contacts she receives messages from and replies

to. Therefore what Kim needs in her life at the moment is a way to improve her time management

and organization. And being able to effectively communicate with others is pivotal for her future

growth in success.

Persona 2

At the age of 55, Frank has been able to retire at a young and able age after 30 years of

teaching High School students. He lives at home with his wife and between his 2 daughters and 3 sons

who have all moved out Frank has 10 grandchildren between the ages of 3 -‐ 9.

Besides traveling, leisure for Frank consists of gardening with his wife, fishing, hiking and golfing if

the weather permits. Frank is old school and up until this year has not used an email account nor does

he communicate with text messaging. But with some of his grandchildren nearing the age of having

phones and using email, Frank felt that he wants the ability to communicate with them more often

since they all live out the province. He has created an email account in past but as someone who does

not regularly engage with new communication technology found it confusing and difficult to

navigate. Therefore what Frank wants is an email interface that is easy to learn and navigate for him

to compose his email.

Context of Use, Scenario and Task

One important and common scenario is the use of Yahoo Mail by college students with part

time jobs and or internships which means there are many branches of different groups you are in

regular contact with. Along with eating breakfast checking emails is one of the first tasks a student

does when they wake up. Emails from your Faculty major, volunteer coordinators, internship

opportunities, friends, classmates, professors, employers etc are common and routine. And with a

high volume of email coming in, one may find themselves composing and sending a fair amount of

emails out to a wide range of individuals as well.

Heuristic Evaluation

Heuristic name Location Severity* Recommendations

Visibility Compose Email –

Reply, Forward, Reply

All Buttons

High All three options are

represented by arrow icons.

These keys are one of the main

features in email interfaces;

they should be less ambiguous.

Visibility Sign out button Medium The Sign out button should be in

a more visible location, instead

of requiring clicking username

Visibility Compose Email key Medium The Compose key should be

more apparent, stand-‐out and

accessible even when the user is

on another tab in yahoo mail.

Feedback Deleting Email High Yahoo Mail should display a

notification to users, telling the

users that an email(s) has moved

to the trash folder.

Constraints Adding grouped

contacts into

recipients while

composing new email

Medium There should be a “select all”

option for users to click in case

of very long / huge contact list

Affordance

(Help and

documentation)

Composing email – cc

and bcc

Low Yahoo Mail should provide a

feature, and option, where users

can toggle a hint box with a

message that teaches users

about how cc and bcc work.

Error Prevention Contacts High When multiple contacts are

selected, the “edit detail”

feature is grey, hinting that it’s

not an available feature;

however, if user double clicks it,

it will lead you to a broken link,

and it cannot be fixed by clicking

“contacts” again. It can only be

fixed by refreshing the whole

page. Yahoo should fix this error;

perhaps by removing the “edit

detail” option when multiple

contacts or selected.

Constraints Adding contacts

while composing

new email

Low There should be an option for

users to edit the grouped

contacts in the tab where users

add contacts to the recipients

while composing a new email.

Constraints

(efficiency of use)

Adding attachment Low User should be able to drag and

drop when adding attachment

Constraints

(efficiency of use)

Send / Save Draft

option while

Composing Email

Medium There should be Send and Save

Draft options at the bottom of

the page where user compose

email.

Visibility Inbox Medium Emails with attachment should

show attachment size on the

inbox menu.

Visibility Inbox -‐ Folder Medium The option of deleting the folder

should be available beside the

folder name.

Visibility Folder – email filter Medium Filter option is in Mail options,

which is quite invisible to new

users. This option should be

available in both Folder and

Inbox.

User study

Hypothesis

Due to Yahoo Mail’s current interface users suffer from an inefficient email service with

irrational layout design, and the multitude of ambiguous icons being the underlying issues. After

completing the user study we found that there were significant evidence that displayed issues in our

participants ability to complete in a timely manner the simple tasks given. For the participants, we

created two sets of tasks and measured the amount of time to complete each set. In conjunction

with the quantitative measure we used direct observation and took note of the change in behaviour

while each tasks is being completed.

To test our hypothesis as accurately possible we created two sets of tasks, basic uses and settings that

most users are likely to be familiar with and followed up with nine questions and ended with a

one-‐one interview.

Tasks

Basic uses

1. Compose an email

2. Upload an (or multiple) attachment)

3. Check in box -‐ open mail -‐ send a bcc/cc -‐ reply/ forward the mail

4. Move to next unread email. Without going back to the inbox

5. Forward an email with an attachment but not include attachment when forwarding

6. Reply to a message

7. Omitting a contact from group email

8. Save draft mail

Settings

9. Create a new contact

10. Block an email

11. Change PW

12. Change settings. (e.g.: theme color)

13. Change Display picture

14. Sign out

The use of email is a near ubiquitous tool used in new media age. With that said the primary

users of this interface that we aimed our redesign towards are teenagers, students and professionals.

Therefore, we decided to include a variety of participants from different backgrounds varying in age,

gender and profession to get a more general picture of those who use email. The results of choosing

a broad scope of participants provides an insightful outlook into our hypothesis.

User study questions

1. What email interface do you primarily use?

2. What is your purpose of using email mostly? (connect with friends / homework / work /

read subscription etc.)

3. How often do you check your e-‐mail (on computer or phone)? (At least once a day / Once

every other day / Once a week / Never)

4. Have you ever used Yahoo email?

5. Did you encounter any problems/obstacles when performing your task? If yes, please

describe.

6. How did you feel about the functions / placement of the icons of Yahoo mail?

7. What do you like about the Yahoo email interface?

8. What do you dislike about the Yahoo email interface

9. Would you consider using Yahoo mail? Why or why not?

The Users Study

The content of the interview covers two main fundamental parts of a public written

correspondence that can be divided into “Design” and “Functionality” category. While users were

asked to do certain tasks we were recorded not only the time but also took note of any significant

change in behaviour and motion such as facial expressions, physical reactions and counting number

of times that they refresh the page or click on the home page.

In our findings what had been revealed is that overall, our participants nearly all agreed that

Yahoo Mail does have much room to improve its usability and interface design.

Users, who did not have an extensive background in using different email interfaces were

more likely to have issues and take more time to complete the given tasks than those who were

known to have experience in using different forms of email have helped us with noticing how a little

lack of hierarchy and consistency can confuse them with their choice. The reactions observed and

recorded from our users led us to the assumption that there are few elements which needs to be

more clear. Thus we followed up with an interview to explore further; for example, when we asked

users who have had basic knowledge of computer to reply or forward an email they some had said

they did not know which icon is for which function.

Before we started our user study with users who were comfortable with working with

different emails including Yahoo, we were under the wrong assumption that we would not observe

significant patterns of use when completing the tasks. Contrary to our initial assumption this group

greatly provided information on what functions are needed to improved Yahoo Mail. For example,

after completing a task like creating new a folder or adding specific emails into that folder, we asked

the user to delete and create a folder but they were unable to. From one participants personal

experience they said “its ok we keep it like this and we will rename the folder later on if I need a new

folder” .

Overall the user study has opened our eyes to recurring issues participants have and in such

invites our group to look into different avenues of solution. After we listened to the needs of users

and discussion that we have had in our group, we have come up with few ideas to how to make this

email server even more efficient. For example, one of our users who is a TA was telling us how she

has difficulty with managing her time and sending out some emails to students at the particular time.

She told us that one day she was suppose to release an email which had a content of assignment

description to all the student and release the email on the given time by the prof, but for some

emergency reason she left her house and did not get back home on the right time so she had to send

the assignments with delay. When we discussed all the user case study in our group we even came up

with a functionality idea such as having an option which will automatically send out emails to the

receiver at the specific time which has been set by user from before.

Number Gender Age Background Reason For Selection

1 F 55

Not very familiar with Yahoo or

other email servers

Uses Yahoo on IPhone

Generation

Gender

Knowledge of

technology

2M 15

Only familiar with basic

functions of Yahoo

Uses Yahoo on PC

Generation

Gender

Occupation

Technology used

3F 25

Familiar with Gmail and Yahoo

Uses both on PC and IPhone

Knowledge of different

email serves

Occupation

4F 38

Only familiar with Yahoo

Uses Yahoo on MacBook Air

Level of comfort with

email servers

Purpose of using email

5M 40

Not familiar with Yahoo at all but

is Gmail user

Uses MacBook

Age

Email servers used

Requirement statement

Functional Requirements

Yahoo! Mail, as an e-‐mail system, is a webmail that offers free e-‐mail services to its users. A

typical e-‐mail system, like that of Yahoo! Mail, is supposed to be able grant the users access to

sending and receiving incoming e-‐mails, and being able to access them with an interface provided

alongside it. In other words, the functional requirements of a webmail are to be able to provide the

users with interfaces that would allow them to receive incoming e-‐mails, send/reply e-‐mails to a

certain or various recipients, and be able to open , view and delete these acquired or delivered

messages as long as they are within access of the user. Even though saving contacts and creating

contact lists are not required functions for a webmail, all webmail services nowadays do possess this

function. Without the presence of any of these requirements, Yahoo! Mail will not be considered as

an e-‐mail system at all.

Non-‐Functional Requirements

The non-‐functional requirements are what make a webmail unique from other e-‐mail service

providers and differentiate it from the others. For instance, Yahoo! Mail has the ability to distinguish

users on the system; it is able to filter incoming e-‐mails according to users’ preference – setting it to

be much like having a specific inbox for messages received from specific addresses. Another

non-‐functional requirement that Yahoo! Mail possess is security throughout the different functions

of the webmail-‐ security against both incoming and outgoing e-‐mails. Yahoo! Mail offers more

features such as: the calendar function which allows users to setup events and reminders for

deadlines and meetings, the yahoo messenger, a customizing features for users to change Yahoo!

Mail’s theme, Email functions such as allowing one or more file attachments, organizing sent e-‐mails,

allowing shortcuts for users to forward or reply to e-‐mails, sending e-‐mails to multiple users, and so

forth.

Prioritization Worksheet

Item Description Business Importance User Importance Technical Feasibility Recourse Availability

Home page layout

Removing Removing the tabs that open Low Medium High High Tabs ĞĂĐŚƟŵĞƚŚĞƵƐĞƌĐůŝĐŬƐŽŶĂůŝŶŬ

Feedback ĚĚŝŶŐĨĞĞĚďĂĐŬƐƵĐŚĂƉŽƉƵƉ ,ŝŐŚ ,ŝŐŚ DĞĚŝƵŵ ,ŝŐŚ ƐŚĂƉĞƚŚĂƚĂƉƉĞĂƌƐǁŚĞŶƚŚĞƵƐĞƌ ĚĞůĞƚĞƐƐŽŵĞƚŚŝŶŐ

Adding more dŚĞŝŵƉŽƌƚĂŶƚƚĂƐŬƐƐƵĐŚĂƐƚŚĞ High High High Highhierarchy ĐŽŵƉŽƐĞďƵƩŽŶǁŝůůďĞǀŝƐŝďůĞďǇĐŚĂŶŐŝŶŐŝƚ ƐĐŽůŽƌĂŶĚƐŚĂƉĞ

Icon Design ŚĂŶŐŝŶŐƚŚĞƌĞƉůǇĂŶĚĨŽƌǁĂƌĚ >Žǁ ,ŝŐŚ DĞĚŝƵŵ ,ŝŐŚ ŝĐŽŶƐƚŽŵŽƌĞĐůĞĂƌŝĐŽŶƐ

Adding ĞůĞƟŶŐǁŝůůďĞĐŽŶƐŝƐƚĞŶƚ >Žǁ ,ŝŐŚ ,ŝŐŚ ,ŝŐŚ Consistency

Bubble ĚĚŝŶŐĂďƵďďůĞůĂǇŽƵƚĨŽƌ DĞĚŝƵŵ DĞĚŝƵŵ DĞĚŝƵŵ ,ŝŐŚlayout ŵĞƐƐĂŐĞƐĞŶƚďĂĐŬĂŶĚĨŽƌƚŚ with the same subject

Changing the home page High High Medium MediumůĂǇŽƵƚƚŽŵƵůƟƉůĞǁŝŶĚŽǁƐƚŚĂƚƌĞƉƌĞƐĞŶƚŝŵƉŽƌƚĂŶƚĨƵŶĐƟŽŶƐƐƵĐŚĂƐĐŽŵƉŽƐĞŝŶďŽǆŵĞƐƐĂŐĞƐĞƚĐ

1

Chapter Two: Design

ƐĨŽƌƚŚĞŽŶǀĞƌƐĂƟŽŶsŝĞǁĨƵŶĐƟŽŶŝƚǁĂƐŝŶƐƉŝƌĞĚďǇƚŚĞƉƉůĞ ƐŵĂŝůŝŶƚĞƌĨĂĐĞǁŚĞƌĞŝŶĞͲŵĂŝůƐĨƌŽŵƚŚĞƐĂŵĞƌĞĐŝƉŝĞŶƚ;ƐͿĂŶĚƚŚĞƐĂŵĞƐƵďũĞĐƚǁŝůůďĞĐůƵƐƚĞƌĞĚƚŽŐĞƚŚĞƌĂŶĚĚŝƐƉůĂǇĞĚĂƐĂůŝƐƚƐŝŵŝůĂƌƚŽŚŽǁĐŽŶǀĞƌƐĂƟŽŶƐĂƌĞĚŝƐƉůĂǇĞĚtŝƚŚƚŚŝƐĨƵŶĐƟŽŶƵƐĞƌƐĐĂŶǀŝĞǁƚŚĞĞŶƟƌĞĐŽŶƚĞǆƚŽĨĂƐŝŶŐůĞĞͲŵĂŝůƚŚƌĞĂĚďĞŝŶŐĚŝƌĞĐƚĞĚƚŽƚŚĞĐŽŶƚĞŶƚƐŝŶŽƚŚĞƌƌĞůĂƚĞĚĞͲŵĂŝůƐǁŝƚŚŽƵƚŶĞĞĚŝŶŐƚŽƐĞĂƌĐŚƵƐŝŶŐƚŚĞƐĞĂƌĐŚďĂƌŽƌƐĐƌŽůůŝŶŐƚŚƌŽƵŐŚƚŚĞŝŶďŽǆƚŽĮŶĚƚŚĞƌĞůĂƚĞĚŵĞƐƐĂŐĞƐĐŚƌŽŶŽůŽŐŝĐĂůůǇhŶĨŽƌƚƵŶĂƚĞůǇ ŽŶǀĞƌƐĂƟŽŶsŝĞǁŝƐŶŽƚĚĞƐŝŐŶĞĚĨŽƌŵĂŶƵĂůƐĞĂƌĐŚŝŶŐĂŶĚŶĂǀŝŐĂƟŽŶĂƐŝƚŚĂƐƚŚĞƚĞŶĚĞŶĐǇƚŽƐƚĂĐŬĞŵĂŝůƐǁŝƚŚƉƌĞǀŝŽƵƐŽŶĞƐ;ƉƌŽǀŝĚĞĚƚŚĞǇĐŽŵĞĨƌŽŵƚŚĞƐĂŵĞƐĞŶĚĞƌͿdŚŝƐǁŝůůƌĞƐƵůƚŝŶƚŽŵĂŬŝŶŐƚŚĞƵƐĞƌ ƐŝŶďŽǆůŽŽŬŽƌŐĂŶŝǌĞĚĂŶĚŶĞĂƚďƵƚĨŽƌƉĞŽƉůĞǁŚŽǁŝůůĮŶĚƚŚĂƚĨĞĂƚƵƌĞŝŶĐŽŶǀĞŶŝĞŶƚƐƟůůǁĞŚĂǀĞƉƌŽǀŝĚĞĚĂŶŽƉƟŽŶĨŽƌƚŚĞŵƚŽƐǁŝƚĐŚŽīŽŶǀĞƌƐĂƟŽŶsŝĞǁ

Design Inspirations, Prior Work & Comparison to Other Existing Interfaces

KƵƌŶĞǁĚĞƐŝŐŶĨŽƌzĂŚŽŽDĂŝůŝƐŝŶƐƉŝƌĞĚŵŽƐƚůǇďǇtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞdŚĞĂďŝůŝƚǇƚŽĚƌĂŐĂŶĚĚƌŽƉŝĐŽŶƐĂŶĚƚŽĐƵƐƚŽŵŝǌĞƚŚĞƐŝĚĞŵĞŶƵĨƌĞĞůǇďĂƐĞĚĨƌŽŵƚŚĞƵƐĞƌƐůŝŬŝŶŐƐĂŶĚƉƌĞĨĞƌĞŶĐĞǁĂƐŝŶƐƉŝƌĞĚďǇďŽƚŚƚŚĞtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞĂŶĚƚŚĞŚŽŵĞͲƐĐƌĞĞŶŝŶƚĞƌĨĂĐĞŽĨŵŽƐƚƐŵĂƌƚͲƉŚŽŶĞƐtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞŝƐĨƌĞĞůǇĐƵƐƚŽŵŝǌĂďůĞůŝŬĞƚŚĞŚŽŵĞͲƐĐƌĞĞŶƐŝŶƚĞƌĨĂĐĞƐŽĨƚŚĞƐŵĂƌƚͲƉŚŽŶĞƐǁĞŚĂǀĞŶŽǁŝĐŽŶƐĐĂŶďĞĞĂƐŝůǇŵŽǀĞĚŐƌŽƵƉĞĚŽƌŐĂŶŝǌĞĚĂŶĚĚĞůĞƚĞĚďǇƐŝŵƉůĞĂĐƟŽŶƐƐƵĐŚĂƐĚƌĂŐŐŝŶŐĂŶĚĚƌŽƉƉŝŶŐ&ŽƌŽƵƌŝĐŽŶƐŶĞǁĚĞƐŝŐŶƐtŝŶĚŽǁƐϴŝŶƐƉŝƌĞĚƵƐƚŽŵĂŬĞƚŚĞŵƐŝŵƉůĞĞůĞŐĂŶƚĂŶĚĐŽŶƐŝƐƚĞŶƚŝŶƚĞƌŵƐŽĨŝƚƐŶĂǀŝŐĂƟŽŶĂŶĚĐŽŶƚƌŽůƐ/ƚƐĚĞƐŝŐŶǁŝůůďĞǀĞƌǇŝŶǀŝƟŶŐƚŽĂŶǇƚǇƉĞŽĨƵƐĞƌƐ

Windows 8

Apple Mail

hƐĞƌƐƉƌĞĨĞƌŵŽƌĞĐƵƐƚŽŵŝǌĂďůĞƐŝŵƉůĞƌĂŶĚŵŽƌĞĐŽŶǀĞŶŝĞŶƚĨĞĂƚƵƌĞƐǁŚĞŶŝƚĐŽŵĞƐƚŽŝŶƚĞƌĨĂĐĞƐŶƐƵƌŝŶŐĞĂƐǇŶĂǀŝŐĂƟŽŶĨŽƌƚŚĞƐĞŵĂŝůŝŶƚĞƌĨĂĐĞƐǁŽƵůĚĂƩĞŶĚƚŽƚŚŝƐĚĞŵĂŶĚŽĨƚŚĞƵƐĞƌƐĂƐĞĚŽŶƚŚĞĚĞƐŝŐŶŝŶƐƉŝƌĂƟŽŶĨƌŽŵtŝŶĚŽǁƐϴĂŶĚƉƉůĞŵĂŝůǁĞĚĞƐŝŐŶĞĚĂŇĞǆŝďůĞŝŶƚĞƌĨĂĐĞǁŚŝĐŚĐĂƚĞƌƐƚŽƚŚĞƐŽĐŝĂůĂŶĚƉƌŽĨĞƐƐŝŽŶĂůŶĞĞĚƐŽĨĞĂĐŚŝŶĚŝǀŝĚƵĂůƵƐĞƌ

2

Conceptual Design A

dŚĞĐŽƌĞŝĚĞĂŽĨŽƵƌƌĞĚĞƐŝŐŶŽďũĞĐƟǀĞŝƐƚŽƐŝŵƉůŝĨǇzĂŚŽŽDĂŝůŝŶƚŽĂŵŽƌĞƐŽƵŶĚĂŶĚĞĸĐŝĞŶƚĞŵĂŝůŝŶƚĞƌĨĂĐĞŵĞĂŶŝŶŐĮƌƐƚďǇŝŵƉƌŽǀŝŶŐĞŵĂŝů ƐŵŽƐƚďĂƐŝĐĂŶĚĞƐƐĞŶƟĂůĨƵŶĐƟŽŶͲƚŽĐŽŵƉŽƐĞĂŶĚƌĞĐĞŝǀĞĞŵĂŝůĂŶĚƐĞĐŽŶĚůǇ ƚŽŝŶĐƌĞĂƐĞƚŚĞƵƐĞƌĂƚĞŽĨƚŚĞĨŽůĚĞƌƐƐƚĂƌƌĞĚĂŶĚƐƉĂŵƚŽŽůƐ <ĞǇƚŽĂĐĐŽŵƉůŝƐŚŝŶŐƚŚŝƐǁĂƐƚŚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŚŽŵĞƉĂŐĞůĂǇŽƵƚtŚĂƚƵƐĞƌƐǁŝůůĮƌƐƚŶŽƟĐĞĂďŽƵƚĐŽŶĐĞƉƚĚĞƐŝŐŶŝƐƚŚĂƚŽŶƚŚĞĞŵĂŝůŚŽŵĞƉĂŐĞЬŽĨƚŚĞƐĐƌĞĞŶŝƐĂƉƉƌŽƉƌŝĂƚĞĚĨŽƌƚŚĞůĞŌƉĂŶĞůĂŶĚвŝƐƉƌŽǀŝĚĞĚĨŽƌƚŚĞ/ŶďŽǆWƌŽǀŝĚĞĚŵŽƌĞƐƉĂĐĞƚŚĞŝŶĐƌĞĂƐĞĚƉĂŶĞůƐŝǌĞǁŝůůŝŶĚŝĐĂƚĞĂŵŽƌĞƐŝŐŶŝĮĐĂŶƚĨƵŶĐƟŽŶƚŽƚŚĞŝŶƚĞƌĨĂĐĞtŝƚŚŝŶƚŚĞůĞŌƉĂŶĞůƚŚĞĐŽŵŵŽŶƚĂďƐƚŽŽůƐͲ/ŶďŽǆƐƚĂƌƌĞĚƌĂŌ^ĞŶƚDĂŝů/ŵƉŽƌƚĂŶƚ:ƵŶŬ^ƉĂŵͲǁŝůůďĞƉƌŽǀŝĚĞĚďƵƚƌĂƚŚĞƌƚŚĂŶũƵƐƚƚĞǆƚƚŚĞŝĐŽŶƐǁŝůůďĞƉƌĞƐĞŶƚŝŶƚŚĞĨŽƌŵŽĨƐƋƵĂƌĞďŽǆĞƐǁŝƚŚŝĐŽŶƐĂŶĚƚĞǆƚƉƌŽĚƵĐŝŶŐŵŽƌĞǀŝƐŝďůĞĂŶĚƌĞĐŽŐŶŝǌĂďůĞƐǇŵďŽůƐ

Design Hypothesis Email versatility - WƌŽǀŝĚĞĚĂŵŽƌĞǀĞƌƐĂƟůĞĂŶĚĐƵƐƚŽŵŝǌĂďůĞŝŶƚĞƌĨĂĐĞƵƐĞƌƐǁŝůůŵŽƌĞĨƌĞƋƵĞŶƚůǇ ĐŽŵŵŝƚĂŶĚŵĂŬĞƵƐĞŽĨƚŚĞĨƵŶĐƟŽŶƐƚŽŽůƐƉƌĞƐĞŶƚ^ĞĐŽŶĚůǇ ǁŝƚŚƚŚĞĂďŝůŝƚǇƚŽĚŽƐŽƵƐĞƌƐǁŝůůĚĞǀŝƐĞĂŶŝŶƚĞƌĨĂĐĞƚŚĂƚďĞƐƚƐƵŝƚƐŽŶĞ ƐƐŽĐŝĂůĂŶĚƉƌŽĨĞƐƐŝŽŶĂůƌĞƋƵŝƌĞŵĞŶƚƐ

Text Messanger EmailͲ/ŶƚƌŽĚƵĐŝŶŐĂƚĞǆƚŵĞƐƐĞŶŐĞƌĞŵĂŝůĨŽƌŵĂƚͲǁŚĞƌĞŵĞƐƐĂŐĞƐĞŶƚĂŶĚƌĞĐŝĞǀĞĂƌĞĐůĞĂƌĂŶĚĚŝƐƟŶŐƵŝƐŚĞĚďǇĂƚĞǆƚďŽǆƉƌŽĚƵĐĞƐĂŵŽƌĞĐŽŶǀĞƌƐĂƟŽŶĂůĂŶĚĂƐǇŶĐƌŽŶŽƵƐĞǆƉĞƌŝĞŶĐĞĨŽƌƵƐĞƌƐ

Large, Distinct Icons -/ŶĐŽŶƚƌĂƐƚƚŽƚŚĞƐƚĂŶĚĂƌĚůŝƐƚĂůŽŶŐƚŚĞůĞŌƉĂŶĞůƵŶŝƋƵĞƐƋƵĂƌĞƐŚĂƉĞŝĐŽŶƐƉƌĞƐĞŶƚƐƚŚĞƚŽŽůƐĨƵŶĐƟŽŶƐĂƐŵŽƌĞĚŝƐĐĞƌŶŝďůĞĂŶĚǁŝůůŝŶĐƌĞĂƐĞƵƐĞĨƌĞƋƵĞŶĐǇ

Drop Shadow & Corner Slits - WƌŽǀŝĚĞƐƚŚĞǀŝƐƵĂůĐůƵĞƚŚĂƚƚŚĞŝĐŽŶƐĂƌĞĂďůĞƚŽƐŚŝŌƉůĂĐĞŵĞŶƚĂŶĚĂůƐŽƚŽďĞƌĞƐŝǌĞĚ

Drag & Drop Function - WƌŽǀŝĚĞƐĂŵŽƌĞƉƌŽĚƵĐƟǀĞŽƉƟŽŶƚŚĂƚŝƐŽĨĂŵŽƌĞŶĂƚƵƌĂůƚƌĂŶƐŝƟŽŶǁŚŝĐŚĞůŝŵŝŶĂƚĞƐƵŶŶĞĐĞƐƐĂƌǇƐƚĞƉƐƚŽĂĚĚƌĞŵŽǀĞŝƚĞŵ

Colour Contrast -/ŶƐƚĞĂĚŽĨƚŚĞƚǁŽƚŽŶĞƐŽĨŐƌĞǇĐƵƌƌĞŶƚůǇƵƐĞĚďůĂĐŬƚĞǆƚĂŶĚǁŚŝƚĞďĂĐŬŐƌŽƵŶĚǁŝůůďĞŝŶƉůĂĐĞĨŽƌĐŽŶĐĞƉƚĚĞƐŝŐŶǁŚŝĐŚĐƌĞĂƚĞƐĂŵŽƌĞĚŝƐƟŶĐƟǀĞǀŝƐŝďŝůŝƚǇŽĨƚŚĞůĂǇŽƵƚ

Interaction Paradigm & Interface Metaphors for Design A

dŚĞŝŶƚĞƌĂĐƟŽŶƉĂƌĂĚŝŐŵŽŶǁŚŝĐŚǁĞďĂƐĞĚŽƵƌĚĞƐŝŐŶĐŽŵĞƐĨƌŽŵƚŚĞĚĞƐŝŐŶĂŶĚƵƐĞŽĨƚŽƵĐŚƐĐƌĞĞŶƐŵĂƌƚƉŚŽŶĞƐͲƚŚĞĚŝƐƟŶŐƵŝƐŚĂďůĞĂŶĚƵŶŝƋƵĞŝĐŽŶƐĂŶĚƚŚĞŶĂƚƵƌĂůĨĞĞůŽĨŶĂǀŝŐĂƟŽŶtĞǀĞĂĐĐŽŵƉůŝƐŚƚŚŝƐďǇĂůůŽǁŝŶŐƵƐĞƌŇĞǆŝďŝůŝƚǇ ŝŶƚĞƌŵƐŽĨĐƵƐƚŽŵŝǌĂƟŽŶĂŶĚĂƚƚŚĞƐĂŵĞƟŵĞƌĞĚĞƐŝŐŶŝŶŐŝĐŽŶƐǁŝƚŚĂĐůĞĂŶĂŶĚŵŽĚĞƌŶĞĚŐĞ^ŝŵŝůĂƌƚŽƚŚĞĐŚĂŶŐĞŝŶƚŚĞƵƐĞƌĨĂĐĞƚŚĂƚƉƌŽĚƵĐĞĚtŝŶĚŽǁƐϴŽƵƌĚĞƐŝŐŶƚĂŬĞƐĂůĞĂƉĨŽƌǁĂƌĚŝŶĐŚĂůůĞŶŐŝŶŐǇĞĂƌƐŽĨƐƚĂŶĚĂƌĚƐŝŶĞŵĂŝůĞƟƋƵĞƩĞƐ DƵĐŚŵŽƌĞĚǇŶĂŵŝĐĨƌŽŵƚŚĞŽůĚŝŶƚĞƌĨĂĐĞĐŽŶĐĞƉƚĐŚĂůůĞŶŐĞƐƚŚĞĐƌĞĂƚĞĚĂŶĚƐƚĂƟĐŶŽƌŵƐŝŵŝůĂƌƚŽǁŚĂƚƚŚĞƵƉĚĂƚĞĚƚŽtŝŶŽǁƐϴĚŝĚ

3

Concept Design B

/ŶƚĞƌĨĂĐĞĂůƚŚŽƵŐŚƐŝŵŝůĂƌŝŶƚŚĞƐƚĂŶĚĂƌĚůĂǇŽƵƚŽĨĞŵĂŝůƐͲƐŵĂůůůĞŌŚĂŶĚƉĂŶĞůĂůŽŶŐǁŝƚŚŽƉĞŶĚŝƐƉůĂǇŽĨƚŚĞŝŶďŽǆͲŝƐŵŽƌĞĞĐŽŶŽŵŝĐĂůŝŶŝƚƐĚĞƐŝŐŶĂŶĚŵĂŬĞƐďĞƩĞƌƵƐĞŽĨƚŚĞůĂǇŽƵƚƐƉĂĐĞ/ŶƚĞƌŵƐŽĨĂŵŽƌĞĞĐŽŶŽŵŝĐƵƐĞŽĨƐƉĂĐĞŝŶƚĞƌĨĂĐĞǁŝůůŽŶůǇĂůůŽǁĨŽƌŽŶĞƚĂďƚŽďĞŽƉĞŶĞĚĂƚŽŶĞƟŵĞůƐŽĨŽĐƵƐŝŶŐŽŶƚŚĞǀŝƐŝďŝůŝƚǇŽĨŽǀĞƌĂůůůĂǇŽƵƚŵĞĂŶƚĨŽƌĂĐŽŵƉůĞƚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐƚŚĂƚĂƌĞĚŝƐƟŶĐƚ^ƵĐŚŝĐŽŶƐĂƐ&ŽůĚĞƌƐǁŝůůďĞƐǇŵďŽůŝǌĞĚďǇĂŶŝŵĂƚĞĚĚƌĂǁŝŶŐƐŝŶƐƚĞĂĚŽĨƚĞǆƚĨĞĞĚďĂĐŬďĂƌĨŽƌǁŚĞŶĂƵƐĞƌĚĞůĞƚĞƐĂŵĞƐƐĂŐĞǁŝůůĂƉƉĞĂƌǁŝƚŚŝŶĂŚŽƌŝǌŽŶƚĂůďĂƌŵŽŵĞŶƚĂƌŝůǇƚŚĞŶŐŽŽīƐĐƌĞĞŶϱƐĞĐŽŶĚƐ

Design Hypothesis

Overall standard email layoutͲWƌĞƐĞŶƚƐĂŵŽƌĞĨĂŵŝůŝĂƌĚĞƐŝŐŶĂŶĚŝŶƚƵƌŶĂŵŽƌĞĞĂƐǇƚƌĂŶƐŝƟŽŶĨŽƌƵƐĞƌƐƚŽĂĚũƵƐƚĂŶĚƚŚƵƐŝŶĐƌĞĂƐĞĞĸĐŝĞŶĐǇŝŶƵƐĞďǇĚĞǀĞůŽƉŝŶŐŽīƚŚĞƐƚĂŶĚĂƌĚůĂǇŽƵƚ

Unique Icon redesignͲDŽƌĞĂƉƉĞĂůŝŶŐŝĐŽŶƐǁŝůůƐƚĂŶĚŽƵƚĂŶĚŝŶǀŝƚĞƵƐĞƌƐƚŚĞƌĞĨŽƌĞŝŶĐƌĞĂƐŝŶŐĨƌĞƋƵĞŶĐǇin use

Single tab windows Ͳ/ŶƐƚĞĂĚŽĨƚŚĞĂďŝůŝƚǇƚŽŽƉĞŶŵƵůƟƉůĞƚĂďƐŽŶůǇďĞŝŶŐĂďůĞƚŽŽƉĞŶŽŶĞƚĂďĞŶĂďůĞƐƵƐĞƌďĞŵŽƌĞĞĸĐŝĞŶƚĂŶĚĨŽĐƵƐŽŶƚŚĞƚĂƐŬĂƚŚĂŶĚ

User Feedback functionͲ/ŵƉŽƌƚĂŶƚĞǆĞĐƚƵƚĞĚƚĂƐŬͲŝĞŵŽǀŝŶŐůŽĐĂƟŽŶŽĨĮůĞƐͲǁŝůůƚƌŝŐŐĞƌĂŵŽŵĞŶƚĂƌǇ;ϱƐĞĐŽŶĚƐͿŶŽƟĮĐĂƟŽŶƉŽƉƵƉ

Interaction Paradigm & Interface Metaphors for Design B

dŚĞŝŶƚĞƌĂĐƟŽŶƉĂƌĂĚŝŐŵƐĞĞŬƐƚŽĞǆƉůŽŝƚƚŚĞƉĞƌĐĞŝǀĞĚŬŶŽǁůĞĚŐĞŽĨƚŚĞƵƐĞƌƐĞǆƉĞƌŝĞŶĐĞǁŝƚŚŽƚŚĞƌĞŵĂŝůƐĞƌǀŝĐĞƐǇĞƚĂƚƚŚĞƐĂŵĞƟŵĞĞĂƐŝůǇĚĞǀĞůŽƉĂƐŬŝůůƐĞƚĨŽƌŶĞǁƵƐĞƌƐƚŚĞƌĞĨŽƌĞĚĞƐŝŐŶǁŝůůĂƚŝƚƐĐŽƌĞƌĞƚĂŝŶŝƚƐŽƉĞƌĂƟŽŶƐŝŵŝůĂƌƚŽƚŚĞƐƚĂŶĚĂƌĚƐŽĨĞŵĂŝůůĂǇŽƵƚƐĞĐĂƵƐĞƚŚĞĨƌĂŵĞŽĨƚŚĞŶĞǁŝŶƚĞƌĨĂĐĞŝƐƐŝŵŝůĂƌŝŶƐŚĂƉĞƚŽƚŚĞŽůĚƚŚĞŵĞƚĂƉŚŽƌƚŚĂƚďĞƐƚĚĞƐĐƌŝďĞƐŝƐůŝŬĞŚĂǀŝŶŐĂŶŽůĚŚĞĂǀǇŵŽƵŶƚĂŝŶďŝŬĞƚŽƌŝĚĞĂƌŽƵŶĚŝŶƚŚĞĐŝƚǇĂŶĚƵƉŐƌĂĚŝŶŐƚŽĂďƌĂŶĚŶĞǁƌŽĂĚďŝŬĞƚŚĞďŝŬĞ ƐĨƌĂŵĞŝƐůŝŐŚƚŝŶǁĞŝŐŚƚĂŶĚŚĂƐůĞƐƐŐĞĂƌƐǁŚŝĐŚƐƵŝƚƐƚŚĞĐŽŵŵƵƚĞŽŶƚŚĞĐŝƚǇƌŽĂĚdŚĞŵŽƵŶƚĂŝŶďŝŬĞŽŶĂĐŝƚǇƌŽĂĚŝƐǁŚĂƚƚŚĞŽůĚzĂŚŽŽDĂŝůǁĂƐƚŽƵƐĞƌƐͲƚŽŽŵĂŶǇƵŶĞĐĞƐƐĂƌǇĨĞĂƚƵƌĞƐŽƉƟŽŶƐǁŚĞƌĞĂƐĂƌŽĂĚďŝŬĞƐŝŵƉůĞǇĞƚĞǆĂĐƚůǇǁŚĂƚŽŶĞŶĞĞĚƐŽŶƚŚĞƌŽĂĚŝƐŚŽǁŝŶƚĞƌĨĂĐĞƉĞƌĨŽƌŵƐ

4

Comparison of Conceptual Design A and B

Aspect to compare Concept Design A Concept Design B

Overall Web Layout A unique layout, with emphasis on the use A economic use of space in standard ŽĨƚŚĞƚŽŽůƐƉƌŽǀŝĚĞĚďǇĚĞƐŝŐŶĂƟŶŐŵŽƌĞĞŵĂŝůůĂǇŽƵƚ/ĐŽŶƐŽŶƚŚĞůĞŌƉĂŶĞůĂƌĞ ƐƉĂĐĞĨŽƌƚŚĞůĞŌƉĂŶĞůĂŶĚŝƚƐƚĂďƐůŝƐƚĞĚ

User Flexibility hƐĞƌƐĂƌĞĂďůĞƚŽŐƌŽƵƉĂĚĚĚĞůĞƚĞƚĂďƐ>ŽĐĂƟŽŶĂŶĚƐŝǌĞŽĨƚĂďƐĂƌĞƉƌĞƐĞƚ ƚŽŽŶĞƐŽǁŶƉƌĞĨĞƌĞŶĐĞ ƚŽĚĞĨĂƵůƚƐĞƫŶŐ

Icon Design Large unique icons within squares Small unique icons within squares

User Feedback A momentary message will appear - message sent to trash - when an important ĂĐƟŽŶͲĚĞůĞƚĞĞŵĂŝůŝƐĞǆĞĐƵƚĞĚ

Text Messenger Email DĞƐƐĂŐĞƐƌĞĐĞŝǀĞĚĂŶĚƐĞŶƚǁŝůůďĞŝŶƚŚĞĨŽƌŵĂƚƐŝŵŝůĂƌƚŽƚŚĂƚŽĨƚĞǆƚŵĞƐƐĂŐĞƐŽŶŽŶĞƐƉŚŽŶĞ ǁŚĞƌĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞƐĚŝƐƟŶŐƵŝƐŚƚŚĞƚǁŽ

Preattentive Processing

ĐĐŽƌĚŝŶŐƚŽŽůŝŶtĂƌĞĞǀĞŶďĞĨŽƌĞĐŽŶƐĐŝŽƵƐĂǁĂƌĞŶĞƐƐĐĞƌƚĂŝŶƐŚĂƉĞƐĂŶĚĐŽůŽƵƌƐƉŽƉŽƵƚĨƌŽŵƚŚĞďĂĐŬŐƌŽƵŶĚĂŶĚŝƚŵŽƐƚƵƐĞĨƵůƚŽŚĂǀĞƚŚŝŶŐƐƐŚŽǁĂƚĂŐůĂŶĐĞ dŽŝŶƐƚĂŶƚůǇƌĞĐŽŐŶŝǌĞĂĚĞƐŝƌĞĚŽďũĞĐƚĨƵŶĐƟŽŶŝƚƐŚŽƵůĚďĞƉƌĞĂƩĞŶƟǀĞůǇĚŝīĞƌĞŶƚĨƌŽŵŽƚŚĞƌƐdĂŬĞŶŝŶƚŽĐŽŶƐŝĚĞƌĂƟŽŶƚŚĞĐŽŶĐĞƉƚŽĨƉƌĞĂƩĞŶƟǀĞƉƌŽĐĞƐƐŝŶŐĂŶĚĨŽƌŵƐƚŚĂƚĂƌĞŬŶŽǁŶƚŽďĞƉƌĞĂƩĞŶƟǀĞůǇƉƌŽĐĞƐƐĞĚƐƵĐŚĂƐĐŽůŽƌ ŝŶƚĞŶƐŝƚǇĂŶĚƐƉĂƟĂůƉŽƐŝƟŽŶŝƐĂƉƉůŝĞĚƚŽƚŚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐĂĐŚŝŶĚŝǀŝĚƵĂůĨƵŶĐƟŽŶͲĨŽůĚĞƌ ƐƚĂƌƌĞĚƚƌĂƐŚĞƚĐͲŚĂǀĞƵŶŝƋƵĞƐǇŵďŽůƐďƵƚĂƌĞĂůůĐŽŶƚĂŝŶĞĚǁŝƚŚŝŶĂƉƵƌƉůĞƐƋƵĂƌĞƚĂďƚĂŐůĂŶĐĞƚŚĞŝĐŽŶƐĂƌĞŐƌŽƵƉĞĚŝŶƐŝŵŝůĂƌĨŽƌŵƐǁŝƚŚŝŶƐƋƵĂƌĞƚĂďƐďƵƚĞĂĐŚĚĞůŝŶĞĂƚĞƐĨƌŽŵƚŚĞŽƚŚĞƌƚŚĂƚŝƐƐƵďƚůĞǇĞƚĚŝƐƟŶĐƚĂŶĚƐƚĂŶĚƐŽƵƚ

Figure - Ground & Proximity

dŽĞǆĞĐƵƚĞĂŵŽƌĞĐůĞĂƌŝŶƚĞƌĨĂĐĞďŽƚŚŽƵƌĚĞƐŝŐŶƐŝŶƚŚĞŝƌďĂůĂŶĐĞŝŶƌĂƟŽďĞƚǁĞĞŶŝĐŽŶƐĨƵŶĐƟŽŶƐ;ŽďũĞĐƚͿĂŶĚǁŚŝƚĞƐƉĂĐĞ;ďĂĐŬŐƌŽƵŶĚͿĞǆĞŵƉůŝĨǇƚŚĞƉƌŝŶĐŝƉůĞŽĨĂďĂůĂŶĐĞŝŶĮŐƵƌĞŐƌŽƵŶĚƌĞůĂƟŽŶƐŚŝƉ'ĞƐƚĂůƚƐƚĂƚĞƐ that when similar elements are placed close together, they are seen as a group rather than individual ĨƌĂŐŵĞŶƚƐƐŽǁŝƚŚƐƋƵĂƌĞƚĂďƐĂŶĚŝĐŽŶƐǁĞŚĂǀĞŐƌŽƵƉĞĚŬĞǇƚŽŽůƐĨƵŶĐƟŽŶƐŝŶĐůŽƐĞƉƌŽǆŝŵŝƚǇƚŽŽŶĞĂŶŽƚŚĞƌ Continuation and Closure

dŚĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐƚĂŬĞƌĞĨĞƌĞŶĐĞƚŽƚǁŽ'ĞƐƚĂůƚƉƌŝŶĐŝƉůĞƐŽŶƟŶƵĂƟŽŶĂŶĚůŽƐƵƌĞdŚĞŝĐŽŶƐĂƌĞĚĞƐŝŐŶĞĚƚŽĞŶŐĂŐĞƚŚĞĞǇĞƚŽŵŽǀĞĐŽŶƟŶƵĂůůǇƚŚƌŽƵŐŚĂŶŽďũĞĐƚĂŶĚĂƚƚŚĞƐĂŵĞƟŵĞƚŚĞŝĐŽŶ ƐĨĞĂƚƵƌĞƐĂƌĞůĞŌŝŶĐŽŵƉůĞƚĞďƵƚĚŝƐĐĞƌŶŝďůĞĨŽƌƵƐĞƌƐƚŽƐĞĞĂƐǁŚŽůĞ

Re!ection: Designing for Humans

5

Compose

Inbox draft

sentfolders

YAHOO! MAIL search webmail

Hi, Kim!

contact calendertrash spam

Sort by date Page 1

SFU User Study Date

sign out

Move Spam ActionsDelete

Compose

Inbox Draft

SentFolders

Sign outYAHOO! MAIL Search WebMail

Hi, Kim!

Contact CalenderTrash Spam

SFU Date

Date

User Study

Hi,The user study questions and heuristic evaluation is attached below.

Thanks

Move Spam ActionsDelete

Hi,Thanks, I think one of the attachments is missing.

Thanks

Me

ReplyForward

Compose

Inbox Draft

SentFolders

Sign outYAHOO! MAIL Search WebMail

Hi, Kim!

Contact CalenderTrash Spam

To:SFU

From: IAT 201Cc+ Bcc

This is where the user has the text edit otions

Hi,The missing file is attached now.

Thanks

IAT201

Send Save Draft

Send Save Draft

YAHOO ! MAIL

Inbox

Sent

Draft

Spam

Trash

Conversations

Folders

Applications

Hi, Kim

Sign Out

Email Search Web Search

Delete Move Spam Actions

Sort By Date

SFU IAT 201 Date

Page1

YAHOO ! MAIL

Inbox

Sent

Draft

Spam

Trash

Conversations

Folders

Applications

Hi, Kim

Sign Out


Delete Move Spam Actions

From:SFU

To:IAT 201

Hi,

The user study quetions are attached below.

Thanks

Date

YAHOO ! MAIL

Inbox

Sent

Draft

Spam

Trash

Conversations

Folders

Applications

Hi, Kim

Sign Out


To:IAT 201

Subject: User Study Questions

Hi,

Thanks, one of the attachments is missing.

Thanks

Date

Attachments This the text edit area for the user

Save Draft

+ CC BCC

Send

Re!ection: Insights & Lessons Learned

Insights From User Testing, Feedback & Discussion

ĂƐĞĚŽŶŽƵƌƵƐĞƌƐƚƵĚǇŝŶƚŚĞƉƌĞǀŝŽƵƐĐŚĂƉƚĞƌ ŝƚŝƐĐůĞĂƌƚŚĂƚŵĂŶǇƵƐĞƌƐͲŽŌĞŶƚŚŽƐĞŶŽƚĨĂŵŝůŝĂƌǁŝƚŚƵƐŝŶŐĚŝīĞƌĞŶƚĞŵĂŝůƉƌŽǀŝĚĞƌƐͲĮŶĚzĂŚŽŽDĂŝůĚŝĸĐƵůƚƚŽŶĂǀŝŐĂƚĞĂŶĚĞǆĞĐƵƚĞďĂƐŝĐƚĂƐŬƐdŚĞƌĞǁĞƌĞŵƵůŝƉůĞĐĂƐĞƐǁŚĞƌĞƚŚĞƉĂƌƟĐŝƉĂŶƚƐŝŵƉůǇĚŝĚŶŽƚŬŶŽǁŚŽǁƚŽĞǆĞĐƵƚĞƚŚĞƚĂƐŬƐĂƚŚĂŶĚdŚĞƌĞĨŽƌĞĨŽƌŽƵƌĚĞƐŝŐŶƐƚƌĂƚĞŐǇǁĞǁƌŽƚĞŽŶĂďůĂĐŬďŽĂƌĚĮƌƐƚǁŚĂƚǁĞĂƐĂŐƌŽƵƉƚŚŽƵŐŚƚŽĨĂƐƚŚĞKE^ŽĨzĂŚŽŽDĂŝůĂŶĚƐĞĐŽŶĚůǇ ǁŚĂƚŝƐƐƵĞƐĚŝĚƚŚĞƉĂƌƟĐŝƉĂŶƚƐĮŶĚĚƵƌŝŶŐƵƐĞƌƐƚƵĚǇ/ƚǁĂƐŝŶƚŚŝƐǀŝĞǁŽƵƌƉĞƌĐŝĞǀĞĚĂŶĚƚŚĞĂĐƚƵĂůŝƐƐƵĞƐͲĨƌŽŵƚŚĞǀŝĞǁŽĨƚŚĞƉĂƌƟĐŝƉĂŶƚƐͲǁŝƚŚzĂŚŽŽDĂŝůƚŚĂƚĚƌŽǀĞƚŚĞĚĞƐŝŐŶƐƚƌĂƚĞŐǇŽĨ/Ϯ

Insights From Prototyping

tŝƚŚĨŽĐƵƐŽŶŚŝĞƌĂƌĐŚǇĂŶĚŝĐŽŶĚĞƐŝŐŶǁĞĂŝŵĞĚƚŽƚŽƐŝŵƉůŝĨǇƚŚĞƚŽŽůƐĂƚŚĂŶĚŽƵƌƉůĂŶǁĂƐƚŽƉƌŽǀŝĚĞƵƐĞƌƐŽůĚĂŶĚŶĞǁĂĨĂƐƚĞƌĞŵĂŝůŝŶƚĞƌĨĂĐĞǁŚŝůĞďĞŝŶŐǀŝƐƵĂůůǇĞŶŐĂŐŝŶŐdŚĞƌĞƐƵůƚŽĨŽƵƌƌĞƐĞĂƌĐŚĚĞƐŝŐŶĂŶĚĞǆĞĐƵƟŽŶŽĨďŽƚŚƉƌŽƚŽǇƉĞĂŶĚǁĂƐĂƐƵĐĐĞƐƐŝŶǁŚŝĐŚŽƵƌƉƌŝŵĂƌǇƌĞĚͲĚĞƐŝŶŐŐŽĂůƐǁĞƌĞƌĞĂĐŚĞĚdŚŽƵŐŚƐŝŐŶŝĮĐĂŶƚůǇĚŝīĞƌĞŶƚŝŶƚŚĞŝƌůĂǇŽƵƚĂŶĚŝƐĚĞƐŝŐŶĞĚǁŝƚŚĂďĂůĂŶĐĞŝŶƚŚĞŚŝĞƌĂƌĐŚǇƚŽƉƌŽǀŝĚĞĂĐůĞĂƌŝŶƚĞƌĨĂĐĞƚŚĂƚŚĂƐƌĞĚƵĐĞĚƚŚĞƐƚĞƉƐĂŶĚƟŵĞƐƉĞŶƚƚŽĐŽŵƉůĞƚĞďĂƐŝĐƚĂƐŬƐƐƵĐŚĂƐĐŽŵƉŽƐŝŶŐĂŶĞŵĂŝů

Storyboard For Project Video

A

B

Chapter Four: Evaluation

Goals of Evaluation Study

dŚĞŐŽĂůŽĨƚŚŝƐĞǀĂůƵĂƟŽŶƐƚƵĚǇǁĂƐƚŽŐŝǀĞŶƚŚĞĚĞƐŝŐŶŽĨƚŚĞƚǁŽƉƌŽƚŽƚǇƉĞƐĚĞƚĞƌŵŝŶĞƚŚĞďĞƐƚƉŽƐƐŝďůĞĂůƚĞƌŶĂƟǀĞƚŽƚŚĞĐƵƌƌĞŶƚzĂŚŽŽDĂŝůŝŶƚĞƌĨĂĐĞWƌŽƚŽƚǇƉĞǁĂƐĂƌĞƐƵůƚŽĨƉůĂŶƐƚŽŝŶƚƌŽĚƵĐĞĂŵŽƌĞŇĞǆŝďůĞĞŵĂŝůŝŶƚĞƌĨĂĐĞƚŚĂƚƐƵŝƚƐƵƐĞƌƐŝŶĚŝǀŝĚƵĂůŶĞĞĚƐdŚŝƐĂŝŵůĞĚƚŽĂĚƌĂƐƟĐƌĞĚĞƐŝŐŶŽĨƚŚĞzĂŚŽŽDĂŝůůĂǇŽƵƚtŚĞƌĞĂƐǁŝƚŚWƌŽƚŽƚǇƉĞƚŚĞŝŶƚĞƌĨĂĐĞǁĂƐĚĞƐŝŐŶĞĚŝŶĂŵĂŶŶĞƌƐŝŵŝůĂƌƚŽƚŚĞƐƚĂŶĚĂƌĚĞŵĂŝůůĂǇŽƵƚdŚĞůŽŐŝĐďĞŝŶŐĂůŽŶŐǁŝƚŚŽƵƌĚĞƐŝŐŶĂĚũƵƐƚŵĞŶƚƐƵƐĞƌĨĂŵŝůŝĂƌŝƚǇƉƌŽǀŝĚĞƐĂŵŽƌĞĞīĞĐƟǀĞĞŵĂŝůĞǆƉĞƌŝĞŶĐĞ/ƚǁĂƐǁŝƚŚŝŶƚŚĞĨƌĂŵĞǁŽƌŬŽĨŽƵƌŐŽĂůƐĨŽƌĞĂĐŚƉƌŽƚŽƚǇƉĞƚŚĂƚǁĞŚĂĚĚĞǀŝƐĞĚƚŚĞĨŽůůŽǁŝŶŐĞǀĂůƵĂƟŽŶ

Questions & Hypothesis Addressed by the Evaluation

Prototype A

;ĂͿdŚĞůĂƌŐĞƌĞĚĞƐŝŐŶĞĚŝĐŽŶƐƌĞƐƵůƚƐŝŶŚŝŐŚǀŝƐŝďŝůŝƚǇĂŶĚŝŶĐƌĞĂƐĞƐƌĂƚĞŽĨƵƐĞ

;ďͿdŚĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞǀŝĞǁƉƌŽǀŝĚĞƐĂůĞƐƐĐůƵƩĞƌĞĚůĂǇŽƵƚĂŶĚĂůůŽǁƐƵƐĞƌƐƚŽĚŝƐƟŶŐƵŝƐŚŵŽƌĞ ĐůĞĂƌůǇďĞƚǁĞĞŶƐĞŶƚĂŶĚƌĞĐŝĞǀĞĚĞŵĂŝůƐ ;ĐͿZĂƚŚĞƌƵƐŝŶŐƌŝŐŚƚĐůŝĐŬƚŚĞĚƌĂŐĂŶĚĚƌŽƉĨƵŶĐƟŽŶŝŶĚĞƐŝŐŶĂůůŽǁƐĂŵŽƌĞŶĂƚƵƌĂůĂŶĚŇĞǆŝďůĞ ƚƌĂŶƐŝƟŽŶƚŽĐŽŵƉůĞƚĞƚĂƐŬƐ

Prototype B

;ĂͿdŚĞƐƚĂŶĚĂƌĚĨĂŵŝůŝĂƌůĂǇŽƵƚŽĨĚĞƐŝŐŶƉƌŽǀŝĚĞƐĂŵŽƌĞŶĂǀŝŐĂďůĞŝŶƚĞƌĨĂĐĞƚŚĂŶĚĞƐŝŐŶ

;ͿůůŽǁŝŶŐƵƐĞƌƐƚŽŽƉĞŶŽŶĞƚĂďĂƚĂƟŵĞĞŶĂďůĞƐƵƐĞƌƐƚŽďĞŵŽƌĞĞĸĐŝĞŶƚďǇĨŽĐƵƐŝŶŐŽŶƚŚĞƚĂƐŬ ĂƚŚĂŶĚ

Design Evaluation Methods

/ŶƚŚĞƚĂďůĞďĞůŽǁƵƐĞƌƐĂƌĞůŝƐƚĞĚŝŶƚŚĞŽƌĚĞƌŝŶǁŚŝĐŚƚŚĞǇƉĂƌƟĐŝƉĂƚĞĚŝŶƚŚĞƐƚƵĚǇdŚĞƵƐĞƌƐƚƵĚǇƚŽŽŬƉůĂĐĞŝŶƚŚĞƐƉĂŶŽĨƌŽƵŐŚůǇϮŚŽƵƌƐĂƚ^&hƐƵƌƌĞǇ

WĂƌƟĐŝƉĂŶƚ 'ĞŶĚĞƌŐĞ ZĞĂƐŽŶĨŽƌ^ĞůĞĐƟŽŶ

1 M 19 Represents frequent users of email - University student who ŵĂŶĂŐĞƐŵƵůƟƉůĞĞŵĂŝůƐĚĂŝůǇ

Ϯ & ϯϬZĞƉƌĞƐĞŶƚƐĨƌĞƋƵĞŶƚƵƐĞƌƐŽĨĞŵĂŝůͲWƌŽĨĞƐƐŝŽŶĂůǁŚŽƌŽƵƟŶĞůǇ ůŝĂŝƐŽŶƐďĞƚǁĞĞŶĐůŝĞŶƚƐĂŶĚĐŽůůĞĂŐƵĞƐƉƌŝŵĂƌŝůǇǀŝĂĞŵĂŝů

3 F 28 Represents moderate users of email - Email is used primarily for social purposes only: sending and recieving emails to and from friends and family

4 M 28 Represents frequent users of email - A professional who is familiar with using up to date technology; relies on computer, phone and ĞŵĂŝůĨŽƌǁŽƌŬ

5 F 36 Represents moderate/low users of email - Not experienced in using ĐƵƌƌĞŶƚƚĞůĞĐŽŵŵƵŶŝĐĂƟŽŶƚĞĐŚŶŽůŽŐǇWƌŝŵĂƌǇƵƐĞŝƐĨŽƌƐĞŶĚŝŶŐ and receiving emails from family and friends

6 M 18 Represents frequent users of email - College student, who is ĨĂŵŝůŝĂƌĂŶĚĞǆƉĞƌŝĞŶĐĞĚŝŶƵƐŝŶŐĂǀĂƌŝĞƚǇŽĨƚĞůĞĐŽŵŵƵŶŝĐĂƟŽŶ technology, ie: instant and text messaging, skype, and emails

Materials

>ŽĐĂƟŽŶŽĨƐƚƵĚǇǁĂƐĐŽŵƉůĞƚĞĚŝŶƚǁŽůŽĐĂƟŽŶƐŽĨƚǁŽŐƌŽƵƉŵĞŵĞďĞƌƐdŚĞŵĂƚĞƌŝĂůƐǁĞƵƐĞĚĐŽŶƐŝƐƚĞĚŽĨĂŶŽƚĞƉĂĚƉĞŶĂŶĚƟŵĞƌ ĞĨŽƌĞƚŚĞƐƚĂƌƚŽĨƚŚĞƚĂƐŬKŶĞŐƌŽƵƉŵĞŵďĞƌǁŽƵůĚŐŝǀĞĂŐĞŶĞƌĂůŽǀĞƌǀŝĞǁŽĨƚŚĞƵƉĐŽŵŝŶŐƚĂƐŬdŚĞĮƌƐƚƚŚƌĞĞƉĂƌƟĐŝƉĂŶƚƐůŝĐŝĂ ƐĨĂŵŝůǇŵĞŵďĞƌƐďĞŐĂŶƚŚĞƐƚƵĚǇďǇĐŽŵƉůĞƟŶŐĞƐŝŐŶĨŽůůŽǁĞĚďǇĞƐŝŐŶdŚĞŽƌĚĞƌĨŽƌƚŚĞůĂƩĞƌƚŚƌĞĞƉĂƌƟĐŝƉĂŶƚƐĨƌŝĞŶĚƐĂŶĚĨĂŵŝůǇŵĞŵďĞƌƐŽĨ:ŽŚŶ ƐǁĞƌĞƌĞǀĞƌƐĞĚǁŝƚŚĞƐŝŐŶďĞŝŶŐĐŽŵƉůĞƚĞĚĮƌƐƚ

ĂƚĂŽůůĞĐƟŽŶ &ŽƌĞĂĐŚƉĂƌƟĐŝƉĂŶƚƚŚĞƌĞǁĞƌĞƚŚƌĞĞĂĐƟǀĞŐƌŽƵƉŵĞŵďĞƌƐŵĞĂƐƵƌŝŶŐƚŚĞĨŽůůŽǁŝŶŐ ϭdŝŵĞƚŽĐŽŵƉůĞƚĞĞĂĐŚƚĂƐŬ ϮĞŚĂǀŝŽƌ ϯEƵŵďĞƌŽĨƚŽƚĂůĐůŝĐŬƐ &ƵƌƚŚĞƌŵŽƌĞƉĂƌƚĐŝƉĂŵƚƐǁĞƌĞĂƐŬƚŽƐƉĞĂŬĂůŽƵĚĂŶĚďƌŝĞŇǇĚĞƐĐƌŝďĞĂŶǇŝƌƌĞŐƵůĂƌŝƚĞƐ

Instructions and Task Description

Tasks

The following tasks were presented to participants on a sheet of paper, which they were able to revert back to if necessary.

Task One:

Search for an e-mail which its content is about “the most recent changes made in the recent ƉƌŽũĞĐƚŶĂŵĞĚ/dϮϬϭ;hƐĞƌƐǁŝůůŽŶůǇďĞŐŝǀĞŶƚŚŝƐŝŶĨŽƌŵĂƟŽŶǁĞǁŝůůŶŽƚƚĞůůƚŚĞŵƚŚĞƐĞŶĚĞƌŽĨƚŚĞ e-mail and possible keywords which are in the contents of the e-mail)

Task Two:

ZĞƉůǇƚŽĂůů/dϮϬϭ'ƌŽƵƉŵĂƚĞƐ ĞǆĐĞƉƚ^ĂŶĚǇ ǁŝƚŚƚŚĞŵĞƐƐĂŐĞ/ŐŽƚŝƚƚŚĂŶŬǇŽƵ

Task Three:

DŽǀĞĂůůĞͲŵĂŝůƐƚŚĂƚĂƌĞƟƚůĞĚϮϬϭƚŽƚŚĞƉƌŽũĞĐƚ/dϮϬϭ ŝŶĐůƵĚŝŶŐƚŚĞĞͲŵĂŝůŝŶƚŚĞƉƌĞǀŝŽƵƐƚĂƐŬ ƚŽĨŽůĚĞƌŶĂŵĞĚ,ŽŵĞǁŽƌŬ;^ŚŽƵůĚďĞϳͲŵĂŝůƐŝŶƚŽƚĂůϯĞͲŵĂŝůĨŽƌƉƌŽƚŽƚǇƉĞͿ

Task Four:

DŽǀĞƚŽŶĞǆƚƵŶƌĞĂĚĞͲŵĂŝůǁŝƚŚŽƵƚŐŽŝŶŐďĂĐŬƚŽƚŚĞŝŶďŽǆƌĞƉůǇƚŽƚŚĞĞͲŵĂŝůǁŝƚŚƚŚĞŵĞƐƐĂŐĞ /ŐŽƚŝƚƚŚĂŶŬǇŽƵ

Task 5:

CŽŵƉŽƐĞĂŶĞǁĞͲŵĂŝůhƉůŽĂĚĂŶĂƩĂĐŚŵĞŶƚĂŶĚƐĞŶĚƚŚĞĞͲŵĂŝů

YƵĞƐƟŽŶŶĂŝƌĞ

ŌĞƌƚŚĞƚĂƐŬƐĨŽƌďŽƚŚƉƌŽƚŽƚǇƉĞƐǁĞƌĞĐŽŵƉůĞƚĞĚƵƐĞƌƐǁĞƌĞĂƐŬĞĚƚŽĐŽŵƉůĞƚĞƚŚĞĨŽůůŽǁŝŶŐƋƵĞƐƟŽŶƐ

ϭZĂƚĞƚŚĞůĞǀĞůŽĨĚŝĸĐƵůƚǇƚŽĐŽŵƉůĞƚĞƚŚĞƌĞƋƵŝƌĞĚƚĂƐŬƐĨŽƌ

Prototype A: Very Easy 1 2 3 4 5 sĞƌǇŝĸĐƵůƚ Prototype B: Very Easy 1 2 3 4 5 sĞƌǇŝĸĐƵůƚ

ϮZĂƚĞƚŚĞǀŝƐŝďŝůŝƚǇŽĨƚŚĞŝĐŽŶƐƚŽŽůƐŝŶƚŚĞůĞŌĐŽůƵŵŶĨŽƌ

Prototype A: Very Poor 1 2 3 4 5 ǆĐĞůůĞŶƚ Prototype B: Very Poor 1 2 3 4 5 ǆĐĞůůĞŶƚ

ϯZĂƚĞƚŚĞŽǀĞƌĂůůĂĞƐƚŚĞƟĐƐŽĨƚŚĞŝĐŽŶƐ

Prototype A: Very Poor 1 2 3 4 5 ǆĐĞůůĞŶƚ Prototype B: Very Poor 1 2 3 4 5 ǆĐĞůůĞŶƚ

ϰZĂƚĞƚŚĞĂĞƐƚŚĞƟĐƐŽĨƚŚĞŽǀĞƌĂůůǁĞďůĂǇŽƵƚĨŽƌ

WƌŽƚŽƚǇƉĞ Very Poor 1 2 3 4 5 Excellent WƌŽƚŽƚǇƉĞ Very Poor 1 2 3 4 5 Excellent

ϱKƵƚŽĨWƌŽƚŽƚǇƉĞĂŶĚWƌŽƚŽƚǇƉĞǁŚŝĐŚĚŽǇŽƵĮŶĚŵŽƐƚǀŝƐƵĂůůǇĂƉƉĞĂůŝŶŐ

WƌŽƚŽǇƉĞ WƌŽƚŽƚǇƉĞ

ϲKƵƚŽĨWƌŽƚŽƚǇƉĞĂŶĚWƌŽƚŽǇƉĞǁŚŝĐŚĚŝĚǇŽƵĮŶĚŵŽƌĞĞĂƐǇƚŽƵƐĞĂŶĚƚŽĐŽŵƉůĞƚĞĞĂĐŚƚĂƐŬ

WƌŽƚŽǇƉĞ WƌŽƚŽƚǇƉĞ

ϳtŚĂƚĞŵĂŝůŝŶƚĞƌĨĂĐĞĚŽǇŽƵĮŶĚŝŶŐĞŶĞƌĂůŝƐƚŚĞďĞƐƚŽǀĞƌĂůů

WƌŽƚŽƚǇƉĞ WƌŽƚŽƚǇƉĞ

ϴ&ƌŽŵƚŚĞĂŶƐǁĞƌƉƌŽǀŝĚĞĚŝŶƋƵĞƐƟŽŶϳǁŽƵůĚǇŽƵĐŽŶƐŝĚĞƌƵƐŝŶŐƚŚŝƐWƌŽƚŽƚǇƉĞŽŶĂƌĞĨŐƵůĂƌďĂƐŝƐ

zĞƐ EŽ

Experimental Design & Procedure

ϭ&ŝůůŽƵƚŝŶĨŽƌŵĞĚĐŽŶƐĞŶƚĨŽƌŵ ϮǆƉůĂŶĂƟŽŶĂŶĚŽǀĞƌǀŝĞǁŽĨƚŚĞƚĂƐŬƐhƐĞƌƐĂƌĞŶŽƟĮĞĚƚŚĞǇǁŝůůďĞĐŽŵƉůĞƟŶŐƚĂƐŬƐ ĨŽƌĞĂĐŚƉƌŽƚŽƚǇƉĞ (a) Speak out loud ;ďͿ/ĨƚŚĞƌĞĂŶǇƋƵĞƐƟŽŶƐƉůĞĂƐĞĂƐŬŶŽǁ ;ĐͿ/ĨƚŚĞƌĞĂƌĞĂŶǇƋƵĞƐƟŽŶƐĚƵƌŝŶŐƚŚĞƐƚƵĚǇƐĂǇdŝŵĞĂŶĚƟŵĞƌǁŝůůƐƚŽƉ ;ĚͿhƐĞƌƐǁŝůůĐŽŵƉůĞƚĞĂϴͲƋƵĞƐƟŽŶƐƵƌǀĞǇĂŌĞƌƚĂƐŬĨŽƌďŽƚŚƉƌŽƚŽƚǇƉĞƐĂƌĞĚŽŶĞ

ĞůŽǁŝƐŽŶĞĞǆĂŵƉůĞŽĨƚŚĞĚĂƚĂƌĞĐŽƌĚĞĚĨŽƌƉĂƌƟĐƉĂŶƚϰĐŽŵƉůĞƟŶŐƚŚĞƚĂƐŬƐĨŽƌWƌŽƚŽƚǇƉĞΘWƌŽƚŽƚǇƉĞ

Participant 4 Protoype A Prototype B

Task 1 ^ĞĂƌĐŚĞĚ/dϮϬϭ ,ĞĨŽƵŶĚƚŚĞĐŽŶƚĞŶƚďǇ ^ĞĂƌĐŚĞĚ/dϮϬϭ >ŽŽŬĞĚŝŶĞŵĂŝůƐϭďǇhƐĞĚďĂĐŬ ƐĐƌŽůůŝŶŐŝŶĐŽŶǀĞƌƐĂƟŽŶǀŝĞǁ ďƵƩŽŶƐĞǀĞƌĂůƟŵĞƐ

TimeϮϯƐĞĐŽŶĚƐ TimeϰϳƐĞĐŽŶĚƐ

Protoype A Prototype B

Task 2 ůŝĐŬĞĚƌĞƉůǇďƵƩŽŶĂŶĚĂĚĚĞĚĐŽŶƚĂĐƚƐ ĂŶƚĮŶĚZĞƉůǇůůďƵƩŽŶZĂŶĚŽŵůǇĐůŝĐŬĞĚĨŽƌ ŵĂŶƵĂůůǇ ĂĐƟŽŶ

TimeϮϬƐĞĐŽŶĚƐ TimeϯϮƐĞĐŽŶĚƐ

Task 3^ĞĂƌĐŚĞĚ/dϮϬϭ&ŽƵŶĚĮƌƐƚĞŵĂŝů tĞŶƚƚŽ/ŶďŽǆƐĞƌĂĐŚĞĚ/dϮϬϭ &ŽƵŶĚϰĞŵĂŝůƐ KƚŚĞƌƚǁŽŽďƚĂŝŶĞĚďǇŶĂŵĞƐĞĂƌĐŚ ŽƵůĚŶƚĮŶĚƌĞŵĂŝŶŝŶŐĞŵĂŝůƐhƐĞƌĂƐŬƐƚŽƐĞĂƌĐŚ ďǇŐƌŽƵƉŵĂƚĞŝŶƚŚĞ/ŶďŽǆ

TimeϱϵƐĞĐŽŶĚƐ TimeϭŵŝŶƵƚĞϯϮƐĞĐŽŶĚƐ

Task 4ůŝĐŬĞĚƚŚĞΔĂƌƌŽǁƟůůŚĞƌĞĂĐŚĞĚƚŚĞƵŶƌĞĂĚ ůŝĐŬĞĚƚŚĞΔĂƌƌŽǁƵŶƟůŚĞƌĞĂĐŚĞĚƚŚĞƵŶƌĞĂĚ ŵĞƐƐĂŐĞ ŵĞƐƐĂŐĞ

TimeϮϭƐĞĐŽŶĚƐ TimeϮϰƐĞĐŽŶĚƐ

Task 5 TimeϭϮƐĞĐŽŶĚƐ TimeϭϯƐĞĐŽŶĚƐ

ƌƌŽƌƐ ϯ ϲ

ůŝĐŬƐ Ϯϰ Ϯϱ

WĂƵƐĞƐ ϵ ϰ

KďƐĞƌǀĂƟŽŶ EŽŵĂũŽƌŝƐƐƵĞƐŝŶŶĂǀŝŐĂƟŽŶ ŽŵƉůĂŝŶĞĚŚĞĐŽƵůĚŶŽƚƵƐĞƚŚĞƐĞĂƌĐŚďĂƌ ĂƐŚĞǁĂŶƚĞĚEŽŵĂũŽƌŝƐƐƵĞƐŝŶŶĂǀŝŐĂƟŽŶ

dŽƚĂůdŝŵĞ ϭŵŝŶƵƚĞϰϱƐĞĐŽŶĚƐ ϯŵŝŶƵƚĞƐϮƐĞĐŽŶĚƐ

0

2

4

6

8

10

User 6User 6User 4User 3 User 2User 1

Total Pauses

Prototype A Prototype B

Results

Quantitative Data

(a). Pauses(b). Total clicks(c). Total errors ;ĚͿdŝŵĞŽĨĐŽŵƉůĞƟŽŶ

0

2

4

6

8

10

12

User 6User 5User 4User 3User 2User 1


Total Errors

0

5

10

15

20

25

30

35



Total Clicks

0.0

0.5

1.0

1.5

2.0

2.5



Total Time

0

2

4

6

8

10

User 6User 6User 4User 3 User 2User 1

Total Pauses


Results

Quantitative Data

(a). Pauses(b). Total clicks(c). Total errors ;ĚͿdŝŵĞŽĨĐŽŵƉůĞƟŽŶ

0

2

4

6

8

10

12



Total Errors

0

5

10

15

20

25

30

35



Total Clicks

0.0

0.5

1.0

1.5

2.0

2.5



Total Time

Qualitative Data

ŌĞƌĞĂĐŚƵƐĞƌŚĂĚĐŽŵƉůĞƚĞĚƚŚĞƚĂƐŬƐĨŽƌƚŚĞƚǁŽƉƌŽƚŽƚǇƉĞƐƚŚĞǇǁĞƌĞƉƌĞƐĞŶƚĞĚǁŝƚŚĂĞŝŐŚƚƋƵĞƐƟŽŶƐƵƌǀĞǇKƵƌŐŽĂůǁĂƐƚŽĮŐƵƌĞŽƵƚǁŚŝĐŚƉƌŽƚŽƚǇƉĞĚĞůŝǀĞƌĞĚĂŵŽƌĞĨƵŶĐŝƚŽŶĂůůĂǇŽƵƚǁŚĂƚŚĂĚƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶĂŶĚƵůƟŵĂƚĞůǇǁŚŝĐŚĚĞƐŝŐŶƉƌŽƚŽƚǇƉĞĚŝĚĞĂĐŚƵƐĞƌƉƌĞĨĞƌ ůŽŶŐǁŝƚŚƚŚĞƋƵĂŶƟƚĂƟǀĞĚĂƚĂƚŚĞƐĞƌĞƐƵůƚƐƉƌŽǀŝĚĞĚƵƐǀĂůƵĂďůĞŝŶĨŽƌŵĂƟŽŶǁŚŝĐŚůĞĚƵƐƚŽŵŽǀĞŽŶĨƵƌƚŚĞƌǁŝƚŚŽŶĞŽĨƚŚĞƉƌŽƚŽƚǇƉĞƐ ĞůŽǁŝƐĂŶŽǀĞƌǀŝĞǁŽĨƐŽŵĞĮŶĚŝŶŐƐƚŚĂƚǁĞĨŽƵŶĚǁĞƌĞƌĞůĞǀĂŶƚĂŶĚŝŶƐŝŐŚƞƵů

Prototype A

ͲdŚĞŵĂũŽƌŝƚǇ ĮǀĞŽƵƚŽĨƐŝǆƉĂƌƟĐŝƉĂŶƚƐŐĂǀĞĨĂǀŽƵƌĂďůĞƌĂƟŶŐƐĨŽƌŝĐŽŶĂĞƐƚŚĞƟĐƐǁŝƚŚ ƚŚƌĞĞƐĂǇŝŶŐŝƚŝƐǆĐĞůůĞŶƚ KŶĞƵƐĞƌŐĂǀĞŝƚĂƉŽŽƌƌĂŝƟŶŐŽĨϮ

ͲKǀĞƌĂůůtĞď>ĂǇŽƵƚƌĞĐŝĞǀĞĚƌĂƟŶŐƐŽĨϯŽƌŚŝŐŚĞƌĨƌŽŵĂůůƵƐĞƌĞƐ

ͲEŽŶĞŽĨƚŚĞƵƐĞƌƐĞǆƉƌĞƐƐĞĚƚŚĂƚƚŚĞƚĂƐŬƐǁĞƌĞƚŽŽĚŝĸĐƵůƚůůƵƐĞƌƐƌĂƚĞĚƚŚĞůĞǀĞůŽĨ ĚŝĸĐƵůƚďĞůŽǁƚǁŽǀĞŶƵƐĞƌƐϰΘϱǁŝƚŚƚŚĞůŽŶŐĞƐƚĐŽŵƉůĞƟŽŶƟŵĞŐĂǀĞĂĚŝĸĐƵůƚǇ ƌĂƚĞŽĨϮ

Prototype B

ͲϭϬϬйŽĨƵƐĞƌĞƐƉƌŽǀŝĚĞĚĨĂǀŽƵƌĂďůĞƌĂƟŶŐƐϯŽƌŚŝŐŚĞƌǁĞƌĞĂƩƌŝďƵƚĞĚƚŽŝĐŽŶǀŝƐŝďŝůŝƚǇ ĚĞƐŝŐŶĂŶĚ ǁĞďůĂǇŽƵƚ

ͲƐǁŝƚŚWƌŽƚŽƚǇƉĞĂůůƵƐĞƌƐƌĂƚĞĚƚŚĞůĞǀĞůŽĨĚŝīƵĐůƚǇŽĨϮŽƌďĞůŽǁ

Comparative Data

Ͳ/ŶĐŽŵƉĂƌŝƐŽŶƚŽWƌŽƚŽǇƉĞƐƵƌƉƌŝƐŝŶŐůǇ WƌŽƚŽƚǇƉĞƵŶĂŶŝŵŽƵƐůǇŽƵƚƐĐŽƌĞƐWƌŽƚŽƚǇƉĞŝŶ ĞǀĞƌǇĐĂƚĞŐŽƌǇ&ŝǀĞŽƵƚŽĨƐŝǆĐŚŽƐĞWƌŽƚŽƚǇƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůŝŶƚĞƌĨĂĐĞ^ŝǆŽƵƚŽĨ^ŝǆĐŚŽƐĞ WƌŽƚŽƚǇƉĞĂƐƚŚĞŵŽƐƚǀŝƐƵĂůůǇĂƉƉĞĂůŝŶŐ ͲhƐĞƌƐĚĞƐĐƌŝďĞĚƚŚĂƚWƌŽƚŽǇƉĞǁĂƐhŶŝƋƵĞŝŶĐŽŵƉĂƌŝƐŽŶƚŽWƌŽƚŽƚǇƉĞĂŶĚŽƚŚĞƌĞŵĂŝůƐ ƉƌŽŐƌĂŵƐ

ͲKŶůǇŽŶĞƵƐĞƌƉƌĞīĞƌĞĚWƌŽƚŽƚǇƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůů,ŝƐĞǆƉůĂŶĂƟŽŶǁĂƐƚŚĂƚŝŶĐŽŵƉůĞƚĞŝŶŐƚŚĞ ƚĂƐŬƐĨŽƌWƌŽƚŽƚǇƉĞŝƚǁĂƐƐŝŵŝůĂƌƚŽƚŚĂƚŽĨ'ŵĂŝůĂŶĚŝƚǁĂƐĞĂƐŝĞƌƚŽŶĂǀŝŐĂƚĞďĞĐĂƵƐĞŽĨƚŚŝƐ

Discussion & Conclusion - Implications for Future Interation Design

Results

ŽŵƉĂƌŝŶŐƚŚĞĚĂƚĂŽĨƚŚĞĞǀĂůƵĂƟŽŶƐƚƵĚǇ ŝƚǁĂƐƋƵŝƚĞĂƉƉĂƌĞŶƚƋƵĂŶƟƟǀĞůǇĂŶĚƋƵĂůŝƚĂƟǀĞůǇ ƚŚĂƚWƌŽƚŽƚǇƉĞǁĂƐǁŚĂƚƵƐĞƌƐŚĂĚƐĞĞŶĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶ

dŚĞĚĂƚĂƌĞǀĞĂůƐƚŚĂƚƚŚĞŵĂũŽƌŝƚǇŽĨƵƐĞƌƐĚŝĚĐŽŵƉůĞƚĞƚŚĞƚĂƐŬƐŝŶWƌŽƚŽƚǇƉĞĨĂƐƚĞƌƚŚĂŶŝŶdŚŝƐƌĞƐƵůƚǁĂƐĂďŝƚŽĨĂƐƵƌƉƌŝƐĞĐŽŶƐŝĚĞƌŝŶŐƚŚĞƵŶŝƋƵĞůĂǇŽƵƚĚĞƐŝŐŶŽĨWƌŽƚŽǇƉĞĂŶĚĚŽĞƐĐŽŶƚƌĂĚŝĐƚƐŽŶĞĚĞƐŝŐŶŚǇƉŽƚŚĞƐŝƐĨŽƌWƌŽƚŽƚǇƉĞdŚĞƐƚĂŶĚĂƌĚĨĂŵŝůŝĂƌůĂǇŽƵƚŽĨĚĞƐŝŐŶƉƌŽǀŝĚĞƐĂŵŽƌĞŶĂǀŝŐĂďůĞŝŶƚĞƌĨĂĐĞƚŚĂŶĚĞƐŝŐŶ KǀĞƌĂůůƟŵĞŽĨĐŽŵƉůĞƟŽŶĨŽƌWƌŽƚŽƚǇƉĞǁĂƐŶŽƚůŽŶŐŝŶĚƵƌĂƟŽŶƵƐĞƌƐũƵƐƚƉĞƌĨŽƌŵĞĚƚŚĞŐŝǀĞŶƚĂƐŬĨĂƐƚĞƌƵƐŝŶŐWƌŽƚŽƚǇƉĞ

dŚŝƐŵĂǇďĞĂƩƌŝďƵƚĞĚƚŽƐĞǀĞƌĂůĨĂĐƚŽƌƐKŶĞǁŚĞŶƐĞĂƌĐŚŝŶŐĨŽƌĂƐƉĞĐŝĮĐĞŵĂŝůƚŚĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞǀŝĞǁƉƌŽǀŝĚĞƐĂĨƌĂŵĞƚŚĂƚƵƐĞƌƐƵƐĞƚŽĐůĞĂƌůǇĚŝƐŶƟŶŐƵŝƐŚĞŵĂŝůƐďǇĚĂƚĞĐĂƚĞŐŽƌǇĂŶĚŶĂŵĞŽĨƐĞŶĚĞƌ ^ĞĐŽŶĚůǇŐŝǀĞŶϭϰŽĨǁŝŶĚŽǁƐƉĂĐĞƚŚĞůĂƌŐĞŝĐŽŶƐŝŶƚŚĞůĞŌĐŽůƵŵŶĂƌĞŵŽƌĞǀŝƐƵĂůůǇŽƌŐĂŶŝǌĞĚƚŚĂŶĂůŝƐƚŽĨŝĐŽŶƐ&ŽƌĞǆĂŵƉůĞǁŚĞŶŵŽǀŝŶŐƚŚĞĞŵĂŝůƐƚŽƚŚĞ,ŽŵĞǁŽƌŬĨŽůĚĞƌŝŶWƌŽƚŽƚǇƉĞƚŚĞĨŽůĚĞƌŝƐŵƵĐŚŵŽƌĞǀŝƐŝďůĞƚŽƚĂƌŐĞƚĂƐŝŶWƌŽƚŽƚǇƉĞ

EŽƚŽŶůǇĚŝĚƵƐĞƌƐƉĞƌĨŽƌŵĨĂƐƚĞƌƵƐŝŶŐWƌŽƚŽƚǇƉĞĂůůďƵƚŽŶĞƵƐĞƌĐŚŽƐĞWƌŽƚŽǇƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĂŶĚƐŝǆŽƵƚŽƵƚƐŝǆĐŚŽƐĞWƌŽƚŽƚǇƉĞĂƐƚŚĞŵŽƐƚǀŝƐƵĂůůǇĂƉƉĞĂůŝŶŐdŚĞƐĞƌĞƐƵůƚƐǁĞƌĞŶŽƚĂƐƵƌƉƌŝƐĞƚŽŽƵƌƚĞĂŵtĞĞǆƉĞĐƚĞĚƵƐĞƌƐƚŽƌĞƐƉŽŶĚĨĂǀŽƵƌĂďůǇďĞĐĂƵƐĞŝƚƉƌĞƐĞŶƚĞĚĂĚŝīĞƌĞŶƚĂƉƉƌŽĂĐŚƚŽĞŵĂŝůƐŝŶĐŽŶƚƌĂƐƚƚŽĂƐƚĂŶĚĂƌĚŝŶƚĞƌĨĂĐĞŝŵƉůĞŵĞŶƚĞĚďǇƚŚĞŵĂũŽƌŝƚǇŽĨĞŵĂŝůƉƌŽŐƌĂŵƐ

tĞĚŽƚĂŬĞŝŶƚŽĐŽŶƐŝĚĞƌĂƟŽŶƚŚĞĞŶǀŝƌŽŶŵĞŶƚŝŶǁŚŝĐŚƚŚĞƵƐĞƌƐƚƵĚǇǁĂƐĐŽŵƉůĞƚĞĚdŚĞĚŝƐĐƌĞƉĂŶĐǇŝŶƚŚĞĞŶǀŝƌŽŶŵĞŶƚƚŚĞƵƐĞƌĞƐŚĂĚĐŽŵƉůĞƚĞĚƚŚĞƐƚƵĚǇŵĂǇŚĂǀĞĂīĞĐƚĞĚƚŚĞƌĞƐƵůƚƐhƐĞƌƐǁŽƵůĚŶŽƌŵĂůůǇŶŽƚďĞƵƐŝŶŐĞŵĂŝůǁŝƚŚƐĞǀĞƌĂůŽƚŚĞƌƐƐƚĂŶĚŝŶŐĂƌŽƵŶĚŝŶŽďƐĞƌǀĂƟŽŶ/ĚĞĂůůǇ ĂůĂƌŐĞƌƐĂŵƉůĞƐŝǌĞǁŝůůƌĞŇĞĐƚĂŵŽƌĞĂĐĐƵƌĂƚĞĚĞƐĐƌŝƉƟŽŶŽĨŽƵƌĚĞƐŝŐŶƐ/ŶĨƵƌƚŚĞƌƐƚƵĚŝĞƐƚŚŝƐǁŝůůďĞĂƉƌŝŽƌŝƚǇŝŶŽƌĚĞƌƚŽƌĞƚƌŝĞǀĞƚŚĞŵŽƐƚĂĐĐƵƌĂƚĞƌĞƐƵůƚƐƉŽƐƐŝďůĞ

dŽĐŽŶĐůƵĚĞƚŚĞƌĞƐƵůƚƐŽĨƚŚĞĞǀĂůƵĂƟŽŶƐƚƵĚǇĞŵƉŚĂƐŝǌĞWƌŽƚŽƚǇƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶŝŶƚĞƌŵƐŽĨĚĞƐŝŐŶůĂǇŽƵƚĂŶĚĨƵŶĐƟŽŶĂůŝƚǇEŽƚŽŶůǇŝƐƚŚĞĚĞƐŝŐŶƵŶŝƋƵĞƉƌĞƐĞŶƚĞĚĂŵŽƌĞĞŶŐĂŐŝŶŐŝŶƚĞƌĨĂĐĞŝƚŽƵƚƉĞƌĨŽƌŵĞĚƚŚĞĨƵŶĐƟŽŶĂůŝƚǇŽĨWƌŽƚŽƚǇƉĞdŚƵƐŝƚŝƐŽƵƌĚĞƐŝĐŝŽŶƚŽĐŽŶƟŶƵĞĨƵƚƵƌĞŝƚĞƌĂƟŽŶƐŽŶWƌŽƚŽƚǇƉĞĂŶĚĮŶĚĂƌĞĂƐŝŶǁŚŝĐŚŽƵƌƚĞĂŵĐĂŶŝŵƉƌŽǀĞ

yahoo mail fail – an interactive approach to designhkhaki/hci-research/iat201_yahoomail.pdf ·...

Documents