developing and evaluating a personal task analysis … · evaluating a personal task analysis app...

36
DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng Master’s in Learning Design and Technology ptayng.app.appery.io

Upload: others

Post on 26-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

DEVELOPING AND EVALUATING A PERSONAL

TASK ANALYSIS APPUniversity of Hawai`i at Mānoa

Elon Ng

Master’s in Learning Design and Technology

ptayng.app.appery.io

Page 2: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

DEVELOPING AND EVALUATING A PERSONAL

TASK ANALYSIS APPUniversity of Hawai`i at Mānoa

Elon Ng

Master’s in Learning Design and Technology

ptayng.app.appery.io

Page 3: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Quick Survey!

How many apps do you have on your phone?

A. 0-5

B. 6-10

C. 11-15

D. I have an app to count all my apps (too many)!

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 4: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Quick Survey!

How many of those apps would you say are “self-

help” or “productive?”

A. 1-4

B. 5-8

C. 8+

D. Candy Crush is pretty productive (none)!

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 5: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Problem

■ Technology has exploded over the previous decade – seemingly making our lives

more convenient

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 6: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Problem

■ Technology has exploded over the previous decade – seemingly making our lives

more convenient

■ Interest in digitalizing an in-class activity for a graduate class

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 7: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Problem

■ Technology has exploded over the previous decade – seemingly making our lives

more convenient

■ Interest in digitalizing an in-class activity for a graduate class

■ Personal motivations

to develop and

evaluate an app

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 8: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Purpose

The purpose of this usability project was to develop

and evaluate the ease of use for a gamified app of a

personal task analysis from an activity in a graduate

course used at a university on the island of O`ahu.

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 9: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

The In-Class Activity

Maslow, A. H. (1943). A theory of human motivation. Psychological review,50(4), 370.

=

Personal

Professional

Student

Life

Page 10: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

=

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

The In-Class Activity

Maslow, A. H. (1943). A theory of human motivation. Psychological review,50(4), 370.

Personal

Professional

Student

Life

Page 11: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Paper Prototype

First Iteration

Second Iteration

Future Iterations

Design Process

First

Round of

Testing

Second

Round of

Testing

Materials

Developed

Page 12: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Paper Prototype Ideas

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 13: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Choosing a Platform

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 14: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

First Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 15: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

First Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 16: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

First Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 17: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

First Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 18: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Second Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 19: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Second Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 20: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Second Iteration

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 21: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Implementation

■ Usability Protocol

■ 6 Participants, two

rounds of 3

participants each

■ Pre-Test and Post-

Test

■ Given four tasks to

perform

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 22: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Implementation

■ Recording Using

FlashBack Express

■ Free software that

lets you see user

input

■ Sound Recording and

Screen Capture with

no watermark!

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 23: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Participants

■ Recruitment Email Sent

■ Six Participants

■ 2 Male, 4 Female

■ 25-54 years old

■ 4 Master’s Students,

2 Doctorate Students

■ Most did look at their

weekly schedule

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 24: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Pre Test Results

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

• Sample apps include –

• Social Media programs (Instagram, Facebook, Twitter)

• Organizational Apps (Calendar, Mail, Scheduler)

• Activity Apps (Nike+, Runtastic, Bus Schedule)

Page 25: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

During the Study – Round 1

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Task 1 – Average 4 clicks

Task 2 – Average 3 clicks

Task 3 – Average 2 clicks

Task 4 – Average 2 clicks

Page 26: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

During the Study – Round 1

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Participant 1 Participant 3

Page 27: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

During the Study – Round 2

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Task 1 – Average 3 clicks

Task 2 – Average 2 clicks

Task 3 – Average 1 clicks

Task 4 – Average 1 clicks

Page 28: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

During the Study – Round 1

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Participant 4 Participant 5

Page 29: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Post Test Results

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

1 2 3 4 5

Labels for buttons or pages are clear and concise.

I can use the app without instructions.

The app is user-friendly.

Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree

Round 1 Testing Post-Study Survey

Participant 1 Participant 2 Participant 3

Page 30: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Post Test Results

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

1 2 3 4 5

Labels for buttons or pages are clear and concise.

I can use the app without instructions.

The app is user-friendly.

Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree

Round 1 Testing Post-Study Survey

Participant 1 Participant 2 Participant 3

1 2 3 4 5

Labels for buttons or pages are clear and concise.

I can use the app without instructions.

The app is user-friendly.

Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree

Round 2 Testing Post-Study Survey

Participant 4 Participant 5 Participant 6

Page 31: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Written Results (Round 1 Post-Test)

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 32: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Written Results (Round 2 Post-Test)

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 33: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Findings (discussion)

■ Second Iteration an improvement– Improved visuals– Less confusion on Home page– Higher post-test results (more

satisfaction overall)

■ Further iterations incorporating feedback continues to improve the app

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 34: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Conclusion (Reflections)

■ Limitations

– Time and Resources

– Settling on a Platform

– Gamification might better be

reserved for another type of app

■ Usability Study Protocol

■ Technical Skills

– Javascript

■ Conducting a Usability Study

INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION

Page 35: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Questions?

Page 36: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have

Thank you for Listening!

A HUGE thank you hug to:

■ My advisor, Dr. Catherine Fulford

■ LTEC Ohana -- Faculty and Staff

■ Critical Friends

■ My Cohort

■ Good Friends at UH

■ Tea