milestone 6 pptx-- usability testing & final prototype

Final Project - CloudDesignerUsability Testing & Final Prototype

Collin AycockNick DozierAlice LeungMatt Craig

November 19, 2015

Usability TestingTest Plan

Test Goals

Our test goals are to have users perform a task for clicking through the review path, and

determine if there are any further navigational errors or confusion of labels/language.

We would also like to get feedback on the visual design of CloudDesigner to see if the

majority of the participants like the color scheme/font, etc.

Methods

Our usability tests will be conducted in person using the appropriate device. The tester will

administer the test following our script and record the results into a shared spreadsheet.

When necessary, a user can be tested remotely using Google Hangouts.

Description of Target Participants

Stakeholders who use review system/websites to make a decision to purchase, get

feedback for their own designs and inspiration.

Usability TestingTest Plan (cont.)

Test Script

Introduction

Hi, my name is ______. Thank you for agreeing to take part in our usability evaluation.

During the rest of the session, I will be working from a script to ensure that my

instructions to everyone who participates in the study are the same. I will ask you to

use CloudDesigner to perform the task.

Task Prompts

I would like you to pretend that you are a Product Owner who needs to approve a new

design for the company website. Your goal is to find that design on the

CloudDesigner site, view it, and leave feedback either approving or suggesting

changes to the design. You can consider the task complete, once you have left

appropriate feedback on this design.

Usability TestingTest Plan (cont.)

Test Script (cont.)

Post-task Questions

From a scale from 1 to 5 (1-very easy to 5-very difficult), how easy was this task to complete?

Was there anything confusing about the task?

Was their anything enjoyable or especially notable about completing the task?

Was their any language or labels that you had a difficult time understanding?

What was your favorite thing about the app?

What was your least favorite thing about the app?

What improvements would you suggest be added to this app?

Would you find this app useful in real life?

Usability TestingTest Findings - Participant #1

● Moderator: Nick

● Device: Mobile

● Test Subject Info

○ Name: Brandon

○ Demographics: Male, 31 years of age, Engineer (Sports Equipment)

○ Characteristics: Loves to go on Amazon to buy and leave feedback on products.

● Why they fit as our target audience○ He is an engineer who enjoys browsing through different designers/engineers’ projects to get inspiration.

● Where they struggled○ He had difficulty leaving a comment on a mobile device (iPhone5).

● Feedback from post-task and post-test sessions○ Positive: Easy to use○ Negative: Did not like the color, too black and white, needs more “design” to make it look

professional/trustworthy.


● Moderator: Nick

● Device: Desktop


○ Name: Layla

○ Demographics: Female, 40 years of age, Technical Writer

○ Characteristics: Layla goes on Yelp to search for restaurants before going for dinner. She sometimes would write reviews on restaurants to let others know the quality of the food.

● Why they fit as our target audience○ She browses through restaurants nearby before she picks a place to eat dinner with friends.

● Where they struggled○ Stars didn’t work on rating when she tried to rate the project.

● Feedback from post-task and post-test sessions○ Positive: Login was quick and easy. She likes the “Welcome username” text.○ Negative: Login was not easy to see/find.


● Moderator: Nick


○ Name: Trevor

○ Demographics: Male, 35 years of age, Visual Designer

○ Characteristics: Trevor loves to use Glassdoor to search for company reviews before he interviews at a firm.

● Why they fit as our target audience○ Because he browses through reviews on companies, he is a good target audience for this crowdsourcing

review system.

● Where they struggled○ Stars didn’t work; it would be helpful if they took my ratings.

● Feedback from post-task and post-test sessions○ Positive: Ease of use.○ Negative: The ratings might influence other commenters, maybe hide overall rating until they leave

feedback. Add some gamification to encourage designers to use. Show them their ratings relative to other designers.


Moderator: Collin

Device: Mobile

Test Subject Info:

Name: Steven

Demographics: Male, 28 years of age, Electrical Engineer

Characteristics: Enjoys eccentric music and thought problems

Why they fit as our target audienceHe is an electrical engineer who enjoys looking through other designers’ projects to get inspiration for his

medical device projects.

Where they struggledNone

Feedback from post-task and post-test sessionsPositive: Useful conceptNegative: Need a way to rate/rank reviewers based on usefulness of comments


Moderator: Collin

Device: Tablet

Test Subject Info:

Name: Steve

Demographics: Male, 29 years of age, Biomedical Engineer

Characteristics: Enjoys online shopping.

Why they fit as our target audienceHe is an Biomedical engineer who browse through reviews to find good designers to hire for his company.

Where they struggledN/A

Feedback from post-task and post-test sessionsPositive: Good design flowNegative: Need a way to rate/rank reviewers based on usefulness of comments.


Moderator: Collin

Device: Desktop

Test Subject Info:

Name: Heather

Demographics: Female, 26 years of age, Nuclear Engineer

Characteristics: Enjoy the engineering design process

Why they fit as our target audienceEven though she’s a Nuclear Engineer, her passion is to design beautiful websites for people to use. So she

looks through other peoples’ projects to get ideas.

Where they struggledShe tried to use search, but found it frustrating she couldn’t use them.

Feedback from post-task and post-test sessionsPositive: Thought that the feedback loop was useful. The color palette was nice and professional.Negative: Non-working search function


Moderator: Alice

Device: Desktop

Test Subject Info:

Name: Bob

Demographics: Male, 45 years of age, Machinist

Characteristics: He is very organize and loves to read reviews before buying parts to machine.

Why they fit as our target audienceEven though he is a machinist and not a designer, he oftens would read reviews of components before buying

parts to make sure he has good parts to machine prototypes.

Where they struggledWhen pressed the “Enter” key, it didn’t submit the comment.

Feedback from post-task and post-test sessionsPositive: It was easy and user-friendly; looks like it doesn’t have too many things to navigate through.Negative: Rating systems need to be more interactive.


Moderator: Alice

Device: Mobile

Test Subject Info:

Name: Jeff

Demographics: Male, 45 years of age, Engineer

Characteristics: He oftens goes on Grainger to read reviews on equipment before he buys.

Why they fit as our target audienceHe loves the the selections on Grainger website, and likes to leave comments to let people know that the

equipment are good or bad to use.

Where they struggledIt was not clear to him that the prototype design was clickable or not, and there were no stars for him to click,

so he couldn’t rate it.

Feedback from post-task and post-test sessionsPositive: It was straight-forward, simple, and easy-to-use.Negative: No ratings, the comment was not on top after submitting feedback.


Moderator: Alice

Device: Desktop

Test Subject Info:

Name: Clay

Demographics: Male, 25 years of age, Visual Designer

Characteristics: He is a designer who works at Facebook News Feed team.

Why they fit as our target audienceSince he is a designer, he always goes on projects website to look at other peoples’ designs for inspiration.

Where they struggledInitially he thought that he had been given the wrong link since the site read more as a public website review

page rather than a site to give internal feedback on a new app design.

Feedback from post-task and post-test sessionsPositive: Liked the ease of submitting a review, it was nice that it only took 5 steps.Negative: The starring system didn’t make much sense; he didn’t understand the need to give it a set of stars

when he’s giving feedback on what does and doesnt’ work.


Moderator: Collin

Device: Desktop

Test Subject Info:

Name: Molly

Demographics: Female, 25 years of age, UX Designer

Characteristics: Tends to be very critical of UIs

Why they fit as our target audienceShe is a designer who always looks through reviews of other peoples’ feedback in order to make her designs

better.


Feedback from post-task and post-test sessionsPositive: Straight-forward; would like to see this working as a real website someday.Negative: Static UI Elements


Moderator: Collin

Device: Tablet

Test Subject Info:

Name: Jon

Demographics: Male 27 years of age, Electrical Engineer

Characteristics: Tends to be hyper focused on details

Why they fit as our target audienceHe is an Electrical Engineer who loves to read reviews on Angie’s List to make sure he finds the best

contractor to fix his house.

Where they struggledFound it hard to find the login button.

Feedback from post-task and post-test sessionsPositive: Likes the idea that his opinions matterNegative: Make the login easier to find


Moderator: Collin

Device: Mobile

Test Subject Info:

Name: Cynthia

Demographics: Female 26 years of age, Biomedical Engineer

Characteristics: Buys online frequently (amazon, woot, ebay)

Why they fit as our target audienceShe loves fashion and goes on Amazon for all the reviews before she buys any pieces of clothing.


Feedback from post-task and post-test sessionsPositive: Sense of community; allows her the ability to directly share her ratings with other users.Negative: No stars to click, couldn’t rate. Color Palette


Moderator: Matt

Device: Desktop

Test Subject Info:

Name: Jamie K.

Demographics: Female, Software Developer

Characteristics: Experience working with different professions (i.e. UX Designers, PM’s, etc.)

Why they fit as our target audienceUnderstands how to navigate through an app and knows what is realistically able to be developed.

Understands the testing process

Where they struggledFinding the login

Feedback from post-task and post-test sessionsPositive: Clicking through prototype, commenting was realisticNegative: Had a hard time with login (when to login)


Moderator: Matt

Device: Mobile

Test Subject Info:

Name: Mike B

Demographics: Entrepreneur of Apps and PM, Male

Characteristics: Has managed the building of multiple apps in iTunes store some succeeded some failed

Why they fit as our target audienceHe has experience with all facets of the software development process. Knows what has succeeded in the

past.

Where they struggledWasn’t sure if he was supposed to click “search projects” on the first page and what to search for

Feedback from post-task and post-test sessionsPositive: Ease of use, simplicity of App, commenting was realistic and funNegative: N/A


Moderator: Matt

Device: Tablet

Test Subject Info:

Name: John M.

Demographics: UX Designer, Male

Characteristics: Is a UX Designer for a company in Chicago.

Why they fit as our target audienceBeing a UX Designer, John understands the process and knows what to look for

Where they struggledCould not click thumbnail to pick project, had to click the “review” link

Feedback from post-task and post-test sessionsPositive: It’s overall possible use.Negative: Could not see multiple views of the app he was reviewing

Usability TestingAnalysis

Themes/Challenges (aka biggest things to fix)

The biggest challenge was to make the starring system functional in Axure. Many participants were having trouble rating the design due to the non-interactivity of the stars.

Another challenge was to show participants that the design they are reviewing are clickable prototypes. This is a prototype within a prototype. Axure has a lot of limitations in terms of making designs interactive.

Login was also difficult for participants to see, and difficult for participants to understand the logged-in state vs. the non-logged-in state.

Thumbnail on homepage is not clickable. The user has to select the “review” link instead.

Usability TestingRecommendations

What must change to make prototype/app better?

If logged in, the username should appear on the review form; user will not have to re-type their name.

Make the star ratings functional on the review form.

Change the comment avatar to a more generic / gender-neutral one.

Make the entire thumbnail for the prototype being reviewed clickable on the selection page.

Final PrototypeOur AxShare Link

http://5acdzw.axshare.com/#c=2

http://5acdzw.axshare.com/#c=2