Milestone 3 - CloudDesignerValue Tested Prototype

Collin AycockNick DozierAlice LeungMatt Craig

October 28, 2015

Overview

How did you conduct your tests?

Users were introduced to the application by receiving an explanation of what the app is used for and its functional goals. Similar to a usability test, the users were given a goal to accomplish and we used predetermined metrics to measure and analyze the results. In this case, the user was asked to choose a project and write a review about it, starting from the homepage. The users were accompanied by a member of the team who would pay attention to measurable actions such as the number of errors made and clicking on the correct pathway via link or picture.

Who did you recruit?

Engineers, Designers and Architects. People who we thought would most benefit from this

application.

What were the goals of this test?

To determine the value of the app, if the intended objective was easy to accomplish and the

navigation was clear.

Test Plan

Introduction

Explain the app to the user and what the goals are of this test

Demo

Walk the user through the app

Allow them to click around and explore/interact with the prototype

Questions

What are your thoughts about the app?

What did you find useful?

What did you find confusing?

Would you use this app in real life?

Would this app help you gain valuable feedback about your designs?

Is this app useful to learning about your design’s effectiveness?

What do you think could be added to the website to make the review process easier?

Test Plan (cont.)

Participant Information

Age

Occupation

Websites they go to for reviewing products.

Metrics

Was the user able to complete the task? (Success/Failure)

Difficulty Ratings (Scale from 1 - very easy to 5 - very difficult)

Number of errors

Type of errors

Findings

What did you learn about your users?

Some users need a high fidelity prototype to understand what they’re clicking in.

All of the users except for one would use this app in real life.

7 out of 7 users gave the app a high rating (average of 4.14 from a scale of [1 - not useful] to [5 - very useful]) in terms of usefulness.

We cannot make the assumption that the user will be better at navigating the site due to his/her technical background.

Findings (cont.)

Metrics Based Results

All users were able to successfully complete the task.The difficulty ranged from 1 to 3 with an average of 2.33, on a scale from 1 [very easy] to 5 [very

difficult].The number of errors ranged from 1 to 3.The majority of errors were related to navigation.

What did you learn about your prototype?

This first prototype had a lot of ambiguity, and a lot of the names/labels are not clear to users.

The “project review page” needs to be redesigned in a way that makes it easier for the user to

know what to do: The button label needs to be more concise, the page needs to help the user

to better understand how to switch between project pages.

The navigation needs to be clear to users.

Users might be better served having a search function instead of a filter system.

Next Steps

Based on your findings, what will you address in your next iteration?

The Project Review Page needs to be more concise.

We need to add a search option for project types.

The navigation needs to be more organized and clear.

We need to find a way to help the user differentiate whether they are in Review “mode” or Designer “mode”. Some users had a hard time figuring out at what point they were in the position to review or not.

Getting in Character

User:

I am a designer/engineer looking to help others improve their design while I

receive the same benefit from them.

Scenario:

You are a designer that wants to help other designers improve their work. As such,

you decide to use CloudDesigner as a gateway. All you have to do is pick a project

to review...

Value Tested PrototypeAxShare Link:

http://9odr0c.axshare.com/#c=2

Added login/logout functionality.

Different versions of the navigation bar are displayed based on login state.

Added error messages to the login form.

When user adds feedback, their comment is now displayed at the top of the list.

Added “success/error” message to that form.

Added a “Review” button under each project, so the user better understands how

to get there.

Removed extra pages that were confusing the user.