goalconnection -...

GoalConnectionFinal PresentationGroup 4: Sandra Chadwell, Michael DeAngelis, Colleen Gunn,Guirlaine Palmer & Chris Wren

Where We Left Off

Audience○ College students

App Iterations○ FrakenApp○ myGoals○ Goal Connection v2

Instructional Model○ Community of Practice

Where We Left Off:App Map

Where We Left Off:GoalConnection v3

Proposed Updates and User Research Goals

Clarify○ Purpose○ Functionalities

Round 1: App Interface and Features○ Features○ Look and feel○ Images and icons

Round 2: User Interactivity○ Engagement○ Usability○ Ease of use

User Research Testing

Round 1: App Interface and Features

Round 1:Research Design Questions

1. Based on the name and overall design of the app, is the purpose of the learning environment self-evident?

2. Do(es) the terminology and/or labels provide users with a clear sense of the app's features?

3. Do the icons provide an intuitive representation of how to navigate through the app?

Round 1:Participant Selection

Pilot Testers● 5 subjects

Data Collection Subjects● 18 family members,

friends, & students

Sample Population● "First Ten" Rule

A convenient sample, with considerable attempts to maintain a gender-balanced population...

Round 1:Methods

Qualitative:

Moderated UI Interviews● The HOW of user

behavior● The WHY of user

behavior

Quantitative

User Surveys● User Demographics● User-base● Product/Services● App features and icons● Instructional design

Round 1:Testing Tools

Centralized access to usability tools: www.goalconnection.net

Round 1:Moderate UI Interviews

Round 1:Moderate UI Interviews

Round 1:Moderate UI Interviews

Round 1:User Surveys

Round 1:User Interface Test Results

Identify Common Themes

User Research Testing, Round 1: Analysis and Findings

Participant Age:● 80% 19-30● 10% 56-65● 10% 66+

Gender:● 50% Male● 50% Female

*10 participants responses were reviewed

Device Ownership:● 60% iPhone● 50% Android● 30% iPad● 10% Blackberry

Commonly Used Apps:● Email/Text Notifications● Calendar● Alerts/Reminders● Labels/Lists● Calculators

User Research Testing, Round 1: Analysis and Findings

User Research Testing, Round 1: Analysis and Findings

Color Responses

● “I don't like the pink and the green”● “Nice, complimentary colors”● “more contrast in colors”● “colors are weird; they remind me of

Christmas”● “The green is a little too loud”

Font Responses

● “Font could be a little bigger, but it's okay”● “font on the titles are small for me”● “font on the bottom is small”● “could be a little small for people with sight

impairments”

User Research Testing, Round 1: Analysis and Findings

Boost Responses

● “don't know what Goal and Boost mean”● “I don't get the boost”● “Not sure what a boost is”● “Boost… like the intensity of the goal?”● “boost+ sounds like an energy drink”● “boost is like getting a tip”● “I still don't get what a boost is…”

Boost/Goal Screen responses

● “a lot of information but well organized”● “there's a lot going on”● “like the large image on screen”● “too much information”

User Research Testing, Round 1: Analysis and Findings

Goal Thumbnail Responses

● “I don't know if I get the icons under the pictures; I'd rather click into the "balanced

● meals" then decide what options I want to choose from there.”

● “font on the titles are small for me (for each square)”

● “are the icons in the box going to be interactive or do you click into the square first?”

● “there's too many buttons (pointing to the options in the square)”

User Research Testing, Round 1: Analysis and Findings

Round 1 Testing After Revisions

App Recommendations:Overall Design & Color Changes

Round 1 Testing After Revisions

App Recommendations: Goal, Accomplishment & Inspiration Screens

Round 1 Testing After Revisions

App Recommendations: Clarify Boost Feature

Round 1 Testing After Revisions

App Recommendations: Simplify Goal Thumbnails

Round 1 Testing After Revisions

App Recommendations: Consolidate Menus

Moving Forward:Round 2 Testing Recommendations

● Focus Groups

● Virtual Usability Testing Interviews

● Shorter Interviews & Surveys

● Vary Content in Application/Goals

User Research Testing

Round 2: User Interactivity

Round 2 Testing Goals

Our round 2 research focused on the app's ease of use, specifically on the difficulty of accomplishing the app's essential tasks:

● Create a goal, inspiration and accomplishment● Follow another user● Grab another user's goal● High-five another user's goal

Round 2:Participant Selection

Pilot Testers● 5 team members

Data Collection Subjects● 37 Original Participants● 25 completed 1/2● 13 completed whole test

Delivery Method● Email Invite● Online Asynchronous

Test

Convenience Sampling: Needed to have follow-up possibility with participants

Access to computer or mobile device with internet access

Round 2:Method Selection

Round 2 was initially planned as a Focus Group. However, the team ultimately conducted online usability testing for the following reasons:

1. Time constraints of the team members to conduct a focus group

2. Needed individualized results vs. group results3. Uniform testing procedure, so all participants had the

same experience4. Removed bias from administrators5. Chance to experiment with some cool new tools!

FluidUI● HTML5 - Platform independent● Ease of use - Drag and Drop● Limited Screens per wireframe

Invision● Wraps actual application● Developer comments inline

Solidify● Prompts in Wireframe● Good Data Collection● Limited Types of Tests

Round 2: Finding The Right Testing Tool

Verify: Wireframing/Testing Tool

Our team chose Verify www.verifyapp.com

● The "Big Brother" to Solidify.

● Our team was happy with Solidify and assumed this wireframing tool would have all features we needed.

● We performed a few sample tests and agreed it was the best tool to use.

● The shortcomings of this tool were discovered later when we built our round 2 wireframes.

Round 2 Analysis of the Testing Instrument

Pluses● Online ease of delivery method

● Variety of test types available

● Results gathered automatically

● Integrated Prompts within wireframe

● Wireframe published to IOS, Android and Mac/PC

Minuses● Click intent NOT clear

● Stringing tests together was clunky

● Marrying demographic data to each test was difficult

● Technical problems prevented test completion for some

Try it for yourself: www.goalconnection.net

Round 2: Participant Demographics*

Age (in years) Gender

*Attempted the test

30-39 (40%)

25-29 (25%)

40-54 (15%)

12-24 (12%)

55-65 (8%)

Male (45%) Female (55%)

Round 2: User Testing - Results

Question: Where would you click to view your profile?

Answer: "Gear" menu in top left corner● 0 of 15 responses recorded

as a success● Majority selected silhouette

icon

Round 2: User Testing - Results

Question: How does [the profile] screen make you feel?

● 27% - Happy● 60% - Indifferent● 13% - Frustrated

Sample Responses:"Looks legit""What do these pictures mean?""Is this wasted space?""Maybe some type of label"

Round 2 User Testing - Results

Directions: Select the option that will show you who you are following.

Answer: "X Following" button

19 of 25 responses recorded as a success

Round 2:User Testing - Results

Question: What steps would you take to create a goal to learn to knit?

Answer: "+" button

13 of 18 responses recorded as a success

Round 2:User Testing - Results

Directions: Select the appropriate menu item to create a knitting goal.

Answer: Create a Goal

12 of 13 responses recorded as a success

Round 2:Resolutions to Takeaways

Observation of Issues

O1. Selected usability tool lacked functionality to allow for continuity of test activities (i.e. Verify):● "Leave test to continue" - ???● Instructions were not always

available on screen● aspect ratio -> errant responses

O2. Icons and language in the test were confusing to match-up.

Corrective Action

C1.Consider tools with more robust features to enhance tester experience, for example:

● strategic use of SolidifyApp● others...?

C2. Include annotated text at the bottom of the main navigation icons.

Round 2:Resolutions to Takeaways

Observation of Issues

O3. Goal Explorer is located is the Profile menu, apart from icon, designed to create custom goals, inspirations, & accomplishments.

O4. Incomplete process to create inspiration and accomplishment.

O5. Testing results did not provide the WHY of user behavior.

Corrective Action

C3. Relocate Goal Explorer to be grouped with the "creation" functionality in the icon.

O4. Add a "Create" button to both pages to clarify the task is complete.

C5. Consider audio recording user commentary to collect more open-ended feedback within the test environment.

Final Prototype

To access the prototype go to: www.goalconnection.net

Moving Forward

How can we make GoalConnection a more effective instructional tool?

Trending / Popular Goals

Points System● Goal Category Experts● Accomplishment / Goal Badges

Share Accomplishments w/ Social Networks

Group Goals

Lessons Learned - Process

What went right?

1. Online meetings 2. Ruled out AR early3. Technology savvy 4. Flexibility and capability

of team 5. Good, consistent

documentation6. Awesome website hub

for tests

What went wrong?

1. Original learning problem had no sizzle

2. Wireframing tool problem

3. Establishing goals earlier

4. Wrangling testers

Questions?