development and usability testing of the operating manual

22
Development and Usability Testing of the Operating Manual for BraidMagic™ H. You , R. Young , D. Zimmerman , C. Ekrut , A. Kumar , and M. W. Lee Dept. of Industrial & Manufacturing Engineering Wichita State University Dept. of Industrial Engineering Seoul National University

Upload: others

Post on 28-Feb-2022

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development and Usability Testing of the Operating Manual

Development and Usability Testing ofthe Operating Manual for BraidMagic™

H. You†, R. Young†, D. Zimmerman†,C. Ekrut†, A. Kumar†, and M. W. Lee‡

†Dept. of Industrial & Manufacturing EngineeringWichita State University

‡Dept. of Industrial EngineeringSeoul National University

Page 2: Development and Usability Testing of the Operating Manual

Agenda Introduction BraidMagic? Objectives

Operating Manual Development

Usability Testing

Analysis & Results

Discussion

Conclusions

Page 3: Development and Usability Testing of the Operating Manual

What is BraidMagic™?

Braiding with BraidMagic

A high-fashion style created with BraidMagic

Page 4: Development and Usability Testing of the Operating Manual

Operating Manual Development

Literature Analysis

Hierarchy of Contents Development

Format and Layout Design

Manual Development

Paper Manuals

Guidelines of Safety/Warranty

On-line Manuals

Parts Naming

Photo Editing

Task Analysis

Page 5: Development and Usability Testing of the Operating Manual

Manual Structure

1. Safeguards2. Parts and Specifications3. Operating Instructions4. Maintenance5. Warranty and Service

Page 6: Development and Usability Testing of the Operating Manual

Manual Features (selected)

Step-by-step instructions along with pictures

Structured information

Tools for easy location of information

Page 7: Development and Usability Testing of the Operating Manual

User-friendly Instructions

Step-by-step instructions in plain language for the target user population (high school diploma or GED) with helpful pictures.

Page 8: Development and Usability Testing of the Operating Manual

Structured Information

Warnings, cautions, and notes were added to prevent any accidental misuse or handling of BraidMagic.

Page 9: Development and Usability Testing of the Operating Manual

Information Locating Tools

Table of Contents was provided with page numbers to allow for quick reference to information.

Reference tabs were provided on corresponding pages.

Page 10: Development and Usability Testing of the Operating Manual

Usability Testing - Participants

5 cosmetology students

All females

Age: 18-25 years

Cosmetology training: 60 to 700 hrs.

Page 11: Development and Usability Testing of the Operating Manual

Test Design1. Pre-Test Session

2. Test Session

3. Post-test Session

Orientation ScriptConsent FormsBackground Questionnaire

Locate InformationUnderstand SafeguardsIdentify and Learn Parts and SpecificationsFollow Operating InstructionsFollow Maintenance InstructionsUnderstand Warranty ConditionsUse Service Cards

Debriefing

Page 12: Development and Usability Testing of the Operating Manual

Measure/Instrument Matrix (selected)

Measures Locate Information

Safeguards Instrument/Scale

Perfor-mance

Completion Time

Stop watch

% Correct Answers

T/F, Matching, Multiple-choice

Prefer-ence

Usefulness Questionnairewith Likert ScalesEase of Use

Learnability

Accessibility

Clarity

Conciseness

Accuracy

Satisfaction

Page 13: Development and Usability Testing of the Operating Manual

Parts Name Matching (illustrated)

Matching questions for parts name identification

Page 14: Development and Usability Testing of the Operating Manual

Assessment Questions (illustrated)

Questions Very Poor Poor Fair Good Very

GoodHow useful is it for information search?

How easy is it to use?

How easy is it to learn?

How explicit is the organization?

How clear is the terminology?

Questions Very Dissatisfied Dissatisfied Somewhat

Satisfied Satisfied Very Satisfied

What is your overall satisfaction?

Page 15: Development and Usability Testing of the Operating Manual

Assessment Results - Overall

Section Average S.D.Table of Contents 4.7 0.5Safeguards 4.9 0.2Parts & Specifications 4.7 0.6Operating Instructions 4.5 0.7Maintenance Instructions 4.4 0.6Warranty Conditions 4.9 0.3Service Cards 4.7 0.3

Page 16: Development and Usability Testing of the Operating Manual

Manual Revision Based on the suggestions and assessment results

of the usability testing, 6 recommendations were developed and revisions were made accordingly.

1. Provide a subsection listing and page numbers in the Table of Contents.

Page 17: Development and Usability Testing of the Operating Manual

Recommendations (continued)

2. Provide additional details for machine malfunctioning and moisture content of hair in Safeguards.

3. Rename two parts (hair grip and hair inserter) for better intuitive identification and learnability in Parts and Specifications.

Page 18: Development and Usability Testing of the Operating Manual

Recommendations (continued)

4. Enlarge the images in Operating Instructions and Maintenance.

5. Align the instructions and images and include action symbols in the images.

Page 19: Development and Usability Testing of the Operating Manual

Recommendations (continued)

6. Enlarge the boxes and provide two types of service card (one with lines and one with boxes for address).

Page 20: Development and Usability Testing of the Operating Manual

Discussion

Usability testing is a critical design component for user-centered design.

Use of various performance/preference measures, observations, and open suggestions in the testing facilitated the identification of potential usability problems of the design.

Page 21: Development and Usability Testing of the Operating Manual

Acknowledgements

We acknowledge HiBraid Inc. in Seoul, Korea, John Jewell, Pat Radford, and cosmetology students of Olde Town Barber & Beauty College at Wichita, KS for their support and time in this study.

Page 22: Development and Usability Testing of the Operating Manual

Q & A

Thank you for your attention!