![Page 1: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/1.jpg)
IBIS-PH (Indicator-Based Information System for Public
Health) Usability: Fall 2009
Sam Vanous Ph.D. HMO Health Program Manager
Utah Department of HealthOffice of Health Care Statistics
![Page 2: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/2.jpg)
Why?
• Supposing is good, but finding out is better.
- Samuel Clemens
• Know thy user, and you are not thy user.- Arnie Lund
• The most common user action on a Web site is to flee.
- Edward Tufte
![Page 3: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/3.jpg)
Early Examples
• 1963: The first mouse was usability tested
• 1981: XEROX usability tested (PARC)
• 1984: It took clients over an hour to install and print a check with Quicken– Took it to the street
• 1987 a usability lab was created for Windows 2.0
![Page 4: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/4.jpg)
Usability Testing
• What exactly is Usability Testing?– Representative users try to accomplish typical
tasks with the product, while staff watch, listen, and take notes.
• Very important: the product is being tested and not the users
• Usability testing allows designers to create products that are functional and intuitive for the users.
![Page 5: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/5.jpg)
Usability Testing
• Why Usability Test?– Identify any usability problems– Collect data on participant’s performance– Determine participant’s satisfaction
• When should it be done?– Early and often
• Prototype Test Analyze• Repeat as often as needed
![Page 6: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/6.jpg)
Methods
• 20 Participants– Users
• 11 light users• 6 medium users• 3 heavy users
– Recruitment• 16 users from UDOH• 4 users with no experience
![Page 7: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/7.jpg)
Methods
• Script– Welcome– Computer/IBIS experience questions– Scenarios– Follow-up questions
![Page 8: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/8.jpg)
Results
• Completion time
• Help (scenario 1)
• Publications (scenario 2)
• Home Page (scenario 3 - not discussed)
• Indicators (scenarios 4, 5, and 6)
• Query (scenario 7)
![Page 9: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/9.jpg)
Completion Time: UDOH
Average Time for Participants to Complete Scenarios:Set 1 (Health Department Employees)
1.61.3
1.7
2.72.3
4.9
0.0
1.0
2.0
3.0
4.0
5.0
6.0
Scena
rio 1
: Help
Scena
rio 2
: Cur
rent
Issu
e
Scena
rio 4
: Diab
etes
Scena
rio 5
: Uta
hns S
mok
e
Scena
rio 6
: Sec
ond
Hand
Smok
e
Scena
rio 7
:YRBS
Minutes
Average Time
![Page 10: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/10.jpg)
Completion Time: Non-UDOH
Average Time for Participants to Complete Scenarios: Set 1 (Non-Health Department Employees)
2.5 3.25
5.5 5.75
9.25
19
02
468
10
121416
1820
Scena
rio 1
: Help
Scena
rio 2
: Cur
rent
Issu
e
Scena
rio 4
: Diab
etes
Scena
rio 5
: Uta
hns S
mok
e
Scena
rio 6
: Sec
ond
Hand
Smok
e
Scena
rio 7
:YRBS
Minutes
Average Time
![Page 11: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/11.jpg)
Scenario 1: Help
• Varied responses and navigation– Contents and Usage, About IBIS, Links, Help,
and Contact
• Text driven and overwhelming
• Suggestions: – First time user button with consolidated
information (contents, usage, and tutorials)
![Page 12: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/12.jpg)
Home Page
![Page 13: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/13.jpg)
Scenario 2: Publications
• Many users clicked News and Updates tab • Light users had most difficulty• When Publications tab chosen, task still was
difficult. • Search function: not as expected.• Suggestions: Organize Publications as well as
News and Updates to consolidate the two areas, or make them completely separate. A dedicated search engine for IBIS would be appreciated.
![Page 14: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/14.jpg)
Publications
![Page 15: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/15.jpg)
Scenarios 4, 5 and 6: Indicators
• Most found the information, but the manner in which they did it varied greatly
• Categorical index – very confusing• Alphabetical index – easier to understand
– Alphabet bar doesn’t pop, users scroll to correct letter
• Indicators are not organized by key word: smoking, diabetes, etc…
• Suggestions: clean language, change alphabet bar
![Page 16: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/16.jpg)
Indicators
![Page 17: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/17.jpg)
Scenario 7: Queries
• Designed to be the most difficult, especially for light users
• Many searched all over looking for the information: indicators (both indices), publications, queries
• Instead of searching for a target, they are exhausting all other options
• Survey list for queries posed the greatest problem, many did not know what was in each category
• If dataset given, query did not pose a problem• Suggestions: simplify language, or describe in more
detail (rollovers, pop-ups, etc…)
![Page 18: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/18.jpg)
Queries
![Page 19: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/19.jpg)
Outsider Perspective
• Used to see effects of language
• Indices were most troubling for those not familiar with health care
• Time was increased to accomplish tasks
• Indicators were rarely used, individuals did not know what they were
• Confirmed language is a barrier to ease of use
![Page 20: IBIS-PH (Indicator-Based Information System for Public Health) Usability: Fall 2009 Sam Vanous Ph.D. HMO Health Program Manager Utah Department of Health](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649ea95503460f94bad01a/html5/thumbnails/20.jpg)
Post Questions
• Individuals are very pleased with IBIS
• Having all the information in one location that can be queried is useful
• The worst feature is the organization and difficulty finding what they are looking for