1

Visualization for Electronic Health Records: Promoting Patient-Centered Cognitive Support for Physician Decision-Making

10:00am Welcome & Introductions

10:20am Ben Shneiderman, Catherine Plaisant, David Wang, John Guerra, Angela NohUniv of Maryland, Review of Lifelines2, Similan, LifeFlow, and current directions

11:00am Jonathan Nebeker, Veteran’s Health Administration & Univ of UtahUsing Cognitive System Engineering for design of GUI for Chronic Disease Management:

A new paradigm for EHR?

11:40am Kevin Maloy, Washington Hospital CenterAzyxxi Physician Interface

12:20pm LUNCH

1:00pm Mike Gillam, Microsoft/AmalgaInterface Design Opportunities in Modern Clinical Computing

1:40pm Matt Quinn, AHRQ and Lana Lowry, NISTJoint efforts on EHR usability guidelines/standards

2:20pm Yair RajwanFraming Effective Patient-Oriented Information Visualization for patient-physician communication

2:40pm Closing discussion

2

Information Visualization for Medical Knowledge Discovery

Ben Shneiderman ben@cs.umd.edu

Founding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer Science

Member, Institute for Advanced Computer Studies

University of MarylandCollege Park, MD 20742

3

Interdisciplinary research community- Computer Science & Info Studies

P h S i P li S i & MITH- Psych, Socio, Poli Sci & MITH

(www.cs.umd.edu/hcil)

4

Scientific Approach (beyond user friendly)

• Specify users and tasksSpecify users and tasks• Predict and measure

• time to learn• speed of performance• rate of human errorsrate of human errors• human retention over time

• Assess subjective satisfaction(Questionnaire for User Interface Satisfaction)

• Accommodate individual differencesAccommodate individual differences• Consider social, organizational & cultural context

5

Design Issues

• Input devices & strategiesInput devices & strategies• Keyboards, pointing devices, voice

• Direct manipulation

• Menus, forms, commands

• Output devices & formats• Output devices & formats• Screens, windows, color, sound

• Text, tables, graphics

• Instructions, messages, help/• Collaboration & Social Media

• Help, tutorials, training

• Search

www.awl.com/DTUI

Fifth Edition: 2010

• Visualization

6

U.S. Library of Congress

• Scholars, Journalists, Citizens

• Teachers, Students

7

Visible Human Explorer (NLM)

D t• Doctors

• Surgeons

• Researchers

• Students

8

NASA Environmental Data

S i ti t• Scientists

• Farmers

• Land planners

• Students

9

Bureau of the Census

• Economists, Policy makers, Journalists

• T h St d t• Teachers, Students

10

NSF Digital Government Initiative

• Find what you need

• Understand what you Find

www.ils.unc.edu/govstat/

Census,

NCHS,BLS, EIA,

NASS, SSA

11

International Children’s Digital Library

www.childrenslibrary.org

12

Information Visualization

• Visual bandwidth is enormous• Human perceptual skills are remarkable

• Trend, cluster, gap, outlier...

• Color, size, shape, proximity...

• Human image storage is fast and vast

• Three challengesThree challenges• Meaningful visual displays of massive data

• Interaction: widgets & window coordination

• Process models for discovery:Integrate statistics & visualizationSupport annotation & collaborationSupport annotation & collaborationPreserve history, undo & macros

13

Spotfire: Retinol’s role in embryos & vision

14

Spotfire: DC natality data

15

16

10M - 100M pixels

Large displaysLarge displays for single or multiple users

17

100M-pixels & more

18

1M-pixels & less

Small mobile devices

19

Treemap: Gene Ontology

+ Space filling+ Space limited+ Color coding+ Size codingg- Requires learning

www.cs.umd.edu/hcil/treemap/

(Shneiderman, ACM Trans. on Graphics, 1992 & 2003)

20

Treemap: WHC Emergency Room (6304 patients in Jan2006)

Group by Admissions/MF, size by service time, color by age

21

Treemap: WHC Emergency Room (6304 patients in Jan2006) (only those service time >12 hours)

Group by Admissions/MF, size by service time, color by age

22

Treemap: Smartmoney MarketMap

www.smartmoney.com/marketmap

23

Market falls steeply Feb 27, 2007, with one exception

24

Market mixed, February 8, 2008 Energy & Technology up, Financial & Health Care down

25

Market rises 319 points, November 13, 2007, with 5 exceptions

26

Treemap: Newsmap (Marcos Weskamp)

newsmap.jp

27

Treemap: Supply Chain

www.hivegroup.com

28

Treemap: NY Times – Car&Truck Sales

www.cs.umd.edu/hcil/treemap/

29

Information Visualization: Mantra

• Overview, zoom & filter, details-on-demand, ,• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview zoom & filter details on demand• Overview, zoom & filter, details-on-demand

30

Information Visualization: Data Types

• 1-D Linear Document Lens, SeeSoft, Info Mural. ea ocu e t e s, SeeSo t, o u a

• 2-D Map GIS, ArcView, PageMaker, Medical imagery

• 3-D World CAD, Medical, Molecules, ArchitectureSci

Viz

• Multi-Var Spotfire, Tableau, GGobi, TableLens, ParCoords,

• Temporal LifeLines, TimeSearcher, Palantir, DataMontage

• Tree Cone/Cam/Hyperbolic, SpaceTree, Treemap

• Network Pajek, JUNG, UCINet, SocialAction, NodeXLInfo

Viz

infosthetics.com flowingdata.com infovis.orgwww.infovis.net/index.php?lang=2

31

Temporal Data: TimeSearcher 1.3

• Time series• Stocks

• Weather

• GenesGenes

• User-specifiedpatterns

• Rapid search

32

Temporal Data: TimeSearcher 2.0

• Long Time series (>10,000 time points)

• Multiple variables

• Controlled precision in match(Linear, offset, noise, amplitude)

33

LifeLines: Patient Histories

www.cs.umd.edu/hcil/lifelines

34

LifeLines2: Contrast+Creatine

35

LifeLines2: Align-Rank-Filter & Summarize

36

NodeXL: Book & Social Media Research Fnd

Social Media Research Foundationsmrfoundation.org

We are a group of researchers who want to create open tools, generate and host open data, and support open

h l hi l t d t i l discholarship related to social media.

Mapping, measuring and understanding the landscape of social media is our mission. We support tool projects that enable the collection, analysis and visualization of social

di d tmedia data.

37

Discovery Process: Systematic Yet Flexible

Preparation• Own the problem & define the schedule• Own the problem & define the schedule• Data cleaning & conditioning• Handle missing & uncertain data• Extract subsets & link to related information

38

SocialAction

• Integrates statistics& visualization

• 4 case studies, 4-8 weeks (journalist, bibliometrician, terrorist analyst,

organizational analyst)g y )• Identified desired features, gave strong positive

feedback about benefits of integration

Perer & Shneiderman, CHI2008, IEEE CG&A 2009www.cs.umd.edu/hcil/socialaction

39

NodeXL:Network Overview for Discovery & Exploration in Excel

www.codeplex.com/nodexl

40

NodeXL:Network Overview for Discovery & Exploration in Excel

www.codeplex.com/nodexl

41

NodeXL: Network Overview for Discovery & Exploration in Excel

https://wiki.cs.umd.edu/cmsc734_09/index.php?title=Homework_Number_3

42

Tweets at #WIN09 Conference: 2 groups

43

27th Annual SymposiumMay 27-28, 2010

www.cs.umd.edu/hcil

44

For More Information

• Visit the HCIL website for 400 papers & info on videoswww.cs.umd.edu/hcil

• Conferences & resources: www.infovis.org

• See Chapter 14 on Info VisualizationShneiderman, B. and Plaisant, C., Designing the User Interface:Strategies for Effective Human-Computer Interaction:g p

Fifth Edition (March 2009) www.awl.com/DTUI

• Edited Collections:Card, S., Mackinlay, J., and Shneiderman, B. (1999)

Readings in Information Visualization: Using Vision to Think Bederson, B. and Shneiderman, B. (2003)Bederson, B. and Shneiderman, B. (2003)The Craft of Information Visualization: Readings and Reflections

45

For More Information

• Treemaps• HiveGroup: www.hivegroup.com • Smartmoney: www.smartmoney.com/marketmap • HCIL Treemap 4.0: www.cs.umd.edu/hcil/treemap

• Spotfire: www.spotfire.com• Ti S h• TimeSearcher: www.cs.umd.edu/hcil/timesearcher

• NodeXL: nodexl.codeplex.com

• Hierarchical Clustering Explorer:www.cs.umd.edu/hcil/hce

• LifeLines2: www.cs.umd.edu/hcil/lifelines2

• Similan: www.cs.umd.edu/hcil/similan