Download - F inding patterns in temporal data
![Page 1: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/1.jpg)
FINDING PATTERNS IN TEMPORAL DATAKRIST WONGSUPHASAWATTAOWEI DAVID WANGCATHERINE PLAISANTBEN SHNEIDERMAN
HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND
27th HCIL Symposium
May 27, 2010
![Page 2: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/2.jpg)
FINDING PATTERNS IN TEMPORAL DATAKRIST WONGSUPHASAWATTAOWEI DAVID WANGCATHERINE PLAISANTBEN SHNEIDERMAN
HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND
27th HCIL Symposium
May 27, 2010
![Page 3: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/3.jpg)
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:36 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/14/2008 06:19 Exit
Time
EmergencyICU
FloorExit
TEMPORAL CATEGORICAL DATA• A type of time series
04/26/2010 10:00 31.0304/26/2010 10:15 31.0104/26/2010 10:30 31.0204/26/2010 10:45 31.0804/26/2010 11:00 31.16
EventCategory
Stock: MicrosoftNumerical
Arrival
Event
![Page 4: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/4.jpg)
TEMPORAL CATEGORICAL DATA
Electronic Health Records: symptoms, treatment, lab testTraffic incident logs: arrival/departure time of each unitStudent records: course, paper, proposal, defense, etc.
Others: web logs, usability study logs, etc.
![Page 5: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/5.jpg)
10+ years work on temporal visualization(mostly on Electronic Health Records)
![Page 6: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/6.jpg)
LIFELINES
SINGLE RECORD
[Plaisant et al. 1998]http://www.cs.umd.edu/hcil/lifelines
![Page 7: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/7.jpg)
LifeLines – Single Patient
![Page 8: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/8.jpg)
working with physicians at WASHINGTON HOSPITAL CENTER
![Page 9: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/9.jpg)
EXAMPLE DATA• Patient transfers
ARRIVAL Arrive the hospitalEMERGENCY Emergency roomICU Intensive Care UnitINTERMEDIATE Intermediate Medical
CareFLOOR Normal roomEXIT-ALIVE Leave the hospital aliveEXIT-DEAD Leave the hospital dead
![Page 10: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/10.jpg)
TASKS
within 2 days
ICU Floor ICU
• Example: Finding “Bounce backs”
![Page 11: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/11.jpg)
LIFELINES 2
RECORDRECORDRECORD
RECORD
RECORD
[Wang et al. 2008, 2009]http://www.cs.umd.edu/hcil/lifelines2
![Page 12: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/12.jpg)
LifeLines2 – Search and Visualize
ARF (Align-Rank-Filter)Framework
Temporal Summary
Multiple Records
![Page 13: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/13.jpg)
ALIGNMENT• Sentinel events as reference points
Time
Patient #45851737 ArrivalEmergency
ICUFloor
ExitPatient #43244997 Arrival
EmergencyICU
FloorExit
June July August
![Page 14: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/14.jpg)
ALIGNMENT (2)• Time shifting
Time
Patient #45851737 AdmitEmergency
ICUFloor
ExitPatient #43244997 Admit
EmergencyICU
FloorExit
0 1 M 2 M
![Page 15: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/15.jpg)
SIMILAN
RECORDRECORDRECORD
RECORD
RECORD
[Wongsuphasawat & Shneiderman 2009]http://www.cs.umd.edu/hcil/similan
![Page 16: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/16.jpg)
Similan – Search by Similarity
![Page 17: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/17.jpg)
Similan – Search by Similarity
![Page 18: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/18.jpg)
FINDING “BOUNCE BACKS”Before After
• Much faster to specify new query• Visualizing the results gives better
understanding
![Page 19: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/19.jpg)
USER STUDIES: SEARCH
ExactMUST have A, B, C
Record#1
Record#2
Record#3
moresimilar
Similarity-basedSHOULD have A, B, C
SimilanLifeLines2
Query
Record#2
Record#1
Record#3
Query
![Page 20: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/20.jpg)
USER STUDIES: SEARCH
ExactMUST have A, B, C
Similarity-basedSHOULD have A, B, C
Query
Record#1
Record#2
Record#3
moresimilar
Query
Record#2
Record#1
Record#3
SimilanLifeLines2
1
![Page 21: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/21.jpg)
NEW STUFFNeeds for an overview -> LifeFlow!
![Page 22: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/22.jpg)
TASKS
within 2 days
ICU Floor ICU
• Example: Finding “Bounce backs”
• Other questionsArrival
ICU
?
??
![Page 23: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/23.jpg)
LIFEFLOW
RECORD
RECORD
RECORD
RECORD
RECORD
RECORD
RECORD
RECORD
AGGREGATEMerge multiple records into
tree
VISUALIZEDisplay the aggregation
![Page 24: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/24.jpg)
AGGREGATE• Aggregate by prefix
#1
#2#3
#4
Example with 4 records
![Page 25: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/25.jpg)
AGGREGATE• Aggregate by prefix
#1
#2#3
#4
![Page 26: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/26.jpg)
VISUALIZE• Inspired by the Icicle tree [Fekete 2004]
Number of files
![Page 27: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/27.jpg)
VISUALIZE (2)• Use horizontal axis to represent time• Video
![Page 28: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/28.jpg)
DEMO – LIFEFLOW When the lines are combined into flow
![Page 29: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/29.jpg)
FUTURE WORK• Comparison
Jan-Mar 2008 April-June 2008
IntermediateICUIntermediateICU
Floor
![Page 30: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/30.jpg)
TAKE-AWAY MESSAGEInformation visualization is a powerful way to explore temporal patterns.
You can work with us on new case studies.
![Page 31: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/31.jpg)
TEMPORAL CATEGORICAL DATA
Electronic Health Records: symptoms, treatment, lab testTraffic incident logs: arrival/departure time of each unitStudent records: course, paper, proposal, defense, etc.
Others: web logs, usability study logs, etc.
![Page 32: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/32.jpg)
EXAMPLE – TRAFFIC INCIDENTS
![Page 33: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/33.jpg)
ACKNOWLEDGEMENTDR. PHUONG HO, DR. MARK SMITH, DAVID
ROSEMANWASHINGTON HOSPITAL CENTER
http://www.whcenter.org
NATIONAL INSTITUTES OF HEALTH (NIH) - GRANT CA147489 http://www.nih.gov
MICHAEL PACK, MICHAEL VANDANIKERCENTER FOR ADVANCED TRANPORTATION
TECHNOLOGY LAB(CATT LAB)
http://www.cattlab.umd.edu
![Page 34: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/34.jpg)
TAKE-AWAY MESSAGEInformation visualization is a powerful way to explore temporal patterns.
You can work with us on new case studies.
More demos this afternoon{kristw, tw7, plaisant, ben}@cs.umd.eduhttp://www.cs.umd.edu/hcil/temporalviz
![Page 35: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/35.jpg)
Q&AQuestions?
{kristw, tw7, plaisant, ben}@cs.umd.edu
http://www.cs.umd.edu/hcil/temporalviz
![Page 36: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/36.jpg)
THANK YOUThank you
![Page 37: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/37.jpg)
BACKUP SLIDESJunkyard...
![Page 38: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/38.jpg)
LIFELINES2• 8 case studies
– Bounce backs– Step ups– BIPAP– Etc.
![Page 39: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/39.jpg)
DR. P
![Page 40: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/40.jpg)
Does not help exploring sequential patternsNeeds a new overview
LifeLines2’s Temporal Summary [Wang et al. 2009]
Continuum’s Histogram [Andre 2007]
![Page 41: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/41.jpg)
USER STUDIES• 8 Extensive case studies• Compared LifeLines2 with Similan
– Learn advantages & disadvantages• Drawing is preferred• Clear cut off points is needed
• Working on improvements– Flexible temporal search
![Page 42: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/42.jpg)
SIMILAN• Compared with LifeLines2 in an
experiment– Learn advantages & disadvantages– Drawing is preferred– No clear cut off points
• Working on improvements– Flexible temporal search
![Page 43: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/43.jpg)
LIFEFLOWAGGREGATE
VISUALIZE
Merge multiple records into tree
Display the tree
![Page 44: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/44.jpg)
APPROACHESExact SearchMUST have A, B, C
Similarity-based SearchSHOULD have A, B, C
Query
Record#1
Record#2
Record#3
moresimilar
Query
Record#1
Record#2
Record#3
![Page 45: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/45.jpg)
MOTIVATION
RESEARCH QUESTIONS
RESEARCHQUESTION#1
PRELIM. + PROPOSED WORK CONCLUSION
RESEARCHQUESTION#2
PRELIM. + PROPOSED WORK
![Page 46: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/46.jpg)
![Page 47: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/47.jpg)
EXPECTED CONTRIBUTIONS1. Design of visual representations, user
interfaces and interaction techniques2. Algorithms for flexible temporal
search3. Evaluation results4. Open new directions for exploring
temporal categorical data
![Page 48: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/48.jpg)
NEEDS FOR AN OVERVIEW• We learn
![Page 49: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/49.jpg)
NEEDS Visualize overviewor show summary
Where should I start?
![Page 50: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/50.jpg)
TEMPORAL VISUALIZATIONSBackground and related work
![Page 51: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/51.jpg)
RELATED WORK• Single record
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Visualization
• E.g. LifeLines, MIDGAARD, etc.
![Page 52: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/52.jpg)
RELATED WORK (2)• Multiple records
VisualizationVisualizationVisualizationVisualization
• E.g. LifeLines2, Continuum, ActiviTree, etc.
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
![Page 53: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/53.jpg)
More space please....
![Page 54: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/54.jpg)
INFORMATION VISUALIZATION MANTRAOVERVIEW FIRST, ZOOM AND FILTER, THEN DETAILS ON DEMAND
![Page 55: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/55.jpg)
RELATED WORK (3)• Multiple records
Visualization
• E.g. LifeLines2, Continuum
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
Patient ID: 4585173712/02/2008 14:26 Arrival12/02/2008 14:26 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/08/2008 10:02 Floor12/14/2008 06:19 Exit
![Page 56: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/56.jpg)
SEQUENTIAL PATTERNS
within 2 days
ICU Floor ICU
• Examples: “Bounce backs”
Patient #1
Patient #2
Patient #3
Patient #4
![Page 57: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/57.jpg)
DESIGN AN OVERVIEW• Sequential patterns• Scalability vs. Loss of information
![Page 58: F inding patterns in temporal data](https://reader036.vdocuments.us/reader036/viewer/2022081604/56816050550346895dcf7a9c/html5/thumbnails/58.jpg)