card sorting @ eurovis2015
TRANSCRIPT
![Page 1: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/1.jpg)
EuroVis 2015, Cagliari, Italy
Card Sorting Techniques for Domain Characterisation in Problem-driven
Visualization Research
Ryo Sakai and Jan Aerts KU Leuven, Belgium
STADIUSCenter for Dynamical Systems, Signal Processing and Data Analytics
![Page 2: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/2.jpg)
Domain characterization is not easy.
![Page 3: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/3.jpg)
Challenges
1. Domain-specific knowledge
2. Exploratory tasks
3. Establish a shared understanding of the domain problem and analysis needs
4. Foster creative thinking
![Page 4: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/4.jpg)
vis designer domain expert
![Page 5: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/5.jpg)
Card sorting
Related works in VIS [1] D. Lloyd and J. Dykes, “Human-centered approaches in geovisualization design: Investigating multiple methods through a long-term case study,” IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2498–2507, 2011.
[2] S. McKenna, D. Mazur, J. Agutter, and M. Meyer, “Design activity framework for visualization design,” To Appear IEEE TVCG (Proc. InfoVis), vol. 20, no. 12, pp. 2191–2200, 2014.
More in CS and HCI see our paper…
![Page 6: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/6.jpg)
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
![Page 7: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/7.jpg)
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
![Page 8: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/8.jpg)
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
![Page 9: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/9.jpg)
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
TransportationsAnimals
Technology Drinks
![Page 10: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/10.jpg)
Card sorting
1. Open card sorting goal: to elicit tacit categorisation of items
generative
Transportations AnimalsTechnology Drinks
![Page 11: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/11.jpg)
TransportationsAnimals
Technology Drinks
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
![Page 12: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/12.jpg)
TransportationsAnimals
Technology Drinks
Icons made by Freepik, Google from www.flaticon.com is licensed by CC BY 3.0
![Page 13: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/13.jpg)
Card sorting types
1. Open card sorting goal: to elicit tacit categorisation of items
generative
2. Closed card sorting goal: to evaluate the assignment of items to categories
evaluative
![Page 14: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/14.jpg)
Step 1: Preparation
![Page 15: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/15.jpg)
Step 1: Preparation
Is a promoter region also regulating another gene?
Which chromosomes are affected by structural
variations?
What are the functional/biological impact of the
structural variation?
Are there any fusion genes?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
Are the genomic rearrangements localized?
Are there any exonic deletion or duplications?
How does the pattern of SV compare between the normal and the tumour
samples?
Is the result of structural variation analysis valid?
What is the sequence of structurally altered region?
Where are the abnormal structural variations?
Are there any disrupted or deleted genes?
inquiry-based cards
![Page 16: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/16.jpg)
Step 1: Preparation
Is a promoter region also regulating another gene?
Which chromosomes are affected by structural
variations?
What are the functional/biological impact of the
structural variation?
Are there any fusion genes?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
Are the genomic rearrangements localized?
Are there any exonic deletion or duplications?
How does the pattern of SV compare between the normal and the tumour
samples?
Is the result of structural variation analysis valid?
What is the sequence of structurally altered region?
Where are the abnormal structural variations?
Are there any disrupted or deleted genes?
inquiry-based cards picture cards
from literature
new visual encoding ideas
![Page 17: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/17.jpg)
Step 1: Preparation
Is a promoter region also regulating another gene?
Which chromosomes are affected by structural
variations?
What are the functional/biological impact of the
structural variation?
Are there any fusion genes?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
Are the genomic rearrangements localized?
Are there any exonic deletion or duplications?
How does the pattern of SV compare between the normal and the tumour
samples?
Is the result of structural variation analysis valid?
What is the sequence of structurally altered region?
Where are the abnormal structural variations?
Are there any disrupted or deleted genes?
inquiry-based cards picture cards
from literature
new visual encoding ideas
Q1 V1
![Page 18: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/18.jpg)
Step 2: Execution
1. open card sorting by yourself
2. repeat with the same/different cards with the same/different user
“front-line analyst” vs. “gate keeper” [Sedlmair et al. 2012]
![Page 19: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/19.jpg)
Step 3: Analysis
1. careful observation during the sorting exercise
2. analysis of criteria and categories (open)
3. analysis of assigned cards (open/close)
![Page 20: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/20.jpg)
Case study
• Structural variations of human cancer genome • user: computational biologists
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 21: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/21.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 22: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/22.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 23: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/23.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Genome Chromosome Segment FeatureGenomic
Resolution
M. Meyer, T. Munzner, and H. Pfister, “MizBee: A multiscale synteny browsers,” in IEEE Transactions on Visualization and Computer Graphics, 2009, vol. 15, no. October, pp. 897–904.
![Page 24: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/24.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 25: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/25.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 26: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/26.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Primary Analysis
In depth Analysis
Impact ValidationProcess
![Page 27: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/27.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Primary Analysis
In depth Analysis
Impact ValidationProcess
![Page 28: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/28.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 29: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/29.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 30: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/30.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Genome Chromosome Segment FeatureGenomic
Resolution
![Page 31: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/31.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Genome Chromosome Segment FeatureGenomic
ResolutionWhat are the functional/biological impact of the
structural variation?
Are the genomic rearrangements
localized?
Where are the abnormal structural variations?
Which chromosomes are affected by structural
variations? Is the result of structural variation analysis valid?
Are there any fusion genes?
How does the pattern of SV compare between the
normal and the tumour samples?
Is a promoter region also regulating another gene?Are there any disrupted
or deleted genes?
What is the sequence of structurally altered
region?Are there any exonic
deletion or duplications?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
![Page 32: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/32.jpg)
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
Genome Chromosome Segment FeatureGenomic
ResolutionWhat are the functional/biological impact of the
structural variation?
Are the genomic rearrangements
localized?
Where are the abnormal structural variations?
Which chromosomes are affected by structural
variations? Is the result of structural variation analysis valid?
Are there any fusion genes?
How does the pattern of SV compare between the
normal and the tumour samples?
Is a promoter region also regulating another gene?Are there any disrupted
or deleted genes?
What is the sequence of structurally altered
region?Are there any exonic
deletion or duplications?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
![Page 33: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/33.jpg)
Genome Chromosome Segment FeatureGenomic
ResolutionWhat are the functional/biological impact of the
structural variation?
Are the genomic rearrangements
localized?
Where are the abnormal structural variations?
Which chromosomes are affected by structural
variations? Is the result of structural variation analysis valid?
Are there any fusion genes?Is a promoter region also
regulating another gene?
How does the pattern of SV compare between the
normal and the tumour samples?
Are there any disrupted or deleted genes?
What is the sequence of structurally altered
region?Are there any exonic
deletion or duplications?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 34: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/34.jpg)
Genome Chromosome Segment FeatureGenomic
ResolutionWhat are the functional/biological impact of the
structural variation?
Are the genomic rearrangements
localized?
Where are the abnormal structural variations?
Which chromosomes are affected by structural
variations? Is the result of structural variation analysis valid?
Are there any fusion genes?Is a promoter region also
regulating another gene?
How does the pattern of SV compare between the
normal and the tumour samples?
Are there any disrupted or deleted genes?
What is the sequence of structurally altered
region?Are there any exonic
deletion or duplications?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picture
![Page 35: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/35.jpg)
R. Sakai, M. Moisse, J. Reumers, and J. Aerts, “Pipit: visualizing functional impacts of structural variations.,” Bioinformatics, vol. 29, no. 17, pp. 2206–7, Sep. 2013.
Genome Chromosome Segment FeatureGenomic
ResolutionWhat are the functional/biological impact of the
structural variation?
Are the genomic rearrangements
localized?
Where are the abnormal structural variations?
Which chromosomes are affected by structural
variations? Is the result of structural variation analysis valid?
Are there any fusion genes?Is a promoter region also
regulating another gene?
How does the pattern of SV compare between the
normal and the tumour samples?
Are there any disrupted or deleted genes?
What is the sequence of structurally altered
region?Are there any exonic
deletion or duplications?
How does the pattern of structural variation
compare between the reference genome and
tumour sample?
1 2 3 4
who: designer user user user
type: open open closed closed
cards: inquiry inquiry inquiry picturegene
SV event
gene
SV events
A B
E F
C D
![Page 36: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/36.jpg)
Take home message
1. Card sorting is a simple and flexible method.
2. Card sorting exercises can be generative or evaluative.
3. The distilling process of card preparation helps to understand the context as well as the relationships of analysis tasks.
4. Card sorting can be useful for the domain characterisation in a problem-driven visualization research.
![Page 37: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/37.jpg)
Acknowledgements
Dept. of Oncology, KU Leuven
Matthieu Moisse Joke Reumers
STADIUSCenter for Dynamical Systems, Signal Processing and Data Analytics
![Page 38: Card Sorting @ EuroVis2015](https://reader034.vdocuments.us/reader034/viewer/2022051708/589fe7d21a28abf3238b60e3/html5/thumbnails/38.jpg)
Thank you!