![Page 1: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/1.jpg)
What Do Exploratory Searchers Look at in a Faceted Search Interface?
Bill Kules and Matthew Banta
The Catholic University of AmericaSchool of Library and Information Science
![Page 2: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/2.jpg)
Outline
• 60-second demo
• Our goals
• Research questions
• Experimental design
• Results
• Future work
![Page 3: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/3.jpg)
![Page 4: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/4.jpg)
Our Goals
• Improve understanding of how faceted interfaces affect searcher actions and tactics
• Develop and validate a methodology for creating exploratory search tasks for evaluations of search systems
![Page 5: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/5.jpg)
Research Questions
• How long do searchers look at the major elements (facets, results, query box, breadcrumbs, etc.) of the interface?
• In what order do searchers look at the major elements in a faceted search interface?
![Page 6: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/6.jpg)
Experimental Design
• N=18 successful sessions– From 21 subjects recruited
• 1x2 within-subjects design
• Task types– Exploratory tasks (n=4)– Known item tasks (n=2)
• Counterbalanced within task type
![Page 7: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/7.jpg)
Procedure
• Introduction• 90 second training video• Calibrate eye tracker• Conduct 6 searches• Questionnaire after each search• Retrospective verbal report
– Video of two searches with gaze data overlaid
• Final questionnaire
![Page 8: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/8.jpg)
Six Tasks
• ExploratoryA. Feminism in the United StatesB. Textile industry on three continentsC. Great Britain and the colonies in the 20th
centuryD. History of the Olympic games
• Known item: find a bookE. Firefly Encyclopedia of TreesF. Harry Potter and the Goblet of Fire
![Page 9: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/9.jpg)
Exploratory Task
Imagine you are taking a class called “Feminism in the United States”. For this class you need to write a research paper on some aspect of the U.S. feminist movement, but have yet to decide on a topic. Use the catalog to find two possible topics for your paper. Then use the catalog to find three books for each topic so that you might make a decision as to which topic to write about.
![Page 10: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/10.jpg)
Equipment Configuration
• NCSU Catalog Research Testbed• Tobii 2150 remote eye tracker
– 21” monitor– 50 Hz sampling rate– Resolution 1024x768
• Tobii Clearview v2.7.1• Gaze fixations
– Minimum 100 ms– 30 pixel radius
• Manually segmented AOIs
![Page 11: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/11.jpg)
Query
Facets
Breadcrumbs
Results
Interface with Areas of Interest (AOIs)
![Page 12: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/12.jpg)
How long did searchers look at the major elements of the interface?
![Page 13: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/13.jpg)
Exploratory Search Tasks Known ItemSearch Tasks
![Page 14: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/14.jpg)
For exploratory search tasks
![Page 15: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/15.jpg)
In what order did searchers look at the major elements?
![Page 16: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/16.jpg)
Transitions in Attention Between AOIs
![Page 17: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/17.jpg)
Query
Facets
Breadcrumbs
Results
Interface with Areas of Interest (AOIs)
![Page 18: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/18.jpg)
Post-search Interviews
• “The subject thing worked. I don’t normally do subject searches.”
• “I needed a subject and I didn’t want to look through 2000 books.”
• “shopping around” - selecting facets and then looking to see what was available for a particular subject
![Page 19: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/19.jpg)
Limitations
• Training was provided
• Researcher-provided tasks in lab setting
• One high-level scenario
• Tasks constructed were focused on this study
![Page 20: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/20.jpg)
Future Work• Additional factors
– Training – Next study supported by OCLC/ALISE grant and CUA purchase of an eye tracker
– Number and size of facets– Domain, search knowledge
• Additional measures– Gaze behavior – e.g. fixation counts– “Traditional” measures – e.g. clicks
• Refine procedure for exploratory search task generation
![Page 21: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/21.jpg)
Conclusions• Facets played a major role in exploratory
searches– Fixation time about ½ as much as on results– On first page about equal– Facet-result & result-breadcrumb ~ ½ of all transitions
![Page 22: What Do Exploratory Searchers Look at in a Faceted Search Interface? Bill Kules and Matthew Banta The Catholic University of America School of Library](https://reader035.vdocuments.us/reader035/viewer/2022070401/56649f1f5503460f94c36f6c/html5/thumbnails/22.jpg)
Acknowledgements
• Rob Capra, Tito Sierra, Jason Casden, and Joe Ryan
• Doug Oard and members of the UMD HCIL – for the use of their facilities and eye-tracker
• This research was supported by a grant from Catholic University and in part by a grant from the NSF/Library of Congress (IIS 0455970).