mobile eyetracking voor_uxd_testing
TRANSCRIPT
![Page 1: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/1.jpg)
Mobiele eye-tracking voor UXD testing
Geert Brône & Toon Goedemé, Ph.D.’s van Katholieke Universiteit Leuven
![Page 2: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/2.jpg)
Mobile eye-tracking for UX testing
Geert Brône & Toon Goedemé
![Page 3: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/3.jpg)
Mobile eye-tracking
3
![Page 4: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/4.jpg)
Mobile eye-tracking
4
mobile
eye-tracking
user
in the wild
![Page 5: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/5.jpg)
Mobile eye-tracking
5
![Page 6: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/6.jpg)
In the wild?
6
![Page 7: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/7.jpg)
In the wild!
7
![Page 8: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/8.jpg)
Taking mobile eye-tracking into the wild
8
![Page 9: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/9.jpg)
9
![Page 10: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/10.jpg)
A brief history of eye-tracking research
10
Long-standing interest in the study of visual attention in various research disciplines:
Psycholinguistics: reading research
Psychology: scene perception
![Page 11: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/11.jpg)
A brief history of eye-tracking research
11
A more recent research interest can be observed in:
Human-computer
interaction Human-human interaction
![Page 12: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/12.jpg)
A brief history of eye-tracking research
12
Navigation & wayfinding
Kinematics & sports research
A more recent research interest can be observed in:
![Page 13: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/13.jpg)
Developments in eye-tracking technology
13
Broadening interest & technological innovation go hand in hand
![Page 14: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/14.jpg)
Developments in eye-tracking technology
14
• First generation eye-trackers
• Unobtrusive eye-trackers
![Page 15: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/15.jpg)
Developments in eye-tracking technology
15
• Mobile eye-trackers
![Page 16: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/16.jpg)
Developments in eye-tracking technology
16
User-friendly & flexible recording devices are one thing, but efficient data analysis is a completely different story
![Page 17: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/17.jpg)
Developments in eye-tracking technology
17
Recent development: Efficient data aggregation and analysis tools: semi-automatic analysis & results presentation à towards plug and play systems
![Page 18: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/18.jpg)
Developments in eye-tracking technology
18
Ok for static recording devices such as screen-based eye-trackers
![Page 19: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/19.jpg)
Developments in eye-tracking technology
19
Not ok for mobile eye-trackers
Ø No fixed reference frame (moving head, moving subject)
Ø Potentially multiple moving objects in the scene
Ø Highly complex datastream for mobile eye-tracking
![Page 20: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/20.jpg)
Developments in eye-tracking technology
20
• Manual coding o time-consuming (and thus expensive!) o requires technical expertise
Current options:
![Page 21: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/21.jpg)
Developments in eye-tracking technology
21
• Predefine potentional area of analysis o Based on infrared (or other) markers o 2-D plane of zone predefined by markers o Semi automatic data aggregation & analysis possible
Current options:
![Page 22: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/22.jpg)
Developments in eye-tracking technology
22
• Predefine potential area of analysis
Current options:
![Page 23: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/23.jpg)
23
• But: o Works only for predefined planes o Tracking multiple fields or objects with identical or similar features
(object categories) o Objects of interest need to be tied to a fixed position in the AOA
(<-> handling of objects) o Labo setup / large natural test environments
Developments in eye-tracking technology
Eye-tracking in the wild?
![Page 24: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/24.jpg)
Introducting the InSight Out method
24
• Apply image processing techniques on data collected by a mobile eye-tracker
• (Semi)-Automatic analysis of (mobile) eye-tracking data without predefined AOA’s
• User-friendly output generation: o Time-line o Statistical data o Object clouds o …
![Page 25: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/25.jpg)
25
• Integration of image recognition algorithms • Benefits:
o Target of analysis is not restricted to a region o Objects can be moving o Manual labour limited
Introducting the InSight Out method
![Page 26: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/26.jpg)
Basic image recognition techniques
26
Technique #1: Object recognition based on local feature matching
![Page 27: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/27.jpg)
Object recognition in eye tracking video
27
User’s selection
Visual similarity
score
[ORB: an efficient alternative to SIFT and SURF, E. Rublee & G. Bradski, ICCV 2011 ]
27
![Page 28: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/28.jpg)
Realizations Object recognition - GUI
28
![Page 29: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/29.jpg)
Object recognition results
29
Processing speed
Recognition rate
![Page 30: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/30.jpg)
Basic image recognition techniques
30
Technique #2: Varying shape detection -> e.g. people, faces
![Page 31: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/31.jpg)
Varying shape detection
31
• Detection of persons: we trained a new model to detect upper part of a human body (upper 60% of full body) o [Parts-based latent SVM cascaded classifier, P. Felzenszwalb, CVPR 2010 ]
• Face detection: 3 face models (frontal, left and right profile) o [Viola&Jones: Robust Real-time Object Detection, IJCV 2001]
![Page 32: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/32.jpg)
Eye-tracker experiments Experiments used for development and testing
32
• Visiting a library and picking up magazines • Walking through a public building while paying
attention to signs such as fire exit, staircases
• Walking through the streets while paying attention to traffic signs
• Visiting a toy shop and picking up products
• Attending a presentation given by a lecturer
![Page 33: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/33.jpg)
Eye-tracker experiments Case study 1: customer journey experiment
33
• “Gain insights in the experience of customers” • Find relation between user experience and visual behavior • Experiment was performed in Museum M (Leuven) • Visiting a specific exhibition: Hieronymus Cock • 14 participants were involved in this experiments • 4 systems were used
o Tobii / arrington / contour head mounted camera
• We collected 160GB of data
![Page 34: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/34.jpg)
Eye-tracker experiments Case study 1: customer journey experiment
34
• Questions to be answered: • Do the visitors notice to walking guides? • Do the visitor notice the childquiz? • Do the visitors notice the Ipod / Ipad in the exhibition • Is there a relation between favorite work and view time?
![Page 35: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/35.jpg)
Eye-tracker experiments Case study 1: customer journey experiment
35
• First result of our algorithm
![Page 36: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/36.jpg)
Future developments: near future
36
Attractive visualisations of the detection results
Detection results database
• Timeline
• Object statistics
![Page 37: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/37.jpg)
37
• Camera-based localisation and 3D mapping o Test person location: 2D heat map and location tracks o 3D gaze location: 3D-heat map
• Possibly combined with detected objects
Future developments: further future
Obj1
Obj2
Obj3
![Page 38: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/38.jpg)
38
• Emotion recognition o Important aspect of customer journey analysis in UX o mobile eye-tracker with additional camera which captures the face o allows to use existing emotion detection algorithms based on the
pose of e.g. mouth corners o Link with detection of touch points and visualize…
Future developments: quite far future
![Page 39: Mobile eyetracking voor_uxd_testing](https://reader033.vdocuments.us/reader033/viewer/2022060111/5563be3bd8b42ac70d8b56a7/html5/thumbnails/39.jpg)
Project planning
39
2 parallel tracks • PhD research on more theoretical aspects
o Stijn De Beugher o Sept 2012 - 2016
• Commercial valorisation o Working towards spin-off startup o Mission: processing eye-tracking data from experiments conducted
by UX/marketing research bureaus o Result: nice-looking reports o Accepting first commercial projects by Q1 2014
guinea pig discount for first
projects!