interactive content for subjective studies on web...
TRANSCRIPT
![Page 1: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/1.jpg)
- 1 - © FTW 2012
INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB BROWSING QOE: A KEPLER DERIVATIVE
Sebastian Egger, Raimund Schatz, Bruno Gardlo
![Page 2: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/2.jpg)
- 2 - © FTW 2012 !
Web QoE Assessment 1/2
Goal is to quantify impact of: - QoS parameters - Usability - Design - Device Performance
on subjective quality perception of web browsing under realistic conditions
![Page 3: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/3.jpg)
- 3 - © FTW 2012
Web QoE Assessment 2/2
Content Related Problems: § Lack of control (Advertisments, interactive elements)
§ External sites permanently changing
§ Server and internet performance fluctuations
§ Comparability between Labs
![Page 4: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/4.jpg)
- 4 - © FTW 2012
Reliable Subjective Testing for
Web QoE enabled by
Realistic, Standardized
Reference Content
Motivation and Goal
![Page 5: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/5.jpg)
- 5 - © FTW 2012
Content Framework Requirements
§ Locally stored § Representative for different Content Categories
- e.g.: News, Photo Album, Webshop, Map Services
§ Interactive Content - Updated daily - User interaction possible
§ Available in different languages § Customizable design in order to mimic certain
webpages § Customizable page weight § Mobile derivate of the framework § (somehow) coherent with existing Standards (Kepler)
![Page 6: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/6.jpg)
- 6 - © FTW 2012
Content Categories
§ News
§ Photo Albums
![Page 7: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/7.jpg)
- 7 - © FTW 2012
Content Categories ctd.
§ Webshops
§ Map Services
![Page 8: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/8.jpg)
- 8 - © FTW 2012
Interactive Content and Language
§ Requirement 1: Allow for realistic tasks! § Requirement 2: Avoid user fatigue and boredom!
§ Sufficient amount of information for several Web QoE test conditions (each 2 – 3 minutes)
§ Interaction pattern must be realistic § Up to date information is important, especially for
news pages § Page content must be available locally § Language should be adaptable to target audience
![Page 9: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/9.jpg)
- 9 - © FTW 2012
Design and Page Weight
§ New web test content framework must be able to mimic different web page designs.
§ Ideally different sites could be recreated by the same framework
§ Customizable page weight. - Emulate technical properties of existing sites àFuture proof
![Page 10: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/10.jpg)
- 10 - © FTW 2012
Coherence with KEPLER
§ The new framework should be technically coherent with the existing Kepler page in terms of defined
- Object count and size - Object types - Object size distribution - Compressible / Incompressible objects
§ Additional feature(s) - Customizable page weight
![Page 11: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/11.jpg)
- 11 - © FTW 2012
PROPOSED SOLUTION
![Page 12: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/12.jpg)
- 12 - © FTW 2012
FTW’s solution 1/2
§ Automatically created web pages suitable for subjective testing
- Interactivity is ensured as pages have the same depth as the prototype page / RSS feed selected
- Several successive web QoE sessions can be conducted as the content is ‘deep’ enough.
§ Content Framework creates web page from harvested content in the database automatically
- Page appearance is defined via style sheets - Page style can be easily customized - Mobile version defined via style sheets
![Page 13: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/13.jpg)
- 13 - © FTW 2012
FTW’s solution 2/2
§ Content: harvest information from selected prototype page through python script or RSS feeds
- Content fed into a local database - Freshness of content enabled by e.g. harvesting news every
day in an automated fashion - Language selection achieved via prototype page / RSS
feeds
§ Web page categories being implemented currently - News Page - Photopage
![Page 14: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/14.jpg)
- 14 - © FTW 2012
Conclusion
§ Content for subjective Web QoE Tests on its way § Following requirements are met
- Local storage - Decent interactivity and content ‘depth’ - Configurable Language - Two content categories
§ Requirements not met (yet) - More content categories - Mobile derivate
§ Roadmap - Publication as part of Standardization Process within ETSI - Release Date: 12.12.2012
![Page 15: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/15.jpg)
- 15 - © FTW 2012
Preview of the pages
News Page § http://dataworkers.eu/spiegel_new/www/
Photopage § http://dataworkers.eu/spiegel_new/www/fakebook/
Login data: Username: etsi PWD: testcontent12
![Page 16: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB …docbox.etsi.org/Workshop/2012/201211_STQWORKSHOP/S... · - e.g.: News, Photo Album, Webshop, Map Services ! Interactive Content](https://reader034.vdocuments.us/reader034/viewer/2022050522/5fa5776e02d2f165ca320598/html5/thumbnails/16.jpg)
- 16 - © FTW 2012
Thank you for your attention!
Questions / Suggestions ?