engagement effects of player rating system-based ...€¦ · banner ad banner consent instructions...
TRANSCRIPT
![Page 1: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/1.jpg)
![Page 2: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/2.jpg)
![Page 3: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/3.jpg)
![Page 4: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/4.jpg)
![Page 5: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/5.jpg)
![Page 6: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/6.jpg)
![Page 7: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/7.jpg)
![Page 8: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/8.jpg)
![Page 9: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/9.jpg)
![Page 10: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/10.jpg)
![Page 11: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/11.jpg)
![Page 12: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/12.jpg)
![Page 13: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/13.jpg)
Banner
AdBanner
Consent
GameInstructions Survey
Mechanical
Turk
Mechanical
Turk
Consent
Payment
Code
![Page 14: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/14.jpg)
Paid
Voluntary
![Page 15: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/15.jpg)
Voluntary
Voluntary
![Page 16: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/16.jpg)
![Page 17: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/17.jpg)
![Page 18: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/18.jpg)
![Page 19: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/19.jpg)
![Page 20: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/20.jpg)
![Page 21: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/21.jpg)
![Page 22: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/22.jpg)
![Page 23: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/23.jpg)
“A requester on
mturk giving away
free money… that
truly is a paradox!”
![Page 24: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/24.jpg)
Variable BANNER MTURK-SM MTURK-LG
Player Rating 1808 1509 1636
Highest Level Rating 1625 1222 1367
Levels Attempted 3 3 4
Levels Completed 3 3 4
![Page 25: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/25.jpg)
Variable BANNER MTURK-SM MTURK-LG
Effort/Importance 46% 63% 74%
Interest/Enjoyment 53% 56% 65%
Perceived Competence 43% 48% 60%
![Page 26: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/26.jpg)
Variable BANNER MTURK-SM MTURK-LG
Effort/Importance 46% 63% 74%
Interest/Enjoyment 53% 56% 65%
Perceived Competence 43% 48% 60%
![Page 27: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/27.jpg)
![Page 28: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/28.jpg)
![Page 29: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/29.jpg)
![Page 30: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/30.jpg)
![Page 31: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/31.jpg)
![Page 32: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/32.jpg)
![Page 33: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/33.jpg)
![Page 34: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/34.jpg)
![Page 35: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/35.jpg)
![Page 36: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/36.jpg)
Variable BANNER MTURK-LG DELAY NO-DELAY
Play Time 119s 206.5s 129s 162s
Levels Attempted 3 4 2 4
Levels Completed 3 4 2 4
Player Rating 1657 1627 1636 1646
Effort/Importance 57% 71% 66% 71%
![Page 37: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/37.jpg)
Variable BANNER MTURK-LG DELAY NO-DELAY
Play Time 119s 206.5s 129s 162s
Levels Attempted 3 4 2 4
Levels Completed 3 4 2 4
Player Rating 1657 1627 1636 1646
Effort/Importance 57% 71% 66% 71%
![Page 38: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/38.jpg)
Variable BANNER MTURK-LG DELAY NO-DELAY
Play Time 119s 206.5s 129s 162s
Levels Attempted 3 4 2 4
Levels Completed 3 4 2 4
Player Rating 1657 1627 1636 1646
Effort/Importance 57% 71% 66% 71%
![Page 39: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/39.jpg)
![Page 40: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/40.jpg)
![Page 41: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/41.jpg)
![Page 42: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/42.jpg)
![Page 43: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/43.jpg)
![Page 44: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/44.jpg)
![Page 45: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/45.jpg)
![Page 46: Engagement Effects of Player Rating System-Based ...€¦ · Banner Ad Banner Consent Instructions Game Survey Mechanical Turk Mechanical Turk Consent Payment Code. Paid Voluntary](https://reader034.vdocuments.us/reader034/viewer/2022050217/5f62b200076b7314cc3a9f78/html5/thumbnails/46.jpg)
Anurag Sarkar
Northeastern University
This material is based upon work supported by the National Science Foundation under grant
no. 1652537. We would like to thank the University of Washington's Center for Game
Science for initial Paradox development.