an in-situ study of mobile phone notifications
DESCRIPTION
We studied what notifications 15 mobile phone users received during one week, how they attended to them, and how the notifications affected them. Highlights of our findings are: * our participants dealt with more than 60 notifications per day, mostly from messengers, SMS, and email. * Notifications from messengers are largely attended within minutes. * Notifications from email clients and messengers show significant correlations with people's emotions: emails are associated with interruption and stress. Messages are related to feeling overwhelming but also connected to others. The paper received best-paper award at ACM MobileHCI '14, which was held in September 2014 in Toronto, Canada. The full paper is available here: http://pielot.org/pubs/Pielot2014-MobileHCI-Notifications.pdfTRANSCRIPT
![Page 1: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/1.jpg)
An In-Situ Study of
Mobile Phone Notifications
Research
Martin Pielot
Telefónica
Research
Rodrigo de
Oliveira
Google Inc.*
Karen Church
Yahoo Inc.*
* this work was done while working in Telefónica Research
ACM MobileHCI ’14, Sep 2014, Toronto, Canada
(Slideshare edit)
![Page 2: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/2.jpg)
MotivationPractice Cell Phone Etiquette Step 4 by Wikiphoto, via WikiHow, CC BY-NC-SA 3.0
On notification, people often interrupt
current activities to check notification
…
We aimed to better understand why
![Page 3: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/3.jpg)
In-Situ Study on Mobile Phone Notifications
(1) Quantitative analysis of notifications
and attentiveness
(2) Fusion with daily subjective feedback
on emotional impact
(3) Implications for strategies to improve
notification handling
![Page 4: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/4.jpg)
Methodology
![Page 5: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/5.jpg)
Participants
15 Volunteers (6 female, 9 male)
Europe and US
Late 20ies, early 30ies
Information workers
![Page 6: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/6.jpg)
Notification Monitor
![Page 7: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/7.jpg)
Notification Posted
![Page 8: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/8.jpg)
Opening of Notification Center
![Page 9: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/9.jpg)
Launch of Apps
![Page 10: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/10.jpg)
Attentiveness
Time
![Page 11: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/11.jpg)
Attentiveness
Time
![Page 12: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/12.jpg)
No notifications on lock screen!
![Page 13: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/13.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
Diary Survey – Daily for 7 Days
![Page 14: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/14.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
Diary Survey – Daily for 7 Days
![Page 15: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/15.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
Diary Survey – Daily for 7 Days
![Page 16: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/16.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
Diary Survey – Daily for 7 Days
![Page 17: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/17.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
Diary Survey – Daily for 7 Days
Morning of next day – to capture late-night notifications
No experience sampling – to not add new notifications
![Page 18: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/18.jpg)
Notifications
![Page 19: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/19.jpg)
messengers49%
email32%
social networks
4%
other15%
6854 notifications in 7 days
Participants did not have
to alter notification
settings
• 2 of 15 did not receive
email notifications
• 7 of 15 did not receive
social network
notifications
![Page 20: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/20.jpg)
0
20
40
60
80
100
120
140N
otific
atio
ns
pe
r D
ay
Messengers Email Social Networks Other
Weekday Day in Weekend
63.5 notifications per day (Median)
![Page 21: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/21.jpg)
0%
20%
40%
60%
80%
100%
MIM Email Social Other
User
Res
po
nses
How many notifications have you receivedon your mobile phone?
don't know
way more
more
the usual
fewer
way fewer
![Page 22: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/22.jpg)
0
50
100
150
200
250
300
350
0 4 8 12 16 20 24
Nu
mb
er
of
No
tifi
ca
tio
ns
Hour of the Day
Messengers Email Social Other
Messages: breaks and evening
Emails: work hours
![Page 23: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/23.jpg)
Attentiveness
![Page 24: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/24.jpg)
Attentiveness - Expectations
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
How fast do YOU typically respond?
With respect to the people you communicate most with
Within a few days
Within 24 hours
Within a few hours
Within an hour
Within a few minutes
Immediatey
![Page 25: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/25.jpg)
Attentiveness - Expectations
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
How fast do THEY typically respond?
With respect to the people you communicate most with
Within a few days
Within 24 hours
Within a few hours
Within an hour
Within a few minutes
Immediatey
![Page 26: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/26.jpg)
0
20
40
60
80
100
120
140
160
180
200
220
Tim
e u
ntil a
tte
nd
ed
(m
in)
Messengers Email Social Networks Other
Weekday Day in Weekend
From: 3.5 min (messages on weekends)
To: 27.7 min (emails on weekends)
Actual Attentiveness
![Page 27: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/27.jpg)
Ringer Mode
Vibration mode faster notification attendance
No difference between silent and normal mode
![Page 28: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/28.jpg)
Emotional Impact
![Page 29: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/29.jpg)
0%
20%
40%
60%
80%
100%
Msgs Email Social Other
Use
r R
esp
on
ses NA
never
rarely
occasionally
frequenty
very frequenty
How frequently felt distracted?
![Page 30: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/30.jpg)
WhatsApp was distracting a bit in the evening when I was out at the opera and then for birthday drinks with friends. It was not important to answer, but still a matter of politeness I had to answer in a reasonable time span.
![Page 31: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/31.jpg)
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 2/4
*
*
(WhatsApp, SMS,
Skype, etc.)
Social Network
apps (Facebook,
Twitter, LinkedIn,
etc.)
E-mail
Other apps
(updates, games,
etc.)
5. How much did the majority of these messages/notifications interrupt you from
your daily tasks?
Very
frequently
distracted
Frequently
distracted
Occasionally
distracted
Rarely
distracted
Very rarely or
never
distracted
NA
Mobile instant
messaging apps
(WhatsApp, SMS,
Skype, etc.)
Social Network apps
(Facebook, Twitter,
LinkedIn, etc.)
E-mail
Other apps (updates,
games, etc.)
6. With respect to the messages/notifications you received on your mobile phone
on Tuesday March 5th, 2013.
Strongly disagree DisagreeNeither agree nor
disagreeAgree Strongly agree
I received a lot of
notifications
I felt overwhelmed
by the amount of
notifications
I felt stressed by
Please tell us more about the application or notifications that cause the most distraction
3/13/13 [SURVEY PREVIEW MODE] Push Message/Notification Study - Diary Survey
www.surveymonkey.com/s.aspx?PREVIEW_MODE=DO_NOT_USE_THIS_LINK_FOR_COLLECTION&sm=%2ffVLBq9vJAztCbrM44%2bMhq0hVuR… 3/4
*
*
*
the notifications
I felt interrupted by
the notifications
I felt annoyed by
the notifications
I felt connected
with others.
I felt that others are
thinking about me.
7. There was at least one instance when the messages/notifications kept me from
doing something I had to or wanted to do.
8. There was at least one instance when I could not respond to a notification or
message as fast as I had wished.
9. There was at least one instance when I felt pressured to respond immediately
to a notification or message.
Yes
No
I don't remember
Please tell us more about this experience (when it happened, where, with whom you were, what
were you doing…)
Yes
No
I don't remember
Please tell us more about this experience (when it happened, where, with whom you were, what
were you doing…)
Yes
No
Daily Diary
![Page 32: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/32.jpg)
Keri J. Email customized icon. via Flickr, Mar 3, 2010 (CC BY-ND
2.0)
more
emails
![Page 33: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/33.jpg)
Increased feelings of
overwhelmed
interrupted
stressed
annoyed
LaurMG. A frustrated man sitting at a desk. via Wikipedia, May 24, 2011 (CC BY-
SA 3.0).
![Page 34: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/34.jpg)
Email notifications are usually from
exchange server, so they are work
related. It means if I am not near my
computer, I should get to my computer
and reply
![Page 35: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/35.jpg)
more
messages
![Page 36: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/36.jpg)
Increased feelings of
having to deal with
a lot of messages
and being
overwhelmed
Jhaymesisviphotography. Texting. via Flickr, Dec 10, 2011 (CC
BY 2.0)
![Page 37: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/37.jpg)
WhatsApp users don’t have option to
stop other side of users knowing if you
have already read or not [...] people
tend to expect immediate answers.
![Page 38: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/38.jpg)
BUT also
feeling connected
with others
Brinks Alo. Week 11/52: How Sweet It is To Be Loved by You. via Flickr, Oct 3, 2010 (CC BY-
ND 2.0)
![Page 39: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/39.jpg)
I was talking to my sister. She was
sad [and] I wanted to respond
immediately to comfort her.
![Page 40: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/40.jpg)
Design Implications for
Notification Handling
![Page 41: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/41.jpg)
Reducing number of interruptions
e.g. by muting the ringer when notification is predicted to be “unimportant” or context “unsuitable” …
Not advisable for communication services as users will check their phones anyway
Rosenthal et al. 2011
![Page 42: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/42.jpg)
Defer notification ‘til opportune moment
e.g. detecting break-points or wait until
activities are finished
Advisable for work/emails, but difficult
in case of personal communication
Horvitz et al. 2005, Iqbal and Bailey 2008, Fischer et al. 2011, Leiva et al.
2012
![Page 43: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/43.jpg)
Communicating non-availability
e.g. by communicating context or
predicting attentiveness
Advisable for personal communication,
to manage expectations
Harper and Taylor 2009, Reynolds et al. 2013, Pielot et al. 2014
![Page 44: An In-Situ Study of Mobile Phone Notifications](https://reader031.vdocuments.us/reader031/viewer/2022020306/55945a381a28ab4c728b4623/html5/thumbnails/44.jpg)
Take Aways
63.5 notifications per day, mostly from communication apps
People attend fast to notifications, in particular from messengers (3.5 min median) … even if the phone is in silent mode
Notifications, in particular related to work, correlate with negative emotions
However, personal communication also correlates with feeling connected
Implications depend on type of notification
Other/Non-important = mute ringer
Work/Email = deliver at opportune moment
Personal/Messages= communicate availability
An In-Situ Study
of
Mobile Phone
Notifications
Martin
Pielot
Rodrigo
de Oliveira
Karen
Church
* this work was done while
working in Telefónica
Research
ACM MobileHCI ’14, Sep 2014, Toronto,
Canada
Inc.*
Yahoo
Inc.*
Telefónica
Research