quality of expenditure data collected with a receipt scanning app … · 2018-10-29 · lcf...
TRANSCRIPT
![Page 1: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/1.jpg)
Quality of Expenditure Data Collected with a ReceiptScanning App in a Probability Household Panel
Alexander Wenz1, Annette Jackle1, Thomas F. Crossley1,Mick P. Couper2, Jonathan Burton1, Joachim Winter3
1University of Essex2University of Michigan3LMU Munich
BigSurv18 Conference
October 27, 2018
1 / 20
![Page 2: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/2.jpg)
Acknowledgements
Funding
I Economic and Social Research Council (ESRC)
I National Centre for Research Methods (NCRM)
I In collaboration with Kantar Worldpanel
Team members
Annette Jackle (PI, Essex) Brendan Read (Essex)Thomas F. Crossley (Essex) Mick P. Couper (Michigan)Jonathan Burton (Essex) Joachim Winter (Munich)Paul Fisher (Essex) Carli Lessof (Southampton)Mike Brewer (Essex) Alessandra Gaia (Bicocca-Milan)Alexander Wenz (Essex) Cormac O’Dea (Yale)
2 / 20
![Page 3: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/3.jpg)
Study aims
Collect high-quality data on monthly expenditure
I in the context of a general-purpose household panel survey:The UK Household Longitudinal Study (UKHLS)
How good are data collected with a receipt scanning appcompared to benchmark data?
3 / 20
![Page 4: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/4.jpg)
Study design
I Understanding Society Innovation PanelI Stratified, clustered random sample of HHs in Great Britain
I Adults aged 16+ invited to download receipt scanning appI After annual household interviewI Invited by letter and emailI Use app for one monthI Own smartphone or tablet (iOS or Android)
I App tasksI Scan shopping receiptI Report spending in appI Report no purchases today
I Fieldwork: Oct-Dec 2016
4 / 20
![Page 5: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/5.jpg)
Study design
I IncentivesI For app downloadI Per day app usedI Bonus for using app for one monthI Max. total: £30.50 (≈ $40) / £34.50 (≈ $45)
I Participation rateI 12.8% used app at least once (n = 270)I 81.5% of app users remain in the study for 29+ days
Jackle et al. (2017): Participation in a mobile app survey to collect expenditure dataas part of a large-scale probability household panel: response rates and responsebiases, Understanding Society Working Paper, 2017-09
5 / 20
![Page 6: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/6.jpg)
Research questions
1. Total expenditure in app compared to benchmark?
2. Category expenditure in app compared to benchmark?
3. Direct entry option important for which categories?
4. Which types of participants responded well to app task?
5. Different substantive conclusions when using app datacompared to benchmark?
6 / 20
![Page 7: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/7.jpg)
Benchmark data
UK Living Costs and Food Survey (LCF)
I Main survey on household expenditure in UK
I Stratified, clustered random sample of HHs in UK
I Adults aged 16+ invited to complete paper spending diaryfollowing the HH interview
I Response rate: 45% of HHs completed interview +at least 1 diary
7 / 20
![Page 8: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/8.jpg)
Differences between app and benchmark study
UKHLS App Study
I Receipt scanning app
I General-purpose survey
I Collect data on totalexpenditure
I Diary period: four weeks
I Excluding Northern Ireland
I Oct-Dec 2016
I N = 259
Living Costs and Food Survey
I Paper spending diary
I Expenditure survey
I Collect data on item-levelexpenditure
I Diary period: two weeks
I Including Northern Ireland
I Apr 2016-Mar 2017
I N = 2,213
8 / 20
![Page 9: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/9.jpg)
Differences between app and benchmark study
UKHLS App Study
I Receipt scanning app
I General-purpose survey
I Collect data on totalexpenditure
I Diary period: two weeks
I Excluding Northern Ireland
I Oct-Dec 2016
I N = 259
Living Costs and Food Survey
I Paper spending diary
I Expenditure survey
I Collect data on item-levelexpenditure
I Diary period: two weeks
I Including Northern Ireland
I Apr 2016-Mar 2017
I N = 2,213
8 / 20
![Page 10: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/10.jpg)
Differences between app and benchmark study
UKHLS App Study
I Receipt scanning app
I General-purpose survey
I Collect data on totalexpenditure
I Diary period: two weeks
I Excluding Northern Ireland
I Oct-Dec 2016
I N = 259
Living Costs and Food Survey
I Paper spending diary
I Expenditure survey
I Collect data on item-levelexpenditure
I Diary period: two weeks
I Excluding Northern Ireland
I Apr 2016-Mar 2017
I N = 2,213
8 / 20
![Page 11: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/11.jpg)
Differences between app and benchmark study
UKHLS App Study
I Receipt scanning app
I General-purpose survey
I Collect data on totalexpenditure
I Diary period: two weeks
I Excluding Northern Ireland
I Oct-Dec 2016
I N = 259
Living Costs and Food Survey
I Paper spending diary
I Expenditure survey
I Collect data on item-levelexpenditure
I Diary period: two weeks
I Excluding Northern Ireland
I Oct-Dec 2016
I N = 2,213
8 / 20
![Page 12: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/12.jpg)
MethodInverse probability weighting to match sample compositionof app study to benchmark data
Sample composition after IPWLCF App-LCF
Mean Age 50.0 −0.4% Female 51.7 −3.3% Employed 58.7 −5.6% Income Q1 26.0 −5.5
Q2 23.8 −3.4Q3 24.4 +5.7Q4 25.9 +3.2
% House owned 72.4 −0.5Mean HH size 2.6 −0.1Mean # children in HH 0.6 −0.1% Urban 75.5 +2.7% Computer in HH 92.1 +3.5
9 / 20
![Page 13: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/13.jpg)
ResultsTotal expenditure
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 200 400 600 800
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Note. Values have been trimmed at £800.
Average total weekly expenditure (in £)
Mean SD Q1 Median Q3 N KS-test
LCF 148.2 131.4 56.7 115.5 196.6 2,213Scan+DE 165.6 187.1 57.2 115.8 209.2 259 n.s.Scan only 116.7 149.4 41.5 76.1 127.7 236 ***
10 / 20
![Page 14: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/14.jpg)
ResultsCategory expenditure
Coding of scanned receipts
1. Data from images manually entered into databaseby Kantar Worldpanel
2. Automated category assignment for each itemI Item description parsedI Compared against consumption classification COICOPI Recoded into spending categories used in app
3. Category assignment manually checked
11 / 20
![Page 15: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/15.jpg)
ResultsCategory expenditure
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 50 100 150
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Note. Values have been trimmed at £125.Zero expenditure: LCF 55%, Scan+DE 48%, Scan only 51%.
Average weekly spending: Clothes and footwear (in £)
Mean SD Q1 Median Q3 N KS-test
LCF 12.8 30.4 0.0 0.0 13.5 2,213Scan+DE 11.3 20.6 0.0 0.0 12.5 259 n.s.Scan only 8.6 17.8 0.0 0.0 9.8 236 n.s.
12 / 20
![Page 16: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/16.jpg)
ResultsCategory expenditure
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 50 100 150
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Note. Values have been trimmed at £125.Zero expenditure: LCF 55%, Scan+DE 48%, Scan only 51%.
Average weekly spending: Clothes and footwear (in £)
Mean SD Q1 Median Q3 N KS-test
LCF 28.5 40.1 6.0 15.8 35.0 999Scan+DE 23.1 24.5 5.9 13.3 32.0 134 n.s.Scan only 18.7 22.3 2.5 10.7 24.5 115 ***
12 / 20
![Page 17: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/17.jpg)
ResultsCategory expenditure
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 50 100 150
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Note. Values have been trimmed at £150.Zero expenditure: LCF 13%, Scan+DE 4%, Scan only 5%.
Average weekly spending: Food and groceries (in £)
Mean SD Q1 Median Q3 N KS-test
LCF 32.3 32.3 5.1 24.4 49.4 2,213Scan+DE 40.9 30.2 14.6 38.3 60.8 259 ***Scan only 34.3 27.0 12.9 29.7 54.1 236 **
13 / 20
![Page 18: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/18.jpg)
ResultsCategory expenditure
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 50 100 150 200
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Note. Values have been trimmed at £200.Zero expenditure: LCF 10%, Scan+DE 25%, Scan only 45%
Average weekly spending: Socialising and hobbies (in £)
Mean SD Q1 Median Q3 N KS-test
LCF 37.8 51.4 7.5 22.8 49.4 2,213Scan+DE 16.6 21.2 0.8 8.3 22.0 259 ***Scan only 5.8 15.1 0.4 0.4 4.9 236 ***
14 / 20
![Page 19: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/19.jpg)
ResultsTotal expenditure by subgroup
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 200 400 600 800
Female
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 200 400 600 800
Male
Note. Values have been trimmed at £800.
Average total weekly expenditure (in £)
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Female MaleMedian N KS-test Median N KS-test
LCF 133.3 1,144 98.4 1,069Scan+DE 92.6 160 ** 129.6 99 *Scan only 77.3 149 *** 71.9 87 n.s.
15 / 20
![Page 20: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/20.jpg)
ResultsTotal expenditure by subgroup
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 200 400 600 800
Income: Below median
0.2
.4.6
.81
Em
piric
al c
umul
ativ
e de
nsity
0 200 400 600 800
Income: Above median
Note. Values have been trimmed at £800.
Average total weekly expenditure (in £)
LCF Spending DiaryUKHLS App Study: scan + direct entryUKHLS App Study: scan only
Income: Below median Income: Above medianMedian N KS-test Median N KS-test
LCF 88.1 1,102 143.8 1,111Scan+DE 74.2 102 * 143.3 157 n.s.Scan only 68.1 91 *** 77.3 145 ***
16 / 20
![Page 21: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/21.jpg)
Conclusions
I Promising method for collecting high-level expenditure data ingeneral population
I Total expenditure (scan + direct entry) comparable tobenchmark (LCF)
I Category expenditure more comparable for some categoriesthan for others
I Direct entry option important for most categories
I Expenditure more comparable for men and those with higherincome
17 / 20
![Page 22: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/22.jpg)
Follow-up study
How to increase participation in mobile data collection?
I Browser-based alternative to app (sequential mixed-mode)I Experiment #1: Invitation to use app
I Within interview vs. letter plus email
I Experiment # 2: Feedback on reported expenditureI Show cumulative summary of expenditure by categoryI Feedback promised vs. feedback not promised vs. no feedback
18 / 20
![Page 23: Quality of Expenditure Data Collected with a Receipt Scanning App … · 2018-10-29 · LCF Spending Diary UKHLS App Study: scan + direct entry UKHLS App Study: scan only Note. Values](https://reader034.vdocuments.us/reader034/viewer/2022042418/5f3466a62c6af968751fdd3f/html5/thumbnails/23.jpg)
More information
Project webpagehttps://www.iser.essex.ac.uk/research/projects/understanding-household-finance-through-better-measurement
19 / 20