objective monitoring of the obesogenic behaviour: from ...Β Β· location unit is the geohash or...
TRANSCRIPT
![Page 1: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/1.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Objective Monitoring of the Obesogenic Behaviour: From smart Raw Data to Privacy Preserving Statistics
1
Christos Diou, Anastasios Delopoulos*
Multimedia Understanding GroupInformation Processing LaboratoryDepartment of Electrical and Computer EngineeringAristotle University of ThessalonikiGreece
Workshop on trusted smart statistics, Wiesbaden, Jan 30-31, 2018
![Page 2: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/2.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
H2020 fundingβ 2016-2020
13 organizationsβUniversities
βSchools
βObesity clinics
βTechnical companies
βTelecommunications provider
βPublic Health Authorities
5 countries
Big Data Agains Childhood Obesity
![Page 3: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/3.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Obesity is a threat for health and economy
![Page 4: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/4.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Big data for evidence-based policies
Thousands of childrenβSchoolsβClinics
Behavioural data βPersonal Behavioural Patterns βBehavioural Risk Factors
Local Environment Conditions from relevant areas
BigO is built around the βcitizen-scientistβ model, which relies on individuals sharing their behavioral data
![Page 5: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/5.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
BigO Community
Reaching out to more than 23.000 school children to become BigO citizen scientists and share their behavioural data
Engage ~7.000
Engaging more than 2.000 children at 3 obesity clinics
![Page 6: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/6.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Need of multi-level approaches
Obesity risk depends on:β The way we eat
β What we eat
β How we move
β The way we sleep
These decompose into a long list of personal behavioral patterns
Highly correlated, in a causal way, with the conditions of localurban, social, regulatory and economic environment Based on Davison KK, Birch LL. Childhood overweight: a contextual model and
recommendations for future research. Obesity reviews. 2001 Aug 1;2(3):159-71
![Page 7: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/7.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
BigO Data collection
Photos - Food & Ads
Location β GPS Physical Activity
Self-reporting
Sleep
![Page 8: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/8.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
The BigO System
BigO Cloud Storage + Analytics Platform
Public HealthOfficials
Healthcare professionals
School
BigO community
Children
![Page 9: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/9.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Measurable quantities that provide information about an individualβs behaviour
β’ Objective measurements or timed self-reports that more accurate than questionnaires
Behavioural indicators
![Page 10: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/10.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Activity counts in time interval
β’ Steps in time interval
β’ Activity type
β’ Transportation mode used
β’ Visited POI and POI type
β’ Bite sequence during a meal
β’ Meal occurrence (self-reported with pictures, or detected from smartwatch)
β’ Sleep start and stop times
Base behavioural indicators
![Page 11: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/11.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Activity counts (computed from a filtered version of the acceleration vector)
β’ Steps (Gu et al., 2017)
β’ Activity type (our implementation)
Physical activity indicators
![Page 12: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/12.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Detect visited locations and means of transportation between them
Location and transportation
![Page 13: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/13.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Modified DBSCAN algorithm (Luo et al., 2017) for POI detection
β’ Detection of home and school
β’ Cross-reference with Foursquare and Google places for the rest
β’ Trip detection: Based on average speed
β’ Transportation mode detection based on accelerometer, using SVM models
POI, trip and transportation mode detection
![Page 14: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/14.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Measures of behavior: Analyze meal microstructure
Detect bites during meals
In the wild
Smartwatch captures accelerometry + gyroscope data
Signal Processing + Deep Learning
![Page 15: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/15.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Identify eating cycles using the smartwatch: Model hand micromovements
Measures of behavior: Analyze meal microstructure
Kyritsis K, Diou C, Delopoulos A. Food Intake Detection from Inertial Sensors Using LSTM Networks. In International Conference on Image Analysis and Processing. 2017.
Kyritsis, K., Diou, C., & Delopoulos, A. Modeling Wrist Micromovements to Measure In-Meal Eating Behavior from Inertial Sensor Data. IEEE journal of biomedical and health informatics, 2019
![Page 16: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/16.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Using the base behavioural indicators, we extract a variety of derived behavioural indicators, such asβ’ Fast food visit frequency
β’ Frequency of eating at home
β’ Eating schedule adherence
β’ Average physical activity level at work
β’ Average physical activity level in the afternoon
β’ Frequency of visits to gym or sports facilities
β’ Number of exercise sessions per week
β’ Frequency of walking/cycling to work
β’ Distribution of use of different modes of transportation
β’ Average sleep duration
β’ β¦
Derived behavioural indicators
![Page 17: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/17.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Behavioural profile (1)
β’ Adopt a list of certain POI Types
β’ For each transition
β’ Transition probabilities between POI types
β’ Probability distribution of behaviours for
β’ nodes
β’ edges
β’ Summary of the individualβs behaviour
β’ Can be used to compare the behaviours of individuals
β’ Different profile for workdays and non-workdays
![Page 18: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/18.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Behavioural profile (2)
Transportation distributions:
Transportation mode
Activity level
β¦
Duration
POI distributions:
Activity level
Meal occurrence
Eating speed
Sleep occurrence
β¦
Duration
![Page 19: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/19.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Behavioural profile similarity map (t-SNE)
Behaviour profile similarity was computed using the eigenvectors of the
transition matrix
Useful for clustering Behavioural Profiles
![Page 20: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/20.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Privacy by design: Geohash votes
Pseudonymizationβ Real names out of the systemβ Analytics on Geohashes not on
persons
Innovative handling of location data
β votes to elements of {geohashes} x {behaviours}β Cecilia was walking fast on
Odengatan street of Stockholm at 9:15 am
β increase votes(u6sce5, βwalk fastβ, 9) by one
β k-anonymityβ Cast the vote to all subareas of u6sce
if less than k votes
6 digit geohashes in central Stockholm
![Page 21: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/21.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Aggregation functions to extract statistics
β’ For example:
Average: π1 π, π = πΈ π,πΊ,π,π΅π{π΅π|πΊ = π}
β’ π: Users
β’ π: Time slots
β’ πΊ: Geohashes
β’ π΅π: Values of the π-th behavioural indicator
β’ π, π: Indicators of the π-th behavioural indicator and π-th geohash, respectively
Aggregating geohash votes
21
![Page 22: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/22.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Privacy by design: Timelines
22
β’ Capture individual behaviour, without revealing exact location
β’ Types of POIs visited, along with transportation modes between POIsβ’ Not POI location!
β’ Granularity in privacy controlβ’ Behavioural indicators for each POI
type
β’ Can include short geohash (to designate a broad POI area)
![Page 23: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/23.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Heatmap - behaviour
23
Activity counts
![Page 24: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/24.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Local environment conditions (LECs)
β’ Examplesβ’ Average number of supermarkets and grocery stores in 100, 1000 and 5000
meters
β’ Open spaces or public parks in neighbourhood
β’ Average distance to public transportation
β’ School exercise programs
β’ Unemployment rate
β’ Education level
β’ Exposure to food advertising in the urban environment
β’ β¦ many more
Location profile
24
![Page 25: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/25.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Heatmap - location
25
Number of fast food outlets
![Page 26: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/26.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Location unit is the geohash or region and is represented as a vector
π = π₯1, β¦ , π₯ππ
where each π₯π is the value of a LEC
Behaviour is a scalar, π¦, representing an aggregated value of a behaviouralindicator across subjects in a region, or a value associated with the behavioural profile of subjects (future work).
Learning goal: π¦ = π(π)
Learning models for prediction and inference
26
![Page 27: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/27.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Types of learning problems
27
Observed overall behaviour of people living at a geohash
Observed behaviourof people visiting a geohash
Which LECs play a role and how much
What is the estimated average behaviour for locations with no measurements
![Page 28: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/28.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Linear and generalized linear models:β’ Hypothesis tests [LEC π₯π does not affect the measured behaviour π¦]
β’ Confidence intervals [LEC π₯π determines the output with a factor in [π€π0, π€π1] with 95%] probability
β’ Effect size measures [π 2 and adjusted π 2, Cohenβs π, odds ration, risk ratio]
β’ Inference using ensemble methods (random forests, EXTRA trees etc)β’ Breiman et al, assessing variable importance through out-of-bag error
β’ Also through the average impurity decrease
Inference
28
![Page 29: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/29.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
β’ Predict the new average behavioural indicator π¦ + Ξπ¦ from its current value, π¦, when the location characteristics change from π to π + Ξπ.β’ The βnewβ location is actually a modified version of the previous (change in
one LEC)
Prediction
29
![Page 30: Objective Monitoring of the Obesogenic Behaviour: From ...Β Β· Location unit is the geohash or region and is represented as a vector π= 1,β¦, π where each π is the value](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f277f21b1451a374f37aca9/html5/thumbnails/30.jpg)
Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece
Thank you!
Prof. Anastasios DelopoulosDept. of Electrical & Computer Engineering
Aristotle University of ThessalonikiGreece
Dr. Christos DiouDept. of Electrical & Computer Engineering
Aristotle University of ThessalonikiGreece