enhancing policy decision making with large-scale digital traces

40
Enhancing Policy Decision Making with Large-Scale Digital Traces Vanessa Frias-Martinez University of Maryland NFAIS, February 2014

Upload: chavi

Post on 13-Feb-2016

22 views

Category:

Documents


0 download

DESCRIPTION

Enhancing Policy Decision Making with Large-Scale Digital Traces. Vanessa Frias-Martinez University of Maryland NFAIS, February 2014. 5.9 billion 87%. 3.2 billion unique users 45%. mobile devices >>humans . Have you ever heard of DATIFICATION? 1. Yes - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Enhancing Policy Decision Making with Large-Scale Digital Traces

Vanessa Frias-MartinezUniversity of Maryland

NFAIS, February 2014

Page 2: Enhancing Policy Decision Making with Large-Scale  Digital Traces
Page 3: Enhancing Policy Decision Making with Large-Scale  Digital Traces
Page 4: Enhancing Policy Decision Making with Large-Scale  Digital Traces

5.9 billion 87%

3.2 billion unique users 45%

mobile devices >>humans

Page 5: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Have you ever heard of DATIFICATION?1. Yes2. No

Page 6: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Mobile Digital Footprints…

…for Social Good?

Page 7: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Research Goal

To extract human behavioral information from mobile digital traces in order to assist decision makers in organizations working for social development

Page 8: Enhancing Policy Decision Making with Large-Scale  Digital Traces

TOOLS

BEHAVIORAL INSIGHTS

Energy

RESEARCH DECISION MAKERS

Health

Education

Safety

Transportation

Interviews, surveys:

Information to assist on policy

decisions

Data MiningMachine LearningStatistical

MOBILE DIGITAL TRACES

To enhance or complement

information in an affordable manner

Page 9: Enhancing Policy Decision Making with Large-Scale  Digital Traces

OUTLINE

Page 10: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Outline

• Cell Phone Data

• Projects with Social Impact– Cencell– AlertImpact

Page 11: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Cell Phone Data

Page 12: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Call Detail Records

Anonymized

Granularity1-4km²

CDR: Caller | Callee | Date | Duration | Geolocation

Page 13: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Modeling Human Behavior

Consumption•Number calls, duration, frequency, SMS/MMS/voice•Expenses•Handset Type and Features

Social•Degree of the social network •Strength of the contacts (Reciprocity & Frequency)•Geography of the social contacts

Mobility•Mobility Patterns (Entropy)•Diameter of mobility•Radius of gyration (Home/Work)

Over 270 variables

Page 14: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Cost-Effective Census Maps From Cell Phone Data

CenCell

Page 15: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Motivation: Census Maps

A/BC+CDE

Page 16: Enhancing Policy Decision Making with Large-Scale  Digital Traces

National Statistical Institutes

A/BC+CDE

Page 17: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Important Data Comes at a Price

Expensive

Low resource regions

A/BC+CDE

Page 18: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Can the variables extracted from Call Detail Records be used as predictors of regional socioeconomic levels (SELs)?

Page 19: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Cost-effective Maps

NSI carries out surveys

Cell Phone Data

REDUCE COSTS

NSI surveys subset of regions

Forecasting Models

Predict the Present

Page 20: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Methodology

Page 21: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Classifying SELs - Training

Consumption

Social

Mobility

SEL

CLASSIFIER

Aggregated1-4km²

Page 22: Enhancing Policy Decision Making with Large-Scale  Digital Traces

SEL

Classifying SELs - Testing

CLASSIFIER

Consumption

Social

Mobility

Aggregated

Page 23: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Experimental Evaluation

Page 24: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Datasets

• Data for a city in Latin America (NSI)– 1200 regions (GUs)– SEL values from 0..100

• Call Detail Records– 6 months, 500K customers– City has 920 coverage areas– 279 variables per coverage area

Page 25: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Evaluation Results

Random Forests 86%3 SELs (A,B,C)

EM Clustering 68%6 SELs (A,B,…,F)

Page 26: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Human Behavior and

Census Variables

Page 27: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Large Scale Quantitative Analysis

Consumption

Social

Mobility

Page 28: Enhancing Policy Decision Making with Large-Scale  Digital Traces

InsightsConsumption Variables

Mobility Variables

Page 29: Enhancing Policy Decision Making with Large-Scale  Digital Traces

AlertImpact

Understanding the Impact of Health Alerts using Cell Phone Data

Page 30: Enhancing Policy Decision Making with Large-Scale  Digital Traces

H1N1 Mexico Timeline

PrefluClosing Schools

27th AprilReopen

6th May

Page 31: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Can we measure the impact that government alerts had on the mobility of the population ?

Page 32: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Evaluation

• Call Records from 1st Jan till 31st May 2009– Compute mobility as different number of BTSs visited

• Stages– Medical Alert - Stage 1 (17th-27th April)– Closing Schools - Stage 2 (28th-1st May)– Suspension of Essential Activities - Stage 3 (1st May-6th May)

• Baselines– same periods, different year (2008)

Page 33: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Changes in Mobility

April 27th May 1st May 6th

Alert Closed Shutdown Reopen

Baseline

Mobility reduced between 10% and 30%

Alert Closed Suspension Reopen

Page 34: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Changes in Epidemic Spreading

Baseline (“preflu” behavior all weeks)Intervention (alert,closed,shutdown)

Epidemic peak postponed 40 hours

Reduced number of infected in peak agents by 10%

BASELINEK

Page 35: Enhancing Policy Decision Making with Large-Scale  Digital Traces

University Campus

Statistically Significant Decrease during Stages 2 and 3

Page 36: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Airport

Statistically Significant Increase during Stages 2 and 3

Page 37: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Take Away Message

Page 38: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Take Away Message

• Geolocated traces allow us to quantitatively – Model human behavior– Measure behavioral changes– Predict/Classify external sources of information

Page 39: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Future

• Enhance and complement the tools currently used by decision makers in organizations working for social good

– Use of open datasets, social media and other digital traces

Page 40: Enhancing Policy Decision Making with Large-Scale  Digital Traces

Thanks !!

[email protected]