a generic framework for spatial crowdsourcinghto/resources/qinf15_presentation... · crowdsourcing...

11
A Generic Framework for Spatial Crowdsourcing QInF 2015 Presentation Students: Hien To Email: [email protected] Website: http://www-scf.usc.edu/~hto Giorgos Constantinou Email: [email protected] Website: http://www-scf.usc.edu/~gconstan Advisor: Prof. Cyrus Shahabi Email: [email protected] Website: http://infolab.usc.edu/Shahabi

Upload: others

Post on 25-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

A Generic Framework for Spatial

Crowdsourcing

QInF 2015 Presentation

Students: Hien To Email: [email protected] Website: http://www-scf.usc.edu/~hto

Giorgos Constantinou Email: [email protected] Website: http://www-scf.usc.edu/~gconstan

Advisor: Prof. Cyrus Shahabi Email: [email protected] Website: http://infolab.usc.edu/Shahabi

Page 2: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Spatial Crowdsourcing

3/3/2015 A Generic Framework for Spatial Crowdsourcing 2

[1] http://www.gartner.com/newsroom/id/2665715

Spatial crowdsourcing (SC): requires workers to physically travel at the task's location in order to execute the task.

Crowdsourcing: outsourcing a set of tasks to a set of workers.

SC Applications

Ubiquity of mobile

users

6.5 billion mobile subscriptions, 93.5% of the world population [1]

Technology advances

on mobiles

Smartphone's sensors. e.g., video cameras

Network bandwidth

improvements

From 2.5G (up to 384Kbps) to 3G (up to 14.7Mbps) and recently 4G (up to 100 Mbps)

task

Page 3: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

MediaQ Demo

3/3/2015 A Generic Framework for Spatial Crowdsourcing 3

http://mediaq.usc.edu/

MediaQ helped PBS cover the Presidential Inauguration on Jan. 20, 2013

[Kim et.al MMSys’14]

Page 4: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Task Assignment

3/3/2015 A Generic Framework for Spatial Crowdsourcing 4

v1

v2

v3

v4

v5

v6

v7

v8

v9

v10

v11

v12

v13

1

1111

111

1

src dest

2

3

4

11

1111

1111

t

5

4

t

t

9

t 3

t

t

8

10

t

6

R1

w1

w2

w3

maxT1=2

R2

maxT2=3

R3

maxT3=4

SC-server t1 t2 t7

One time snapshot

[Kazemi et.al ACM GIS’12]

Requesters

Maximum task assignment is reducible to max-flow problem

Page 5: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Challenges of Task-assignment

• Dynamism Tasks/workers arrive without our knowledge

3/3/2015 A Generic Framework for Spatial Crowdsourcing 5

• Location Privacy Adversary can infer workers’ sensitive details

• Trust Workers cannot always be trusted, i.e., malicious/spam users

Page 6: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

USC

Dynamic Task Assignment

• Learn worker distribution Prefer tasks in worker-sparse areas

Prefer nearby workers

3/3/2015 A Generic Framework for Spatial Crowdsourcing 6

Submitted to [VLDB’15]

• Local task assignment at every time snapshot

[To et.al TSAS’15]

[Kazemi et.al ACM GIS’12]

• Learn activity patterns Defer tasks arriving in uphill periods

From [Musthag et.al CHI’13]

Page 7: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Worker Location Privacy

• Objectives Assign tasks to workers without knowing workers’ locations

Ensure tasks will be performed, with high probability

3/3/2015 A Generic Framework for Spatial Crowdsourcing 7

~0 ~3 ~3 ~2

~4 ~7 ~6 ~3

~4 ~5 ~2 ~3 ~1

~2 ~0 ~0 ~0 ~6

~3 ~0 ~0

Noisy worker count per grid cell

[To et.al VLDB’14]

[To et.al ICDE’15]

• Differential Privacy Preserve privacy of individual workers

• Solutions Assign every task to all workers

Does not scale!

Assign tasks to sufficient nearby workers

• The first privacy study in spatial crowdsourcing!

task

Page 8: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Trustfulness of Workers • Non-spatial metrics

Rating

# of transactions

Fast response time

Quality of work

3/3/2015 A Generic Framework for Spatial Crowdsourcing 8

3 miles

1 mile

task

3$

3$

t1

t2 3$ t3

2 miles 2 miles

• Use reputation-based trust

To maximize the quality of the result in task assignment

To direct requesters to “trusted” areas in task posting

• Spatial metrics

Distance traveled

Spatial coverage

Page 9: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Proposed Framework & Execution Plan • Develop a generic spatial crowdsourcing architecture to ease the

development of SC applications.

3/3/2015 A Generic Framework for Spatial Crowdsourcing 9

PhasesPPhasedd Phases 2015 2016 2017 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2

A1B1

A2B2

A3

B3

A4B4

A5B5

A6B6

Page 10: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Evaluation

3/3/2015 A Generic Framework for Spatial Crowdsourcing 11

• Use real data workload and generate synthetic data

e.g. Gowalla, Yelp, Foursquare

• Build real systems, e.g., MediaQ, iRain Organize events at USC to collect SC data Deploy on cloud and monitor workload and system behavior Get feedback via academic collaboration

• Publish framework as an open source project

e.g. github

Page 11: A Generic Framework for Spatial Crowdsourcinghto/resources/QInF15_Presentation... · crowdsourcing •Completed a summer intern at Amazon in 2014 •Fulbright fellow 3/3/2015 A Generic

Team

George Constantinou (1st year PhD student) •His research focuses on trustfulness in spatial

crowdsourcing •Completed a summer intern at Amazon in 2014 • Fulbright fellow

3/3/2015 A Generic Framework for Spatial Crowdsourcing 12

Prof. Cyrus Shahabi (advisor) •Pioneered spatial crowdsourcing •Director of InfoLab; an active research

group in spatial crowdsourcing

• Partnership/Research Accomplishments SC for collecting media content: MediaQ (since 2012) SC for collecting weather information: iRain (since 2014) Experience in developing mobile platforms

Hien To (4th year PhD student) •Research on scalability/privacy of task assignment •Published papers in prestigious database

conferences, e.g., ICDE, VLDB, CIKM •Completed two summer interns at Teradata in

2012 and 2014

The Wiley-AAG International Encyclopedia of Geography