attraction and avoidance detection from...
TRANSCRIPT
![Page 1: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/1.jpg)
Attraction and Avoidance Detection from Movements
Zhenhui Jessie Li (with Bolin Ding, Fei Wu, Tobias Lei, Roland Kays, Meg Crofoot)
Pennsylvania State University
VLDB Conference Hangzhou, China September, 2014
1
![Page 2: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/2.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Mining Mobility Relationship Problem
• Given two trajectories R and S, measure their relationship strength
2
R
Sr1
r2
r3
r4 r5 r6
s1
s2
s3s4
s5
s6
* assume synchronized sampling rate
![Page 3: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/3.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Using Trajectory Similarity as a Measure of Mobility Strength
3
R
Sr1
r2
r3
r4 r5 r6
s1
s2
s3s4
s5
s6
d
freq(R,S) =nX
i=1
⌧(ri, si).
Meeting (or co-locating) frequency
⌧(ri, sj) =
⇢1, |ri � sj | d;0, otherwise.
Vlachos et al., Discovering similar multidimensional trajectories. ICDE’02 Chen et al., Robust and fast similarity search for moving object trajectories. SIGMOD’05 Jeung et al., Discovery of convoys in trajectory database. VLDB’08 Li et al., Mining relaxed temporal moving object clusters. VLDB’10
![Page 4: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/4.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Meeting Frequency = Relationship Strength?
4
the more frequently you co-locate with another person,
the stronger the mobility relationship is.
less frequently
weaker
![Page 5: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/5.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Meeting Frequency = Relationship Strength?
5
Example 1. A and B are friends living in different cities attracted to meet Freq(A, B) = 2
Example 2. A and C are colleagues working in the same building avoid meeting Freq(A, C) = 20
Meeting Frequency ≠ Relationship Strength
![Page 6: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/6.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Consider Mobility Background to Infer Relationship
6
Example 1. A and B are friends living in different cities attracted to meet Freq(A, B) = 2
Example 2. A and C are colleagues working in the same building avoid meeting Freq(A, C) = 20
Mobility background
Expect(A, B) = 1 Expect(A, C) = 100
![Page 7: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/7.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
What happened vs. What is expected to happen
7
Example 1. Freq(A, B) = 2 Expect(A, B) = 1
Example 2. Freq(A, C) = 20 Expect(A, C) = 100
What happened? What is expected?
![Page 8: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/8.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
What happened vs. What is expected to happen
8
Example 1. Freq(A, B) = 2 Expect(A, B) = 1
Example 2. Freq(A, C) = 20 Expect(A, C) = 100
What happened? What is expected?
larger than smaller than
Attraction Avoidance How to estimate what is expected?
![Page 9: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/9.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
How to Estimate Expectation?
• Null hypothesis: Two movement sequences R and S are independent.
• If we randomly shuffle the sequences,
• the meeting frequency should remain the same
9
R ! �(R) S ! �(S)
freq(R,S) ⇡ freq(�(R),�(S))
Pr(freq(�(R),�(S) = y)) = Pr(freq(R,�(S) = y))
Shuffling two sequences = Shuffling one sequence
![Page 10: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/10.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Permutation Test to Estimate the Probabilistic Background Model
10
r1 r2 r3 r4 r5
s1 s2 s3 s4 s5
R
S
If we randomly shuffle the sequence …
freq(R,S) = 2
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
r1 r2 r3 r4 r5
s5 s1 s3 s4 s2
R
σ(S)
freq(R,�(S)) = 0
![Page 11: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/11.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Permutation Test to Estimate the Probabilistic Background Model
11
r1 r2 r3 r4 r5
s1 s2 s3 s4 s5
R
S
r1 r2 r3 r4 r5
s4 s2 s3 s1 s5
R
σ(S)
If we randomly shuffle the sequence …
freq(R,S) = 2
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
freq(R,�(S)) = 1
![Page 12: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/12.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Permutation Test to Estimate the Probabilistic Background Model
12
…. n! permutations
….
freq(R, σ(S))
count
generate histogram
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
![Page 13: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/13.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
13 freq(R, σ(S))
count
generate histogram
Actual frequency
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
Expected frequency
…. n! permutations
….
![Page 14: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/14.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
14 freq(R, σ(S))
count
generate histogram
Actual frequency
95% area
Attraction relationship: 95% significance
Expected frequency
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
…. n! permutations
….
![Page 15: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/15.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
15 freq(R, σ(S))
count
generate histogram
Actual frequency
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
Expected frequency
…. n! permutations
….
![Page 16: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/16.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
16
generate histogram
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
freq(R, σ(S))
count Actual frequency
Expected frequency
98% area
Avoidance relationship: 98% significance
…. n! permutations
….
![Page 17: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/17.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
17
…. n! permutations
….
freq(R, σ(S))
count
generate histogram
avoid attract
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
Expected frequency
![Page 18: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/18.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Compute Degree of the Relationship
18
freq(R, σ(S))
avoid attract
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
Expected frequency
sigattract(R,S) = Pr[freq(R,S) > freq(R,�(S))]
sigavoid
(R,S) = Pr[freq(R,S) < freq(R,�(S))]
significant significant
![Page 19: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/19.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Monte Carlo Scheme to Approximate Degree
• The total number of permutations is factorial n! • Monte Carlo scheme: sample N permutations
19
N � 4
✏2⇢ln
2
�
(1� ✏)⇢ ⇢̂ (1 + ✏)⇢
with probability 1� �
guarantee
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
![Page 20: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/20.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Experiment on the Monkey dataset
20
12 monkeys 11/10/2004 – 04/18/2005
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95
Red: significant avoidance Green: significant attraction
![Page 21: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/21.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Experiment on the Monkey dataset
21
12 monkeys 11/10/2004 – 04/18/2005
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95
Red: significant avoidance Green: significant attraction
![Page 22: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/22.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Experiment on the Monkey dataset
22
12 monkeys 11/10/2004 – 04/18/2005
Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95
Red: significant avoidance Green: significant attraction
![Page 23: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/23.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Comparison with Previous Measures
23 Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)
attract
avoid
![Page 24: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui](https://reader033.vdocuments.us/reader033/viewer/2022051607/603954efcada891514174f07/html5/thumbnails/24.jpg)
Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements
Summary and Future Work
• Summary: Important to consider background – What happened vs. What is expected to happen – Consider mobility background using permutation test
• Permutation test is one way, but not the only way to consider background context – How to deal with “impossible” trajectory? – How to deal with sparse observations?
• Rich spatial and temporal context – location semantics – social events
24
Thanks! Questions?