exploration of collective perception in the presence of ... · exploration of collective perception...

26
exploration of collective perception in the presence of lying agents January 3, 2019 Shubham Jain - Yasmina Benkhoui - Sanket Gujar Swarm Intelligence - Spring 2018

Upload: others

Post on 01-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

exploration of collective perception in thepresence of lying agents

January 3, 2019

Shubham Jain - Yasmina Benkhoui - Sanket GujarSwarm Intelligence - Spring 2018

Page 2: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

references

[1] Robust distributed decision-making in robot swarms: Exploiting athird truth state M Crosscombe, J Lawry, S Hauert, M Homer IEEE/RSJInternational Conference on Intelligent Robots and Systems (IROS)

[2] K. Saulnier, D. Saldana, A. Prorok, G. J. Pappas and V. Kumar,Resilient Flocking for Mobile Robot Teams, IEEE Robotics andAutomation Letters, Vol. 2, No. 2, pp. 1039-1046, April 2017.

1

Page 3: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

How can we achieve consensus in swarm inthe presence of lying individuals?

2

Page 4: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Environment

Figure: Environment

Each robot has ground sensor so it can read the color of the tilebeneath it. The robot also knows its position in the grid with the helpof position sensor.

3

Page 5: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Terminology

Templates - Patterns for which robot maintains a belief valueBelief vector - Has dimensions equal to number of templates andalways sums up to 1Messages - Robots broadcast their belief vectors to neighboursSensor update - Robot compares sensor value with template, addsnoise of 0.2 and makes update to beliefNeighbour update - Update using neighbour’s beliefs (Depends onalgorithm)

4

Page 6: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

First case study: Basic pattern recognition

The problem is calculating the probability of a certain pattern knowingthe position of the robot, their observation and the received messagesat a certain time t

p(y l |z1:t , x1:t , ml :t1:k)

y l l th patternxt Robot position at time tzt Robot’s observation at time tmt

k k th message received at time t

5

Page 7: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

First case study: Basic pattern recognition

Algorithm:We start with all the robots having equal beliefs about all the patterns.We update the beliefs as following:

CurrentBelief = OldBelief × MsgBrodcastNeigh

We normalize after each update

6

Page 8: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Results of the first case study

Figure: Initial state7

Page 9: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Results of the first case study

Figure: After two time-steps8

Page 10: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Results of the first case study

Figure: After six time-steps9

Page 11: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

First case study: Basic pattern recognition

ResultThe algorithm achieves consensus in 3 to 4 steps: all the robots agreeon the right pattern.

10

Page 12: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Lying Individual

But what will happen if we introduce a lying individuals to theswarm?

11

Page 13: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Lying Individual

Lying IndividualA lying individual is a robot broadcasting a false belief because it mayhave a bug or because it may be deliberately designed by a malicioushacker.For our case - Lying individual continuously transmits belief of 0 forright pattern

12

Page 14: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of introducing a lying individual

Figure: Initial State13

Page 15: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of introducing a lying individual

Figure: 3 steps after the introduction of a lying individual14

Page 16: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of introducing a lying individual

Figure: 4 steps after the introduction of a lying individual15

Page 17: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

2nd case study: Using Average Beliefs

Algorithm:We introduce a lying individual and we update the belief by using theaverage of neighbours beliefs:

CurrentBelief = OldBelief ×∑

NeighBeliefNumNeighb

16

Page 18: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of using average beliefs- Low range

Result: Depending on the range we specify, the robots converge on apattern or they do notRange = 1Average with low range

17

Page 19: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of using average beliefs- Medium range

Result: Depending on the range we specify, the robots converge on apattern or they do notRange = 2Average with medium range

18

Page 20: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Result of using average beliefs- High range

Result: Depending on the range we specify, the robots converge on apattern or they do notRange = 3Average with high range

19

Page 21: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

3rd Case study: Similarity Subsequence Reduced

Assumption - Number of lying individuals (n) is knownInspiration - Resilient Flocking [2] presented in classFor each robot, we calculate the cosine similarity of its belief vectorwith its neighbour

cosθi =∑

a × bi∥a∥ × ∥bi∥

Remove n neighbors having lowest similarity from neighbor’s list beforeperforming updateImprovement - Need to disregard only n neighbours instead of 2nneighbours as in [2]Video

20

Page 22: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Similarity Subsequence Reduced - Results

Figure: Varying number of liars with communication range fixed at 2 21

Page 23: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Similarity Subsequence Reduced - Results

Figure: Varying communication range with number of liars fixed at 4 22

Page 24: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Conclusion

3 different algorithms tried out for decentralized decision makingBasic Algorithm - Does not work at all with presence of lying robotsUsing averaged beliefs - Fails for high communication rangeSimilarity Subsequence reduced - More robust to changes incommunication range

Performed experiments with 20 trials each to explore effect of followingon SSR -

Number of lying robotsCommunication Range

We concluded that our Similarity Subsequence Reduced algorithm ismore robust than others and converges to the right pattern most often.

23

Page 25: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Future Work

More experiments to vary parameters like - Robot density, number oftemplates and difficulty of templatesExplore effect of robot position initialization in the pattern.We can try to not communicate during the initial time steps, lettingthe robots first build their belief and then start communicating.

24

Page 26: Exploration of Collective Perception in the presence of ... · exploration of collective perception in the presence of lying agents January3,2019 Shubham Jain - Yasmina Benkhoui -

Thank You

Questions?

25