megavis: perceptual decisions in the face of explicit costs and benefits

53
MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits Michael S. Landy Julia Trommershäuser Laurence T. Maloney Ross Goutcher Pascal Mamassian

Upload: nida

Post on 23-Mar-2016

22 views

Category:

Documents


0 download

DESCRIPTION

MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits. Ross Goutcher Pascal Mamassian. Michael S. Landy Julia Trommersh ä user Laurence T. Maloney. Statistical/Optimal Models in Vision & Action. Sequential Ideal Observer Analysis Statistical Models of Cue Combination - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

MEGaVis: Perceptual Decisions in the Face of Explicit Costs and

Benefits

Michael S. Landy

Julia Trommershäuser

Laurence T. Maloney

Ross Goutcher

Pascal Mamassian

Page 2: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Statistical/Optimal Modelsin Vision & Action

• Sequential Ideal Observer Analysis• Statistical Models of Cue Combination• Statistical Models of Movement Planning

and Control– Minimum variance movement planning/control– MEGaMove – Maximum Expected Gain model

for Movement planning

Page 3: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Statistical/Optimal Modelsin Vision & Action

• MEGaMove – Maximum Expected Gain model for Movement planning– A choice of movement plan fixes the

probabilities pi of each possible outcome i with gain Gi

– The resulting expected gain EG=p1G1+p2G2+…– A movement plan is chosen to maximize EG– Uncertainty of outcome is due to both

perceptual and motor variability– Subjects are typically optimal for pointing tasks

Page 4: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Statistical/Optimal Modelsin Vision & Action

• MEGaMove – Maximum Expected Gain model for Movement planning

• MEGaVis – Maximum Expected Gain model for Visual estimation– Task: Orientation estimation, method of

adjustment– Do subjects remain optimal when motor

variability is minimized?– Do subjects remain optimal when visual

reliability is manipulated?

Page 5: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 6: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 7: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Payoff(100 points)

Penalty(0, -100 or-500 points, in separate blocks)

Page 8: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Payoff(100 points)

Penalty(0, -100 or-500 points, in separate blocks)

Page 9: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 10: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 11: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 12: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 13: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 14: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 15: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 16: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 17: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Done!

Page 18: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 19: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

Page 20: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

100

Page 21: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

-400

Page 22: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

-500

Page 23: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation

• Align the white arcs with the remembered mean orientation to earn points

• Avoid alignment with the black arcs to avoid the penalty

• Feedback provided as to whether the payoff, penalty, both or neither were awarded

Page 24: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Task – Orientation Estimation• Three levels of orientation variability

– Von Mises κ values of 500, 50 and 5– Corresponding standard deviations of 2.6, 8 and

27 deg• Two spatial configurations of white target

arc and black penalty arc (abutting or half overlapped)

• Three penalty levels: 0, 100 and 500 points• One payoff level: 100 points

Page 25: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Stimulus – Orientation Variability

κ = 500, σ = 2.6 deg

Page 26: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Stimulus – Orientation Variability

κ = 50, σ = 8 deg

Page 27: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Stimulus – Orientation Variability

κ = 5, σ = 27 deg

Page 28: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Payoff/Penalty Configurations

Page 29: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Payoff/Penalty Configurations

Page 30: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Payoff/Penalty Configurations

Page 31: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Payoff/Penalty Configurations

Page 32: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Where should you “aim”?Penalty = 0 case

Payoff(100 points)

Penalty(0 points)

Page 33: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Where should you “aim”?Penalty = -100 case

Payoff(100 points)

Penalty(-100 points)

Page 34: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Where should you “aim”?Penalty = -500 case

Payoff(100 points)

Penalty(-500 points)

Page 35: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Where should you “aim”?Penalty = -500, overlapped penalty case

Payoff(100 points)

Penalty(-500 points)

Page 36: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Where should you “aim”?Penalty = -500, overlapped penalty,

high image noise case

Payoff(100 points)

Penalty(-500 points)

Page 37: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Variability

Page 38: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Setting Shifts (HB)

Page 39: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Score (HB)

Page 40: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Setting Shifts (MSL)

Page 41: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Score (MSL)

Page 42: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Setting Shifts(3 more subjects)

Page 43: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 – Score(3 more subjects)

Page 44: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 1 - Efficiency

Page 45: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Intermediate Conclusions

• Subjects are by and large near-optimal in this task• That means they take into account their own

variability in each condition as well as the penalty level and payoff/penalty configuration

• Can they respond to changing variability on a trial-by-trial basis?

• → Re-run using a mixed-list design (all noise levels mixed together in a block; only penalty level is blocked)

Page 46: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Setting Shifts (HB)

Page 47: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Score (HB)

Page 48: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Setting Shifts (MSL)

Page 49: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Score (MSL)

Page 50: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Setting Shifts(2 more subjects)

Page 51: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 – Score(2 more subjects)

Page 52: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Experiment 2 - Efficiency

Page 53: MEGaVis: Perceptual Decisions in the Face of Explicit Costs and Benefits

Conclusion• Subjects are nearly optimal in all conditions• Thus, effectively they are able to calculate

and maximize effective gain across a variety of target/penalty configurations, penalty values and stimulus uncertainties

• The main sub-optimality is an unwillingness to “aim” outside of the target

• This is “risk-seeking” behavior, unlike what is seen in paper-and-pencil decision tasks