advanced mechanism design - cs.ubc.ca

36
Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics Advanced Mechanism Design Lecture 17 Advanced Mechanism Design Lecture 17, Slide 1

Upload: others

Post on 25-Apr-2022

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Advanced Mechanism Design

Lecture 17

Advanced Mechanism Design Lecture 17, Slide 1

Page 2: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Lecture Overview

1 Recap

2 VCG caveats

3 AGV

4 Dominant Strategy Implementation

5 Further MD topics

Advanced Mechanism Design Lecture 17, Slide 2

Page 3: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

VCG

Definition (VCG mechanism)

x (v̂) = arg maxx

∑i

v̂i(x)

pi(v̂) =∑j 6=i

v̂j (x (v̂−i))−∑j 6=i

v̂j(x (v̂))

You get paid everyone’s utility under the allocation that isactually chosen

except your own, but you get that directly as utility

Then you get charged everyone’s utility in the world whereyou don’t participate

Thus you pay your social cost

Advanced Mechanism Design Lecture 17, Slide 3

Page 4: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

VCG and Individual Rationality

Definition (Choice-set monotonicity)

An environment exhibits choice-set monotonicity if ∀i, X−i ⊆ X.

Definition (No negative externalities)

An environment exhibits no negative externalities if∀i∀x ∈ X−i, vi(x) ≥ 0.

Theorem

The VCG mechanism is ex-post individual rational when the choiceset monotonicity and no negative externalities properties hold.

Advanced Mechanism Design Lecture 17, Slide 4

Page 5: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

VCG and Budget Balance

Definition (No single-agent effect)

An environment exhibits no single-agent effect if ∀i, ∀v−i,∀x ∈ arg maxy

∑j vj(y) there exists a choice x′ that is feasible

without i and that has∑

j 6=i vj(x′) ≥∑j 6=i vj(x).

Theorem

The VCG mechanism is weakly budget-balanced when the nosingle-agent effect property holds.

Advanced Mechanism Design Lecture 17, Slide 5

Page 6: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

More good news

Theorem (Krishna & Perry, 1998)

In any Bayesian game setting in which VCG is ex post individuallyrational, VCG collects at least as much revenue as any otherefficient and ex interim individually-rational mechanism.

This is somewhat surprising: does not require dominantstrategies, and hence compares VCG to all Bayes–Nashmechanisms.

A useful corollary: VCG is as budget balanced as any efficientmechanism can be

it satisfies weak budget balance in every case where anydominant strategy, efficient and ex interim IR mechanismwould be able to do so.

Advanced Mechanism Design Lecture 17, Slide 6

Page 7: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Bad news

Theorem (Green–Laffont; Hurwicz)

No dominant-strategy incentive-compatible mechanism is alwaysboth efficient and weakly budget balanced, even if agents arerestricted to the simple exchange setting.

Theorem (Myerson–Satterthwaite)

No Bayes-Nash incentive-compatible mechanism is alwayssimultaneously efficient, weakly budget balanced and ex-interimindividual rational, even if agents are restricted to quasilinearutility functions.

Advanced Mechanism Design Lecture 17, Slide 7

Page 8: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Lecture Overview

1 Recap

2 VCG caveats

3 AGV

4 Dominant Strategy Implementation

5 Further MD topics

Advanced Mechanism Design Lecture 17, Slide 8

Page 9: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

1. Privacy

VCG requires agents to fully reveal their private information

this private information may have value to agents that extendsbeyond the current interaction

for example, the agents may know that they will compete witheach other again in the future

it is often preferable to elicit only as much information fromagents as is required to determine the social welfaremaximizing choice and compute the VCG payments.

Advanced Mechanism Design Lecture 17, Slide 9

Page 10: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

2. Susceptibility to Collusion

Example

Agent U(build road) U(do not build road) Payment

1 200 0 1502 100 0 503 0 250 0

What happens if agents 1 and 2 both increase their declaredvaluations by $50?

The choice is unchanged, but both of their payments arereduced.

Thus, while no agent can gain by changing his declaration,groups can.

Advanced Mechanism Design Lecture 17, Slide 10

Page 11: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

2. Susceptibility to Collusion

Example

Agent U(build road) U(do not build road) Payment

1 250 02 150 03 0 250 0

What happens if agents 1 and 2 both increase their declaredvaluations by $50?

The choice is unchanged, but both of their payments arereduced.

Thus, while no agent can gain by changing his declaration,groups can.

Advanced Mechanism Design Lecture 17, Slide 10

Page 12: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

2. Susceptibility to Collusion

Example

Agent U(build road) U(do not build road) Payment

1 250 0 1002 150 0 03 0 250 0

What happens if agents 1 and 2 both increase their declaredvaluations by $50?

The choice is unchanged, but both of their payments arereduced.

Thus, while no agent can gain by changing his declaration,groups can.

Advanced Mechanism Design Lecture 17, Slide 10

Page 13: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

3. VCG is not Frugal

212 8 Protocols for Strategic Agents: Mechanism Design

First, note that because the Clarke tax does not depend on an agenti’s own declara-tion v̂i, our previous arguments that Groves mechanisms are dominant strategy truthfuland efficient transfer immediately to the VCG mechanism. Now, we’ll try to providesome intuition about the VCG payment rule. Assume that all agents follow their dom-inant strategies and declare their valuations truthfully.The second sum in the VCGpayment rule pays each agenti the sum of every other agentj 6= i’s utility for themechanism’s choice. The first sum charges each agenti the sum of every other agent’sutility for the choice thatwould have been madehadi not participated in the mecha-nism. Thus, each agent is made to pay hissocial cost—the aggregate impact that hisparticipation has on other agents’ utilities.

What can we say about the amounts of different agents’ payments to the mechanism?If some agenti does not change the mechanism’s choice by his participation—that is,if x (v) = x (v−i)—then the two sums in the VCG payment function will cancel out.The social cost ofi’s participation is zero, and so he has to pay nothing. In order foran agenti to be made to pay a nonzero amount, he must bepivotal in the sense thatthe mechanism’s choicex (v) is different from its choice withouti, x (v−i). This iswhy VCG is sometimes called the pivot mechanism—only pivotalagents are made topay. Of course, it’s possible that some agents willimproveother agents’ utility byparticipating; such agents will be made to pay a negative amount, or in other wordswill be paid by the mechanism.

Let’s see an example of how the VCG mechanism works. Recall that Section 8.1.2discussed the problem of selfish routing in a transportationnetwork. We’ll now recon-sider that example, and determine what route and what payments the VCG mechanismwould select. For convenience, we reproduce Figure 8.1 as Figure 8.4, and label thenodes so that we have names to refer to the agents (the edges).

n n

n n

n n3

2

3

2

1

5

2

1

A F

C E

B D

��

���

@@

@@R

-

@@

@@

@@

@@

@@R

1

-

@@

@@R

��

���

Figure 8.4 Transportation network with selfish agents.

c©Shoham and Leyton-Brown, 2006VCG can end up paying arbitrarily more than an agent iswilling to accept (or equivalently charging arbitrarily less thanan agent is willing to pay)Consider AC, which is not part of the shortest path.

If the cost of this edge increased to 8, our payment to ABwould increase to pAB = (−12)− (−2) = −10.If the cost were any x ≥ 2, we would select the path ABEFand would have to make a payment to AB ofpAB = (−4− x)− (−2) = −(x+ 2).The gap between agents’ true costs and the payments thatthey could receive under VCG is unbounded.

Advanced Mechanism Design Lecture 17, Slide 11

Page 14: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

3. VCG is not Frugal

Are VCG’s payments at least close to the cost of the secondshortest disjoint path?286 10 Protocols for Strategic Agents: Mechanism Design

s 1 2 k − 2 k − 1 t· · ·ck

ck

ck

ck

ck

ck

c(1 + ε)

Figure 10.5: A transportation network example for which VCG’s payments are noteven close to the cost of the second disjoint path.

4. Dropping bidders can increase revenue

Now we will considerrevenue monotonicity: the property that a mechanism’s revenuerevenuemonotonicity always weakly increases as agents are added to the mechanism. Although it may seem

intuitive that having more agents should never mean less revenue, in fact VCG doesnot satisfy this property. To see why, let us return to the road-building example.

Agent U(build road) U(do not build road) Payment

1 0 90 02 100 0 90

Table 10.3: Valuations for agents in the road-building referendum example.

Agent U(build road) U(do not build road) Payment

1 0 90 02 100 0 03 100 0 0

Table 10.4: Adding agent 3 causes VCG to select the same choice but to collect zerorevenue.

Consider the new valuations given in Table 10.3. Observe that the social-welfare-maximizing choice is to build the road. Agent 2 is pivotal andso would be made topay 90, his social cost. Now see what happens when we add a third agent, as shownin Table 10.4. Again, VCG would decide that the road should bebuilt. However,since in this second case the choice does not change wheneither winning agent isdropped, neither of them is made to pay anything, and so the mechanism collects zerorevenue. Observe that the road-building referendum problem satisfies the “no single-agent effect” property; thus revenue monotonicity can faileven when the mechanismis guaranteed to be weakly budget balanced.

The fact that VCG is not revenue monotonic can also be understood as a strategicopportunity for agent 2, in the setting where agent 3 does notexist. Specifically, agent

c© Shoham and Leyton-Brown, 2008

The top path has a total cost of c.

VCG picks it, pays each of the k agents c(1 + ε)− (k − 1) ck .

Hence VCG’s total payment is c(1 + kε).

For fixed ε, VCG’s payment is Θ(k) times the cost of thesecond shortest disjoint path.

Advanced Mechanism Design Lecture 17, Slide 12

Page 15: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

4. Revenue Monotonicity Violated

Revenue monotonicity: revenue always weakly increases as agentsare added.

Example

Agent U(build road) U(do not build road) Payment

1 0 90 02 100 0 90

Advanced Mechanism Design Lecture 17, Slide 13

Page 16: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

4. Revenue Monotonicity Violated

Revenue monotonicity: revenue always weakly increases as agentsare added.

Example

Agent U(build road) U(do not build road) Payment

1 0 90 02 100 0 03 100 0 0

Advanced Mechanism Design Lecture 17, Slide 13

Page 17: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

4. Revenue Monotonicity Violated

Revenue monotonicity: revenue always weakly increases as agentsare added.

Example

Agent U(build road) U(do not build road) Payment

1 0 90 02 100 0 03 100 0 0

Adding agent 3 causes VCG to pick the same choice but tocollect zero revenue!

Agent 2 could pretend to be two agents and eliminate hispayment.

Advanced Mechanism Design Lecture 17, Slide 13

Page 18: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

5. Cannot Return All Revenue to Agents

we may want to use VCG to induce agents to report theirvaluations honestly, but may not want to make a profit bycollecting money from the agents.

Thus, we might want to find some way of returning themechanism’s profits back the agents.

However, the possibility of receiving a rebate after themechanism has been run changes the agents’ incentives.

In fact, even if profits are given to a charity that the agentscare about, or spent in a way that benefits the local economyand hence benefits the agents, the VCG mechanism isundermined.

It is possible to return at least some of the revenues to theagents, but it must be done very carefully, and in general notall the money can be returned.

Advanced Mechanism Design Lecture 17, Slide 14

Page 19: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Lecture Overview

1 Recap

2 VCG caveats

3 AGV

4 Dominant Strategy Implementation

5 Further MD topics

Advanced Mechanism Design Lecture 17, Slide 15

Page 20: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

AGV Mechanism

AGV is efficient, strictly budget balanced, but gives updominant strategies and trades ex post for ex ante individualrationality.

Explained in detail in the book, but the highlights:

allocation rule is the same as Groveseach agent i paid the expected utility of the other agents

based on the type distribution, not others’ declarations

each agent charged 1n−1 of the payments made to the other

agents

Advanced Mechanism Design Lecture 17, Slide 16

Page 21: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Lecture Overview

1 Recap

2 VCG caveats

3 AGV

4 Dominant Strategy Implementation

5 Further MD topics

Advanced Mechanism Design Lecture 17, Slide 17

Page 22: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Besides VCG, what DS mechanisms can we build?

Let Xi(v̂−i) ⊆ X denote the set of choices that can be selected bythe choice rule x given the declaration v̂−i by the agents otherthan i (i.e., the range of x (·, v̂−i)).

Theorem

A deterministic mechanism is dominant-strategy truthful if andonly if, for every i ∈ N and every v̂−i ∈ V−i:

1 The payment function pi(v̂) can be written as pi(v̂−i, x (v̂));

2 ∀vi ∈ Vi, x (vi, v̂−i) ∈ arg maxx∈Xi(v̂−i)(vi(x)− pi(v̂−i, x)).

an agent’s payment can only depend on other agents’declarations and the selected choice

it cannot depend otherwise on the agent’s own declaration.

taking the other agent’s declarations and the paymentfunction into account, from every player’s point of view themechanism selects the most preferable choice.

Advanced Mechanism Design Lecture 17, Slide 18

Page 23: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Which Choice Rules can be Implemented?

Definition (Affine maximizer)

A social choice function is an affine maximizer if it has the form

arg maxx∈X

(γx +

∑i∈N

wivi(x)),

where each γx is an arbitrary constant (may be −∞) and eachwi ∈ R+.

Theorem (Roberts)

If there are at least three choices that a social choice function willchoose given some input, and if agents have general quasilinearpreferences, then the set of (deterministic) social choice functionsimplementable in dominant strategies is precisely the set of affinemaximizers.

In the case of general quasilinear preferences (i.e., when each agentcan have any valuation for each choice x ∈ X) and where thechoice function selects from more than two alternatives, affinemaximizers turn out to be the only social choice functionsimplementable in dominant strategies.

Advanced Mechanism Design Lecture 17, Slide 19

Page 24: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Understanding Roberts

In the case of general quasilinear preferences (i.e., when eachagent can have any valuation for each choice x ∈ X) andwhere the choice function selects from more than twoalternatives, affine maximizers are the only DS-implementablesocial choice functions.

Efficiency is an affine-maximizing social choice function forwhich ∀x ∈ X, γx = 0 and ∀i ∈ N,wi = 1.

Affine maximizing mechanisms are weighted Grovesmechanisms

They transform both the choices and the agents’ valuations byapplying linear weights, then effectively run a Grovesmechanism in the transformed space

Thus, we cannot stray very far from Groves mechanisms evenif we give up on efficiency

It is possible to implement a richer set of functions whenagents’ preferences are restricted further

Advanced Mechanism Design Lecture 17, Slide 20

Page 25: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Understanding Roberts

In the case of general quasilinear preferences (i.e., when eachagent can have any valuation for each choice x ∈ X) andwhere the choice function selects from more than twoalternatives, affine maximizers are the only DS-implementablesocial choice functions.

Efficiency is an affine-maximizing social choice function forwhich ∀x ∈ X, γx = 0 and ∀i ∈ N,wi = 1.

Affine maximizing mechanisms are weighted Grovesmechanisms

They transform both the choices and the agents’ valuations byapplying linear weights, then effectively run a Grovesmechanism in the transformed space

Thus, we cannot stray very far from Groves mechanisms evenif we give up on efficiency

It is possible to implement a richer set of functions whenagents’ preferences are restricted further

Advanced Mechanism Design Lecture 17, Slide 20

Page 26: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Understanding Roberts

In the case of general quasilinear preferences (i.e., when eachagent can have any valuation for each choice x ∈ X) andwhere the choice function selects from more than twoalternatives, affine maximizers are the only DS-implementablesocial choice functions.

Efficiency is an affine-maximizing social choice function forwhich ∀x ∈ X, γx = 0 and ∀i ∈ N,wi = 1.

Affine maximizing mechanisms are weighted Grovesmechanisms

They transform both the choices and the agents’ valuations byapplying linear weights, then effectively run a Grovesmechanism in the transformed space

Thus, we cannot stray very far from Groves mechanisms evenif we give up on efficiency

It is possible to implement a richer set of functions whenagents’ preferences are restricted further

Advanced Mechanism Design Lecture 17, Slide 20

Page 27: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Lecture Overview

1 Recap

2 VCG caveats

3 AGV

4 Dominant Strategy Implementation

5 Further MD topics

Advanced Mechanism Design Lecture 17, Slide 21

Page 28: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Computational applications of mechanism design

1 Task scheduling

allocate tasks among agents to minimize makespan

2 Bandwidth allocation in computer networks

allocate the real-valued capacity of a single network linkamong users with different demand curves

3 Multicast cost sharing

share the cost of a multicast transmission among the userswho receive it

4 Two-sided matching

pair up members of two groups according to their preferences,without imposing any paymentse.g., students and advisors; hospitals and interns; kidneydonors and recipients

Advanced Mechanism Design Lecture 17, Slide 22

Page 29: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Computational applications of mechanism design

1 Task scheduling

allocate tasks among agents to minimize makespan

2 Bandwidth allocation in computer networks

allocate the real-valued capacity of a single network linkamong users with different demand curves

3 Multicast cost sharing

share the cost of a multicast transmission among the userswho receive it

4 Two-sided matching

pair up members of two groups according to their preferences,without imposing any paymentse.g., students and advisors; hospitals and interns; kidneydonors and recipients

Advanced Mechanism Design Lecture 17, Slide 22

Page 30: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Computational applications of mechanism design

1 Task scheduling

allocate tasks among agents to minimize makespan

2 Bandwidth allocation in computer networks

allocate the real-valued capacity of a single network linkamong users with different demand curves

3 Multicast cost sharing

share the cost of a multicast transmission among the userswho receive it

4 Two-sided matching

pair up members of two groups according to their preferences,without imposing any paymentse.g., students and advisors; hospitals and interns; kidneydonors and recipients

Advanced Mechanism Design Lecture 17, Slide 22

Page 31: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Computational applications of mechanism design

1 Task scheduling

allocate tasks among agents to minimize makespan

2 Bandwidth allocation in computer networks

allocate the real-valued capacity of a single network linkamong users with different demand curves

3 Multicast cost sharing

share the cost of a multicast transmission among the userswho receive it

4 Two-sided matching

pair up members of two groups according to their preferences,without imposing any paymentse.g., students and advisors; hospitals and interns; kidneydonors and recipients

Advanced Mechanism Design Lecture 17, Slide 22

Page 32: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Constrained Mechanism Design

Imagine that the mechanism designer isn’t allowed to change theagents’ strategy spaces or utility functions.

e.g., improve traffic flow without building new roads or closingexisting ones

e.g., broker peace between two warring countries withoutchanging their military capabilities

Advanced Mechanism Design Lecture 17, Slide 23

Page 33: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Constrained Mechanism Design

Imagine that the mechanism designer isn’t allowed to change theagents’ strategy spaces or utility functions.

What can be done in such settings?

1 Contracts

2 Bribes

3 Mediators

Advanced Mechanism Design Lecture 17, Slide 23

Page 34: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Constrained Mechanism Design

Imagine that the mechanism designer isn’t allowed to change theagents’ strategy spaces or utility functions.

What can be done in such settings?1 Contracts

agents agree to a contract before playing the gameif anyone deviates, he is punishedfolk-theorem-like result: can implement any social choicefunction that the agents prefer to the punishment

2 Bribes

3 Mediators

Advanced Mechanism Design Lecture 17, Slide 23

Page 35: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Constrained Mechanism Design

Imagine that the mechanism designer isn’t allowed to change theagents’ strategy spaces or utility functions.

What can be done in such settings?

1 Contracts2 Bribes

promise to pay agents if a given joint outcome is reachedthese promises can change the game’s payoffs so that agentshave dominant strategiesany Nash equilibrium can be transformed into a dominantstrategy equilibrium in this way, and the mechanism designerdoes not even have to pay the agents anything in equilibrium!

3 Mediators

Advanced Mechanism Design Lecture 17, Slide 23

Page 36: Advanced Mechanism Design - cs.ubc.ca

Recap VCG caveats AGV Dominant Strategy Implementation Further MD topics

Constrained Mechanism Design

Imagine that the mechanism designer isn’t allowed to change theagents’ strategy spaces or utility functions.

What can be done in such settings?

1 Contracts

2 Bribes3 Mediators

Offer to play on behalf of agentse.g., in Prisoner’s Dilemma, play C if the other agent also usesthe mediator; otherwise play Dusing the mediator’s services is weakly dominant, and leads toboth agents cooperating in equilibriumin a broad class of other games, mediators can be used toimplement the optimal-surplus outcome

Advanced Mechanism Design Lecture 17, Slide 23