adwords, an algorithmic perspective - brooklyn collegeshoshana/pub/cs514_adwords_slides.pdf ·...
TRANSCRIPT
![Page 1: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/1.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Adwords, An Algorithmic Perspective
Shoshana Neuburger
April 20, 2009
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 2: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/2.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 3: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/3.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
What are Adwords?
◮ Search engine displays search results.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 4: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/4.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
What are Adwords?
◮ Search engine displays search results.
◮ For each query, relevant ads are also returned.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 5: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/5.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
What are Adwords?
◮ Search engine displays search results.
◮ For each query, relevant ads are also returned.
◮ The search results and ads are displayed separately.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 6: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/6.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Some searches reveal many sponsored ads...
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 7: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/7.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm��� ������ �� ���� ���� ����� �������� �������������
School Furniture for Less��������������������������� !"#$ !�%&����'������(����%���%������)���������%���Student Travel Deals*�+����,����,��-����������%.����+�%���%�������/��+����%���Dorm Furniture0122�3�&�����+���4 !"#$ !��������'5�����'6�����'(7������8���%&�����,�%���Buy Dorm Room Furniture���������������������9���:;<=�����������������6���������86��������%���Dorm Furniture6����������*���4 !"#$ !�7����������'>����&���+��,8���%?���5����%���College Furniture@�����0122�3�����,������&���A�����������B�����,7���C���8�����������Furniture
College Futon Store
DE1DEF"F"G3HF#2IJ1HK,L������ K������������� MNOPQRSNTSPURVWUSXSUSQRSYZ������[\[]������� _]]]]]]���J122�3�� !"#$ !�%a]I_[�������bCollege and Dorm room Furniture and Rug BostonMassachusetts)+��;c,����0122�3�4 !"#$ !����������7�������������������������������������� !"#$ !������������������d����+�� !"#$ !�%���%J122�3�� !"#$ !�����%���e\ff�\5�����\�����������\College Furniture & Dorm Room Furniture - FreeShipping0122�3�4 !"#$ !�(&���Z���4 !"#$ !�C���������������������������������� !"#$ !�%*�����������������������+�����,��J122�3���������III���%�����,� !"#$ !�%���eJ122�3�\� !"#$ !�%����\=g�\5�����\�����������\Dorm Essentials : College : Home : Target������&���A���������0122�3�@���B����������B�����������C�����%III6��������������0122�3�4 !"#$ !����&���A���������%0122�3�4 !"#$ !����III���%������%���e4 !"#$ !�\&���\A���������\0122�3�\@���e�h��i/C6j(����i;gcf<kcff\fjj�\5�����\�����������\Dorm Furniture - College Bunk Beds and ComputerDesks&���Z�������������������������J122�3�� !"#$ !�'�����������������������%������������������%&���������+��,%���%���������������%���e\=<�\5�����\�����������\JCPenney: Beanbags, Dorm Chairs, Dorm RoomFurniture, College ...
Cool College Furniture Specials
College Furniture
����������������������lmnmoppq rsttuvuwxyz{|xyu}~ssvtu�u�yr�
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 8: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/8.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
And others result in none...
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 9: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/9.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm��� ������ ���� ���� ����� ����� �������� ������������ ����� ¡�¢¡�£ ¤¥£¡¦¡£¡� ¡§��©�ª�«¬«�®� �©ª «°«±®��²³ ²³µ¶µ¶�·�·¹� º »¼½½�������¾
FACULTY: Department of CIS: Brooklyn College CUNY¿³ ²³µ¶µÀ�·�·¹� Á²³ ²³µ¶µÂ���º ���Ã�Ä�º�©�ĺ��©ºÅ���ª��ª������Ã�����©���Á���ª��Â���º ���Ã�Ä�º�©�ĺ��©ºÆ��®ÇÈ�����Á�È�����Â���º ���Ã�Ä�º�©�ĺ��©¼¼¼���º���º ���Ã�Ä�º�©�ĺ��©É���É����É®��©�ªÄº�ª�� ¬ÊËìÌ�����¬������������Discrete Algorithms Seminar���©�������®ª����ªª�����ª��ª�ͪ ª�©�®��º ��ª����ªÎ�ªª�ÎÉÉ���ª��º���º���É��ª�ª���º�®�Ï����ÐÑÊÒÓÔÕÖºÑÊÒÓÖÔѺ����Ã��ο³ ²³µ¶µÀ�·�·¹� º ¼¼¼���º���º ���Ã�Ä�º�©�ĺ��©É×���ªÈÉÕÔÖÉ®ÔÕ¬� �ª���ª�º��®¬�������������������©�ª�®������º���º ���Ã�Ä�º�©�ĺ��©Ø
Advanced Algorithms : Topics in Game TheoryÙ� ÑÚÁ��������Û����Á���Ã�ªÌ����������Æ������ª����Á¿³ ²³µ¶µÀ�·�·¹� ºÒºÙ�ÖÊÁÆ����Á ��ª��¬��������©ª���Î�ª� ����ª����� ����������©ª�������¼¼¼��©�º�©ª����º��©É×�������É��ÜÑÒº�ª�� ¬ÑÚìÌ�����¬������������Stringology 2009 - Bar Ilan University¼¼¼���������Ý�ÙÝÁÝ����¾ÞÝ�©���ª��©�����Áß��à����ªá�� �©��Þâ����Ì�����Á��ã���ß��à����ªÄÞ¿³ ²³µ¶µÀ�·�·¹� ÁÌ�ªÄß��à����ªÄ�®���ä��ü¼¼©º��º �©º��º��É×��� ÄÉ�ª��������ÄÉ���ª������ª�º���¬ÕìÌ�����¬������������Doctoral research, faculty, and students at the Department of ...
SB System Consultants
DREU 2003 Awards | CRA-W
CRA-DMP Experience
CRA-DMP Experience
����������© ©����������åæçèæçèèé êëìêëíîíîïðñðòóïòôõììóöï÷ïíòøë
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 10: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/10.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Advertiser
◮ An advertiser is charged for his ads.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 11: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/11.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Advertiser
◮ An advertiser is charged for his ads.
◮ Each advertiser can value each keyword differently.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 12: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/12.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Advertiser
◮ An advertiser is charged for his ads.
◮ Each advertiser can value each keyword differently.
◮ An advertiser bids for a keyword that should display his ad.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 13: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/13.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Advertiser
◮ An advertiser is charged for his ads.
◮ Each advertiser can value each keyword differently.
◮ An advertiser bids for a keyword that should display his ad.
◮ Some keywords are more popular among advertisers.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 14: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/14.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Search engine’s perspective:
◮ Maximize revenue each day.
◮ Limitations:◮ must respect each advertiser’s daily budget
and◮ the profit depends on an advertiser’s bid for a keyword he wins.
The bids and daily budgets are specified in advance.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 15: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/15.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Search engine’s perspective:
◮ Maximize revenue each day.
◮ Limitations:◮ must respect each advertiser’s daily budget
and◮ the profit depends on an advertiser’s bid for a keyword he wins.
The bids and daily budgets are specified in advance.
Decision: which ads to display for a query?
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 16: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/16.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Online Algorithm
The Adwords problem is an online allocation problem.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 17: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/17.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Online Algorithm
The Adwords problem is an online allocation problem.
The effectiveness of an online algorithm is measured bycompetitive analysis.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 18: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/18.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
What is the Adwords problem?Online Algorithm
Online Algorithm
The Adwords problem is an online allocation problem.
The effectiveness of an online algorithm is measured bycompetitive analysis.
ALG is α-competitive if the ratio between its performance and theoptimal offline performance is bounded by α.
ALG(I )OPT (I ) ≥ α for all instances I.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 19: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/19.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Criteria
Maximize the profit for each query.
As a keyword arrives, choose the ad that offers the highest bid.
Until the advertiser’s budget is depleted.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 20: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/20.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Algorithm
ExampleBidder1 Bidder2
Bicycle $1 $0.99Flowers $1 $0
Budget $100 $100
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 21: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/21.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Algorithm
ExampleBidder1 Bidder2
Bicycle $1 $0.99Flowers $1 $0
Budget $100 $100
Queries:
100 Bicyclesthen100 Flowers.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 22: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/22.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Algorithm
ExampleBidder1 Bidder2
Bicycle $1 $0.99Flowers $1 $0
Budget $100 $100
Queries:
100 Bicyclesthen100 Flowers.
Greedy allocates 100 Bicycles to Bidder1.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 23: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/23.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Algorithm
ExampleBidder1 Bidder2
Bicycle $1 $0.99Flowers $1 $0
Budget $100 $100
Queries:
100 Bicyclesthen100 Flowers.
OPT (offline) allocates 100 Bicycles to Bidder2 and 100 Flowers toBidder1.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 24: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/24.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Greedy Algorithm
ExampleBidder1 Bidder2
Bicycle $1 $0.99Flowers $1 $0
Budget $100 $100
Queries:
100 Bicyclesthen100 Flowers.
Algorithm Allocation Revenue
Greedy Bidder1: 100 Bicycles $100
OPT Bidder1: 100 FlowersBidder2: 100 Bicycles $199
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 25: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/25.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Greedy Algorithm
Competitive Analysis
ALG is α-competitive if the ratio between its performance and theoptimal offline performance is bounded by α.
ALG(I )OPT (I ) ≥ α for all instances I.
Algorithm α
Greedy 12
Mehta, Saberi, Vazirani, Vazirani (’05) 1 − 1e≈ .63 optimal
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 26: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/26.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
AdWords and Generalized On-line Matching
Aranyak Mehta, Amin Saberi, Umesh Vazirani, Vijay VaziraniFOCS, 2005
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 27: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/27.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
In search of a better algorithm
As a query arrives, the algorithm
◮ Should favor advertisers with high bids
◮ Should not exhaust the budget of any advertiser too quickly
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 28: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/28.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
In search of a better algorithm
As a query arrives, the algorithm
◮ Should favor advertisers with high bids
◮ Should not exhaust the budget of any advertiser too quickly
The algorithm weighs the remaining fraction of each advertiser’sbudget against the amount of its bid.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 29: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/29.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Previous Results
Karp, Vazirani, Vazirani (1990)
◮ Online bipartite matching
◮ Randomized algorithmranking
◮ Fixes random permutation ofbidders in advance.
◮ Budgets = 1, Bids = 0/1
◮ Factor: 1 − 1e
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 30: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/30.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Previous Results
Karp, Vazirani, Vazirani (1990)
◮ Online bipartite matching
◮ Randomized algorithmranking
◮ Fixes random permutation ofbidders in advance.
◮ Budgets = 1, Bids = 0/1
◮ Factor: 1 − 1e
Kalyanasundaram, Pruhs (2000)
◮ Online b-matching
◮ Deterministic algorithmbalance
◮ Matches query to bidder withhighest remaining budget.
◮ Budgets = 1, Bids = 0/ǫ
◮ Factor: 1 − 1e
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 31: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/31.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
KVV ’90
“We saw online matching as a beautiful research
problem with purely theoretical appeal. At the time, we
had no idea it would turn out to have practical value.”
- Umesh Vazirani, SIAM News, April 2005
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 32: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/32.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Applying balance
The new algorithm generalizes b-matching to arbitrary bids.
Natural Algorithm:
◮ Assign query to highest bidder
◮ Break ties with largest remaining budget
Achieves competitive ratio < 1 − 1e.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 33: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/33.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Applying balance
The new algorithm generalizes b-matching to arbitrary bids.
Natural Algorithm:
◮ Assign query to highest bidder
◮ Break ties with largest remaining budget
Achieves competitive ratio < 1 − 1e.
We would like to do better!
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 34: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/34.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Adwords problem:
◮ N bidders
◮ Each bidder i has daily budget bi
◮ Each bidder i specifies a bid ciq for query word q ∈ Q
◮ A sequence of query words q1q2 · · · qM , qj ∈ Q, arrive onlineduring the day.
◮ Each query qj must be assigned to some bidder i as it arrives;the revenue is ciqj
Objective: maximize total daily revenue while respecting dailybudget of bidders.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 35: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/35.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Simplified version of Adwords problem:
◮ Bidder pays as soon as ad is displayed
◮ Bidder pays his own bid
◮ One ad displayed per search page
Assumption: bids are small compared to budgets.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 36: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/36.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
New Algorithm
Algorithm: Give query to bidder that maximizes
bid × ψ(fraction of budget spent)
ψ is tradeoff function between bid and unspent budget.
ψ(x) = 1 − e−(1−x)
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 37: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/37.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Where does ψ come from?
New Proof forBALANCE {0,ε} Factor Revealing LP
Modify LP for arbitrary bids [0,ε]
Use dual to get
1-1/e
1-1/eUse dual to get Tradeoff function
Tradeoff Revealing LP1-1/e
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 38: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/38.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Factor-Revealing LP
Choose large k .
Discretize the budget of each bidder into k equal slabs.
Define the type of a bidder by the fraction of budget spent at endof balance.
Define x1, x2, . . . , xk :xi = number of bidders of type i .
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 39: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/39.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Factor-Revealing LP
w.l.o.g. OPT = $N.
Revenue =k
∑
i=1
xii
k
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 40: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/40.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Factor-Revealing LP
w.l.o.g. OPT = $N.
Revenue =k
∑
i=1
xii
k
Constraint 1: x1 ≤ Nk
Constraint 2: x1 + x2 ≤ 2Nk−
x1k
∀i , 1 ≤ i ≤ k − 1:i
∑
j=1
(1 +i − j
k)xj ≤
i
kN
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 41: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/41.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Factor-Revealing LP
Minimizek
∑
i=1
xii
k
such thati
∑
j=1
(1 +i − j
k)xj ≤
i
kN
∑
j
xj = N
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 42: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/42.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Factor-Revealing LP
Minimizek
∑
i=1
xii
k
such thati
∑
j=1
(1 +i − j
k)xj ≤
i
kN
∑
j
xj = N
Solve LP by finding the opimum primal and dual.Optimal solution is xi = N
k(1 − 1
k)i−1
which tends to N(1 − 1e) as k → ∞.
Thus, balance achieves a factor of 1 − 1e.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 43: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/43.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Where does ψ come from?
New Proof forBALANCE {0,ε} Factor Revealing LP
Modify LP for arbitrary bids [0,ε]
Use dual to get
1-1/e
1-1/eUse dual to get Tradeoff function
Tradeoff Revealing LP1-1/e
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 44: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/44.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Modify the LP for arbitrary bids
Subtle tradeoff between bid and unspent budget
We generalize LP L and its dual D to the case with arbitrary bidsusing LPs L(π, ψ).
L: D:Max c · x Min b · y
Ax ≤ b yTA ≥ c
L(π, ψ) D(π, ψ)Max c · x Min b · y + ∆(π, ψ) · y
Ax ≤ b + ∆(π, ψ) yTA ≥ c
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 45: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/45.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Modify the LP for arbitrary bids
L(π, ψ) D(π, ψ)Max c · x Min b · y + ∆(π, ψ) · y
Ax ≤ b + ∆(π, ψ) yTA ≥ c
Observation: For every ψ, dual achieves optimal value at samevertex.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 46: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/46.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Modify the LP for arbitrary bids
L(π, ψ) D(π, ψ)Max c · x Min b · y + ∆(π, ψ) · y
Ax ≤ b + ∆(π, ψ) yTA ≥ c
Observation: For every ψ, dual achieves optimal value at samevertex.
There is a way to choose ψ so that the objective function does notdecrease.Thus, the competitive factor remains 1 − 1
e.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 47: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/47.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
Modify the LP for arbitrary bids
L(π, ψ) D(π, ψ)Max c · x Min b · y + ∆(π, ψ) · y
Ax ≤ b + ∆(π, ψ) yTA ≥ c
Observation: For every ψ, dual achieves optimal value at samevertex.
There is a way to choose ψ so that the objective function does notdecrease.Thus, the competitive factor remains 1 − 1
e.
This competitive factor is optimal.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 48: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/48.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
PerspectiveRelated WorkMSVVMore Realistic Models
More Realistic Models
The algorithm introduced by MSVV generalizes to
◮ Advertisers with different daily budgets.
◮ The optimal allocation does not exhaust all budgets.
◮ Several ads per search query.
◮ Cost-per-Click
◮ Second Price
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 49: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/49.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
Online budgeted matching in random input models
with applications to Adwords
Gagan Goel and Aranyak MehtaSODA, 2008
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 50: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/50.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
Outline of article
◮ Distributional assumption about query sequence: although theset of queries is arbitrary, the order of queries is random.
◮ Main Result: Greedy has competitive ratio 1 − 1e
in therandom permutation input model
◮ This result applies to the i.i.d. model as well.
◮ Approach: modify KVV (fix hole in proof) and then applyresults to Adwords problem
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 51: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/51.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
Permutation Classes
For each item p, classify permutations
◮ Into those in which p remains unmatched, miss.
◮ Into those in which p gets matched.Subclasses depending on the structure of the match:
◮ good : the correct match is available when p arrives◮ bad : the correct match is allocated prior to the arrival of p
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 52: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/52.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
GM Algorithm
◮ Properties of Greedy:◮ Monotonicity◮ Prefix◮ Partition
◮ These properties are simple observations in bipartite matching.
◮ There can be several different bids for the same query in theAdwords problem.
◮ Not every mismatch can be reversed easily; a taggingprocedure is used to generalize the results.
◮ The tagging method works on permutations of the input.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 53: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/53.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
GM Algorithm
Revenue =m
∑
i=1
min
Bi ,∑
q∈Q
bidiq
In the last bid the algorithm allocates to a bidder, his budget maybe exceeded.
Inequalities bound the sizes of miss, bad, good.
A linear program maximizes the loss of revenue over theseinequalities.
Factor revealing LP proves competitive ratio of 1 − 1e
in randominput model.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 54: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/54.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
GM Results
Competitive factor of Greedy in
◮ random-permutation input model
◮ independent distribution input model (i.i.d.)
is exactly 1 − 1e.
Shoshana Neuburger Adwords, An Algorithmic Perspective
![Page 55: Adwords, An Algorithmic Perspective - Brooklyn Collegeshoshana/pub/CS514_adwords_slides.pdf · Adwords, An Algorithmic Perspective Shoshana Neuburger April 20, 2009 Shoshana Neuburger](https://reader031.vdocuments.us/reader031/viewer/2022020416/5c73c55709d3f2d37b8bcf30/html5/thumbnails/55.jpg)
OverviewGreedy AlgorithmMSVV Algorithm
Random Input Models
Goel and Mehta
Thank you!
Shoshana Neuburger Adwords, An Algorithmic Perspective