yahoo! boss api external 20091001

48
B uild your O wn S earch S ervice Fred Meng

Post on 19-Oct-2014

4.337 views

Category:

Technology


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Yahoo! BOSS API external 20091001

Build your Own Search Service

Fred Meng

Page 2: Yahoo! BOSS API external 20091001

Outlines

•  Search engines using BOSS •  Big milestones for BOSS •  What else can be built with BOSS •  BOSS API

– What – Why – Features

•  How to use it – BOSS API – BOSS Mashup framework

Page 3: Yahoo! BOSS API external 20091001

Search engines using

Page 4: Yahoo! BOSS API external 20091001

middlespot - http://middlespot.com

Page 5: Yahoo! BOSS API external 20091001

hakia - http://hakia.com

Page 6: Yahoo! BOSS API external 20091001

hakia - http://hakia.com

Page 7: Yahoo! BOSS API external 20091001

hakia - http://hakia.com

Page 8: Yahoo! BOSS API external 20091001

Tartin3 - http://www.tartin3.com

Page 9: Yahoo! BOSS API external 20091001

askBoss - http://ask-boss.appspot.com

Page 10: Yahoo! BOSS API external 20091001

askBoss - http://ask-boss.appspot.com

Page 11: Yahoo! BOSS API external 20091001

askBoss - http://ask-boss.appspot.com

Page 12: Yahoo! BOSS API external 20091001

askBoss - http://ask-boss.appspot.com

Page 13: Yahoo! BOSS API external 20091001

OneRiot - http://www.oneriot.com

New ranking models

Page 14: Yahoo! BOSS API external 20091001

tweetnews - http://tweetnews.appspot.com

New ranking models

Page 15: Yahoo! BOSS API external 20091001

TechCrunch - http://search.techcrunch.com

Page 16: Yahoo! BOSS API external 20091001

TechCrunch - http://search.techcrunch.com

Page 17: Yahoo! BOSS API external 20091001

Big Milestone for

Page 18: Yahoo! BOSS API external 20091001

Big Milestone for BOSS

• 10 million queries per day in Dec 2009 = 300 million monthly queries

source: http://www.ysearchblog.com/2008/12/08/boss-reaches-a-milestone/

• 1 billion monthly queries in May 2009 source: http://www.ysearchblog.com/2008/12/08/boss-reaches-a-milestone/

Page 19: Yahoo! BOSS API external 20091001

What else can be built with

Page 20: Yahoo! BOSS API external 20091001

Get the pic - http://www.getthepicsure.com

Page 21: Yahoo! BOSS API external 20091001

Get the pic - http://www.getthepicsure.com

Page 22: Yahoo! BOSS API external 20091001

Get the pic - http://www.getthepicsure.com

Page 23: Yahoo! BOSS API external 20091001

What can be built with the BOSS API?

Client / Browser integrations

Page 24: Yahoo! BOSS API external 20091001

What can be built with the BOSS API?

Client / Browser integrations

Page 25: Yahoo! BOSS API external 20091001

What can be built with the BOSS API?

Client / Browser integrations

Page 26: Yahoo! BOSS API external 20091001

APIs About

Page 27: Yahoo! BOSS API external 20091001

Reality of Search: Huge Barriers of Entry

• Three players (G-Y-M) dominate the market, giving users limited choice

• Becoming a serious Search principal requires a massive capital investment and access to top technical talent

Page 28: Yahoo! BOSS API external 20091001

All crawled, ranked and presented in a

single API

Reality of Search: Huge Barriers of Entry

Page 29: Yahoo! BOSS API external 20091001

•  Open up Yahoo!'s search infrastructure and enable third parties to build revolutionary search products.

•  Unrestricted!

•  http://developer.yahoo.com/search/boss

All crawled, ranked and presented in a

single API

What?

Page 30: Yahoo! BOSS API external 20091001

All crawled, ranked and presented in a

single API

Opening Yahoo! Search Tech

Page 31: Yahoo! BOSS API external 20091001

•  Removes entry barriers –  massive capital investment

•  Asset to innovate –  New relevancy models –  New presentation styles

•  Boom the search market –  Fragment the market, foster more players, choices,

competitions

Why?

Page 32: Yahoo! BOSS API external 20091001

•  Ability to re-rank results •  Blend results/content sources •  Ability to use any monetization platform •  Present results in any way •  No branding or attribution •  Unlimited queries per day* <BOSS Usage Fees>

•  Access to multiple verticals (web search, image, news) •  Spell checks, keyword suggestions (Key Terms) •  40+ supported language and region pairs •  SearchMonkey Structured Data, Delicious data •  Page data from Site Explorer •  Expanded Abstracts: 170 characters to 300! •  Mashup Framework

BOSS API Features

Page 33: Yahoo! BOSS API external 20091001

How to use

Page 34: Yahoo! BOSS API external 20091001

Getting Started with BOSS

1)  Info & Docs: http://developer.yahoo.com/boss

2)  Register for an BOSS App ID (free)

3)  Code samples: Javascript, PHP and Python http://www.saurabhsahni.com/boss-examples.zip

4)  (optional) Join the BOSS Developer Grouphttp://tech.groups.yahoo.com/group/ysearchboss/

5)  Starting your hacks

Page 35: Yahoo! BOSS API external 20091001

API Structure

The Basics:

http://boss.yahooapis.com/ysearch/{vert}/v1/{query}?appid={BOSSappid}&format=xml

•  {vert} = {web, news, images, spelling} •  {query} = {your search term} •  {appid} = required application id •  {format} = json is the default

Page 36: Yahoo! BOSS API external 20091001

API Structure

Optional Parameters: http://boss.yahooapis.com/ysearch/{vert}/v1/{query}?

appid={BOSSappid}&format=xml&optionalparameter={value} •  lang = {value} : 40+ languages •  count = {value} : number of results request •  start = {value} : first result requested •  sites = {value} : site restricts •  view=keyterms : related words/phrases for each result •  view = searchmonkey_rdf : SearchMonkey structured data •  view = delicious_toptags : most common public tags •  view = delicious_saves : # of delicious saves •  filter = porn / hate : filter out porn or hate-related content •  type = {value} : document format (e.g. word, pdf, etc) •  abstract = long : increases abstract length to 300 words

Page 37: Yahoo! BOSS API external 20091001

BOSS API: Web XML Response

http://boss.yahooapis.com/ysearch/web/v1/iphone?appid=…&format=xml&lang=tzh&region=tw

Page 38: Yahoo! BOSS API external 20091001

BOSS API: Find related keywords

http://boss.yahooapis.com/ysearch/web/v1/台北?appid=…&format=xml&lang=tzh&region=tw&age=1d-7d&view=keyterms

Page 39: Yahoo! BOSS API external 20091001

API Structure: Images

Optional Parameters for Images: http://boss.yahooapis.com/ysearch/images/v1/iphone?

appid={BOSSappid}&format=xml&optionalparameter={value} •  dimensions = {value}: all (default), small, medium, large, wallpaper,

widewallpaper •  refererurl = {value}: URL, no default. Search for this URL. Depending on

other query restrictions, returns all image objects with this referring URL. •  url = {value}: URL, no default. Search for this URL. Returns this exact image

result.

Page 40: Yahoo! BOSS API external 20091001

BOSS API: Images XML Response

http://boss.yahooapis.com/ysearch/images/v1/iphone?appid=…&format=xml&dimensions=small

Page 41: Yahoo! BOSS API external 20091001

API Structure: News

Optional Parameters for News: http://boss.yahooapis.com/ysearch/news/v1/台北?

appid={BOSSappid}&format=xml&optionalparameter={value} •  age = {value}: 7d is the default. (30d, 1w, 12h, 5d-10d, 2w-30d) •  orderby = {value}: relevance is the default. (add orderby=date to sort by

date)

Page 42: Yahoo! BOSS API external 20091001

BOSS API: News XML Response

http://boss.yahooapis.com/ysearch/news/v1/台北?appid=…&format=xml&lang=tzh&region=tw&age=1d-7d

Page 43: Yahoo! BOSS API external 20091001

BOSS API: Spell Check

http://boss.yahooapis.com/ysearch/spelling/v1/taipai?appid=…&format=xml

Page 44: Yahoo! BOSS API external 20091001

BOSS Mashup framework

An experimental Python library which provides SQL-like functions for mashing up the BOSS API with third-party data sources.

http://developer.yahoo.com/search/boss/mashup.html

Page 45: Yahoo! BOSS API external 20091001

BOSS Mashup framework

Simple code example:

Page 46: Yahoo! BOSS API external 20091001

BOSS Mashup framework

Output:

Page 47: Yahoo! BOSS API external 20091001

BMF+GAE

Enhanced version of BOSS Mashup Framework to Google App Engine:

http://zooie.wordpress.com/2008/08/04/yahoo-boss-google-app-engine-integrated/

Enables quick deployment of BOSS applications online

Page 48: Yahoo! BOSS API external 20091001

Thanks

Questions / Feedback?