everything you always wanted to know about sharepoint 2013 search relevance
DESCRIPTION
TRANSCRIPT
![Page 1: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/1.jpg)
Everything you always wanted to know about SharePoint search relevance …
Joris PoelmansSharePoint ArchitectRealDolmen
![Page 2: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/2.jpg)
About meWork at RealDolmen
Principal consultant and product manager
SharePoint Server MVP since 2005
Active in Belux Information Worker User Group – www.biwug.be
Blog: http://jopx.blogspot.com
Twitter: @jopxtwits
![Page 3: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/3.jpg)
3
![Page 4: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/4.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 5: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/5.jpg)
5
Challenges with search – data complexity
What we give to search engines
What most search engines see1 2 3 4awaycomecontrastivecustomizeforfs14howoptimizingourrelevance (3)
shouldsimplesomess14techniquesview (2)whatwhenwithyou
Author: victor poznanskiTitle: conf relevancy sharepoint Date: 9.4.9Type: pptAuthority: 6Anchor: SPC presentation …
![Page 6: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/6.jpg)
6
Challenges with search – understanding intent
![Page 7: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/7.jpg)
7
What is a good search result?
All relevant documents (precision)
Complete answer (recall)
Sweet spotBalance between recall, precision and relevance
![Page 8: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/8.jpg)
8
Microsoft goals for search in 2013
Find Answer ExtendFind what you’re looking for with intelligent results tailored to you
Get answers and take action with an experience that’s always a step ahead
Build smarter/no-code applications that can scale for any need or business requirement
![Page 9: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/9.jpg)
9
Configuration in the Conceptual Relevance Flow
For all queries:
Authorities: Level 1: http://networksRanking model: {incorporate user ratings}
Query:BT networkquarterly report
Search Web Part
Query Processing Engine
Document Collection
Thesaurus: BT British TelecomBest bets: BT Network …/BTN.htm
(WORDS BT, British Telecom) AND(WORDS network, networks, networked) AND (WORDS quarterly, quarterlies) AND(WORDS report, reports, reported)
Mixed Results for:• BT Network best bet• BT network quarterly
report• BT network
ContentType=reports
Dynamic Reordering Rules: Quarterly Report {prefer docs from http://reports}
Query Rule: {Terms} Quarterly Report {Terms} ContentType=“reports”
![Page 10: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/10.jpg)
10
Configuration options for tuning relevanceQuery dependent
• Thesaurus• Best bets/promoted
results• Dynamic reordering
rules• Query rules
Influence Dynamic Ranking
Query independent
• Authorities• Ranking models
Influence Static Ranking
![Page 11: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/11.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 12: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/12.jpg)
Query rules drive relevanceQuery Conditions
What queries should be handled?
Query Actions
What happens when a rule matches?
PublishingOptions
Is the rule active and for how long?
![Page 13: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/13.jpg)
Query rules: conditions and actions PHRASE-BASED MATCHES• Exact match, beginning or end• Ad-hoc or term store dictionary• Match a regex (advanced)
HISTORICAL (LOG-BASED) MATCHES• Is this query more likely aimed at
the following source…?• Do people mostly click on result
of the following type…?
CURATED (BEST BET)• Show a promoted result
REFORMULATE THE USER QUERY• Show a block of results• Replace the core results
with a different query
ActionsQuery Conditions
![Page 14: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/14.jpg)
14
Query rules and result blocks
Query rulesDemo
![Page 15: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/15.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 16: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/16.jpg)
16
Using a thesaurus to improve relevancyWhat is it?• Expands a query with synonyms• Specify synonyms for single or multiple words• Possible to specify language for a synonym to apply• Input from business is essential• Only one thesaurus possible per farm
![Page 17: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/17.jpg)
17
Using a thesaurus to improve relevancyHow to use it?1. Create a .CSV filea.Key = term to trigger a synonym forb.Synonym = term that should be triggered by the keyc.Language = language that should be applied to the synonym
2. Import using SharePoint 2013 management shell
Import…http://technet.microsoft.com/en-us/library/jj219579.aspx
![Page 18: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/18.jpg)
18
Using a thesaurus to improve relevancyThings to know• No export possible for a thesaurus, change requires a
redeploy• Entries are not case sensitive• Language is not mandatory• Synonyms are not given the same weight as the initial term
– it is possible to change the weight - http://bit.ly/1bcSSm4
![Page 19: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/19.jpg)
19
Demo scenario – Importing thesaurus and modifying the weight
Using a thesaurusDemo
![Page 20: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/20.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 21: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/21.jpg)
21
Dynamic reordering rules (1/3)What is it?Dynamic Rules let you reorder results according to a set of criteria• Just like query rules apply to user queries, dynamic rules apply to results
They are configured as part of a query• They translate into a special query syntax called XRANK
Result actions let you promote or demote results that match• In many cases, you can use this instead of Best Bets.
![Page 22: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/22.jpg)
22
Dynamic reordering rules (2/3)How to configure it?
Result Conditions
Result Actions
Promote up or demote down
Manual condition looks like a query
![Page 23: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/23.jpg)
23
Dynamic reordering rules (3/3)What is my score?
A promotion-to-top places any result at the top of the results
A demotion-to-bottom places any result at the bottom of the results
A promotion of 10 moves a mediocre relevant result to the top
A demotion of 10 places a mediocre revelant result under the most relevant results.
![Page 24: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/24.jpg)
24
Boosting results
Dynamic reordering
Demo
![Page 25: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/25.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 26: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/26.jpg)
26
Authorative sites
![Page 27: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/27.jpg)
27
Authorities: Connected
1
0
1
1
2
4
3
2
∞
4
Setting an authority affects all sites connected through hyperlinks
Sites are weighted
by distance to the authority
![Page 28: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/28.jpg)
28
Authorities: Connected
1
0
1
1
2
1
1
2
∞
0
Setting an authority can have unexpected side- effects
![Page 29: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/29.jpg)
29
Authorities: Connected
1
0
1
1
2
1
-
2
∞
0
Non-authorities do not affect connected sites
![Page 30: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/30.jpg)
AgendaChallenges with search
Configuration options to drive relevanceQuery rulesThesaurusDynamic reordering rulesAuthoritiesRanking models
![Page 31: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/31.jpg)
31
How Can You Change Ranking?
ΣRank Score
ωpowerpoint
ωauthor
ωactivity
Title=“XBOX Monthly report”
Type=pptActivity=2M clicksAuthor=Ian RankemRating = 5
Title=“XBOX Monthly report”
Type=pptActivity=2M clicksAuthor=Ian RankemRating = 5
Query: Ian Monthly
ωrating
Transform (normalization)
Document(managed properties)
![Page 32: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/32.jpg)
32
BM25F ranking model• SharePoint 2013 calculates relevance rank score using BM25F
(fielded version of BM25)
• Default model is a two-stage ranking model (second stage using a neural network)
• Install August 2013 CU to have an additional two-stage linear model and use this as start point
See Customizing ranking models to improve relevance in SharePoint 2013 - http://bit.ly/1cxf6A1Microsoft Research white paper - http://trec.nist.gov/pubs/trec14/papers/microsoft-cambridge.enterprise.pdf
![Page 33: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/33.jpg)
33
Examing item rankingExplain rank page _layouts/15/explainrank.aspx requires two parameters:• q – which contains the query• d – which specifies the path of the item for which
you want to see rankdetailDownload search display template from http://bit.ly/IUaPiZ Mavention search ranking app - http://blog.mastykarz.nl/understanding-item-ranking-sharepoint-2013-search-mavention-explain-rank-app-sharepoint/
Important: If you get a 403 error add yourself on the Search Service Application with full control
![Page 34: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/34.jpg)
34
Explainrank.aspx and Mavention item ranking app
Ranking modelsDemo
![Page 35: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/35.jpg)
35
Configuring ranking modelsUse PowerShell to administer ranking models• Get-SPEnterpriseSearchRankingModel• New-SPEnterpriseSearchRankingModel• Remove-SPEnterpriseSearchRankingModel
Different steps:• Export existing model• Create managed properties you need to use in your model• Add managed property into your model with a specific weight and
normalization• Import model back again• Not possible anymore to use DefaultRankingModelID webpart property –
still looking for workaround
• Use querystring parameter rm=[GUID for ranking model] to test your
model
![Page 36: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/36.jpg)
36
Using a custom ranking model
Ranking modelsDemo
![Page 37: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/37.jpg)
37
Summary• SharePoint 2013 allows you to
easily capture intent and provide relevant results
• Use custom ranking models when you have considered or tried simpler options (Authorities, thesaurus, query rules, dynamic rules, ....)
• Search projects are iterative and are executed in multiple phases - use analytics reports, user feedback web parts, etc ...
• Extra tooling expected – check out https://channel9.msdn.com/Events/SharePoint-Conference/2012/SPC145
![Page 38: Everything you always wanted to know about SharePoint 2013 Search relevance](https://reader036.vdocuments.us/reader036/viewer/2022081417/5541304f55034684118b4587/html5/thumbnails/38.jpg)
Thank You