what you need to know about search in sharepoint 2013 preview - dfw sharepoint users group 2012
DESCRIPTION
Slides from my talk about Search in SharePoint 2013 Preview at the Dallas Fort Worth (DFW) SharePoint Users GroupTRANSCRIPT
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
What you need to know about Search in SharePoint 2013 PreviewCorey Roth (@coreyroth)Applications ArchitectInfusion
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Corey RothAbout me
Transplant to Houston, TX Applications Architect at Infusion Development Three-time Microsoft SharePoint MVP Specializing in ECM, Search, and apps Come see my sessions at SPC12
E-mail: [email protected] Twitter: @coreyroth Blog: www.dotnetmafia.com
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Agenda
Major Product Changes User Interface Crawling Querying SharePoint Online Logical Architecture API (Developer Breakout)
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Where is FAST Search for SharePoint? GONE!
Components of FS4SP and some FAST ESP fully integrated
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
New Search Interface
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
New Search Interface Script based queries Template based search results Visual Refiners Previews for more documents types using OWA
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Search Demo
demo Corey Roth
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Result Types SharePoint 2013includes a new framework for presenting
search results to end users called result types Result types have several elements that enable each
type to be rendered differently:
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Result Type with Display Template Example Here’s an example from one of the Hands On Labs that
demonstrates building a custom result type and display template for .TXT file search results:
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Result Types
demo Corey Roth
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Query Suggestion Examples Here are some examples of how query suggestions
might look: Before the Query Suggestion Above are items based on what other
users have queried and found Bottom 3 items are ones you clicked
before
After the Query Suggestion Top 3 items are ones you clicked before
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Crawl and Content Configuration
Crawling and Content Sources Result Sources Improvements in Document Parsing Entity Extraction Schema Management
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Crawling and Content Sources
Crawling improvements Anonymous HTTP crawling Crawls aysnc content Continuos crawling
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Result Sources – FKA Scopes and Federated Search Scopes and Federated Search in SharePoint 2010 are now known
as “Result Sources” in SharePoint 2013 Results Sources also support a “Remote SharePoint Index”
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Improvements in Result Sources Site and site collection admins can manage and
configure result source Reduces need for SSA admins to configure Empowers lower-level admins
Exchange result source Allows query transformations
Eg: appendeding to each query, e.g. author=“Our CEO”, etc.
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Content Sources and Result Sources
demo
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Improvements in Document Parsing
SharePoint 2013 introduces new parsing features Automatic file format detection: no longer relies on
file extension Deep link extraction for Word and PowerPoint
formats Visual metadata extraction: titles, authors and dates High-performance format handlers for HTML, DOCX,
PPTX, TXT, Image, XML and PDF formats New Montage, Visio and OneNote filters The IFilter API still around
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Summary: New Site Search Admin Tasks Just to summarize, here are things site admins can do to
manage search themselves:Task Site
Collection Admin
Site Admin
Create and/or override Query Rules, including Promoted Results
Create and/or override Result types and display templates
Create and/or override Result Sources, either for remote locations or as a custom search “vertical”
Create managed properties
Create refiners
Start a local crawl – can even be done down to the list level
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Schema Management Managed properties still configured at SSA level Site Collection admins can define managed properties
Site collection admins can pick up new crawled properties for custom metadata in their sites and create managed properties from them
Still requires a full crawl SSA Properties used by default until overridden
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Faceted Navigation with Search Refiners Uses term sets for navigations Associate terms to managed properties Managed property must be set as “Refinable” Example:
You have term store terms Camera and Laptop You have managed properties Megapixel Count, Color and
Manufacturer For Camera term, you add refiners for Megapixel Count and
Manufacturer For Laptop term you add refiners for Color and Manufacturer
Another Example: Department is the term store term, Customers and Projects
could be refiners
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
New Search Settings
demo
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
SharePoint Online SPO gets some love
Greater feature parity with on-premises Tenant admin has search settings
i.e.: Search Schema, Results Sources, Query Suggestions, Authoritive Pages
Automatic OWA
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
SharePoint Online
demo
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Architecture
Logical Architecture - Components Crawl Content Processing Analytics Processing Index Administration Query Processing
Search Process
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Logical Architecture
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Crawling the Content• Crawls SharePoint Content• Crawl database tracks content that is
crawled• Does not store the crawled content
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Content Processing Content Processing Component
Processes crawled items and feeds these items to the index component
Document Parsing happens through Format Handlers iFilter is supported through a Generic iFilter format handler iFilters are still the extensibility platform for SharePoint 15
Heart of indexing process Linguistic Processing Writes to link database Generates phonetic name variations for people search
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Analytics Processing Component Analyzes crawled items and how users interact
with search results.
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Index Component
Used in both feeding and query processes: Feeding: receives processed items from the
content processing component and writes those items to index files
Query: receives queries from the query processing component and returns results sets
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Index Architecture (at very high level) An index partition is a logical
portion of the entire search index.
Index can scale in both horizontal (partitions) and vertical (replicas) ways
Partitions can be added but NOT removed
PrimaryReplica
SecondaryReplica 1
SecondaryReplica 2
Secondary Replica 1
SecondaryReplica 2
Primary Replica
Secondary Replica 3
SecondaryReplica 2
Primary Replica
SecondaryReplica 1
Partition #1 Partition #2 Partition #3
SecondaryReplica 3
SecondaryReplica 3
Servers
Index Servers1, 2 & 3
Index Servers4, 5 & 6
Index Servers7, 8 & 9
Index Servers10, 11 & 12
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Query Processing Component
Performs linguistic processing at query time: Word breaking, stemming, query spellchecking, thesaurus
Analyzes and processes search queries and results.
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Search Administration Search Admin Component
Runs number of system processes required for search
Responsible for search provisioning and topology changes
Coordinates search components – Content Processing, Query Processing, Analytics, and Indexing.
Search Admin DB Stores search configuration data:
Topology Crawl rules Query rules Managed property mappings Content sources Crawl schedules
Stores Analytics settings
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Search Processes Host Controller
Windows Service that supervises NodeRunner process(es) Automatically restarts NodeRunner.exe
NodeRunner.exe Process that hosts a search components Five instances total (one per component)
Can be scaled to multiple servers
MSSearch.exe Windows Service hosting the Crawl Component
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Search Host Process Multiple NodeRunner instances can
run on the same server Each NodeRunner instance hosts one
search component 5 instances of the NodeRunner.exe on
a single server install
NodeRunner.exe
Crawl Component
NodeRunner.exe
Query Processing Component
NodeRunner.exe
Analytic Processing Component
NodeRunner.exe
Content Processing Component
NodeRunner.exe
Index Component
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Architecture Demo
demo Corey Roth (@coreyroth)Applications ArchitectInfusioin
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
API Changes REST Client Object Model Web Services Deprecated
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Query Languages Keyword Query Syntax
Preferred Method FAST Query Language (FQL)
Still available Full Text SQL Query
Removed from product
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Querying with REST Available at the URL http://server/_api/search/query
Pass keyword query via querytext parameter
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Querying wit REST
demo
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Search Client Object Model Microsoft.SharePoint.Client.Search.dll Execute queries with SearchExecutor class
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.
Querying with CSOM
demo