Deploying FAST Search for SharePoint 2010

Barry Waldbaum Dan HarringtonArchitect Senior Consultant

FAST Solution Architecture Center Microsoft Corporation

Today’s Goal

You can do it!

Quick, easy, powerful search

(for free!)

Complete intranet search

High-end search delivered through

SharePoint

Basic search Intranet-wide searchPeople and expertise search

Visual, highly customizable and advanced content processing

Powerful platform to build on• 360° customer views• Research portals• Reputation analysis• …

Products for Every Customer Need

Agenda

FAST Search OverviewConcepts and terminologyRelationship to SharePoint 2010 Search

Deployment ConsiderationsPre-Installation through ConfigurationIntegration with SharePoint 2010Multinode deployment processSizing and ResourcesManageability

Demos

βeta Notice!

Commands and UI Screens shown hereafter are not necessarily finalized, and subject to change

Concepts and Terminology

SharePoint Search

End Users Content +

Profiles

FAST Search for SharePoint

FAST Search Extends SharePoint ServerSuperset of capabilities; common base functionality and platform

Content search

People search

Unique Social Search from SharePoint Server

Common connectors and content APIs

Common query and federation APIs

Best High-End Content Search based on FAST ESP

Common developer experience and IT Pro Foundation

FAST Search in SharePoint

SharePoint Server

Content management

Web front end

SQL content storage

Administrative services

SharePoint Search

People search

Content search

Crawler

SQL with crawler DB

FAST Search

Content gathering

Content processing

Search

Admin

Conceptual component view

FAST Search Components

Administrative

Administrative services

Name serviceSecurity access

module (SAM)

Content Gatherin

g

Enterprise Crawler

Web Analyzer

Database Connector

Content Processin

g

Content distributor

Document processor(s)

Indexing dispatcher

Search

Index/Search

Query result processor Queries

Content

Installation and Configuration

Pre-Installation Tasks

Account for installationSystem Administration privileges

Account for running FAST SearchMust have DB Creation privileges in SQL Server Management StudioMust be Domain user

IPSec used between SharePoint 2010 & FAST Search to securely authenticate component connections

Pre-Installation Tasks (cont.)

Deployment Topology - IntegrationAdd FAST Search to existing SharePoint

installationSharePoint 2010 and SQL in place firstStandalone or Multinode FAST Search

SharePoint 2010

SQL

FAST Search

FAST Search Installationdemo 1. Run Pre-Requisite Installer2. Run FAST Search Installer3. Run configuration script

Integration NotesFAST Search configuration produces details file:

C:\FASTSearch\Install_Info.txt

Contains information needed for SharePoint 2010 configuration of FAST Search applications

Also creates deployment config file: C:\FASTSearch\...

etc\config_data\deployment.xml

Contains per-node component layout and detailsCan be modified e.g. when adding node to installation

Search Service ApplicationsLinkage between SharePoint and FAST Search

FAST Query InterfaceFAST Content Gathering Interface

SharePoint 2010

SQL

FAST Search

Terminology MappingSharePoint UI Install_Info.txt

Query Service Location QR Server Proxy(s)

Admin Service Location WCF ServiceResource Store Location Resource Store

Content Distributor Content Distributors

Collection Name *

SQL Database SQL Server Database

* Does not appear in Install_Info.txt file

FAST Search Configuration

demo 1. Create a Search Service Application (SSA)

for FAST Content2. Create a SSA for FAST Query3. Configure FAST as the default search engine

for the site4. Setup a new FAST Search site5. Start a crawl of the profiles for people

search6. Start a crawl of all the content into FAST

Capacity Planning

Deployment ConceptScale-out

Add columns to extend document capacityAdd rows to extend query capacity or fault tolerance

Indexer/Search

Indexer/

SearchRow 0

Indexer/

Search

Indexer/

Search

Indexer/

Search

Indexer/Search

Row 1

Column 0

1

Indexer/

Search

Indexer/

Search

2 3

FASTSearch

Admin & Content

Processing

Scale-out Scenarios

From simple to complex

Indexer/Search

Indexer/Search

Indexer/

Search

Indexer/Search

Enterprise

CrawlerIndexer

/Search

Indexer/

Search

FAST Search CPU Usage

Administrative

Administrative services

Name serviceSecurity access

module (SAM)

Content Gatherin

g

Enterprise Crawler

Web Analyzer

Database Connector

Document

Processing

Content distributor

Content processor(s)

Indexing dispatcher

Search

Index/Search

Query result processor

Key

Heavy

Moderate

Light

FAST Search Memory Usage

Administrative

Administrative services

Name serviceSecurity access

module (SAM)

Content Gatherin

g

Enterprise Crawler

Web Analyzer

Database Connector

Document

Processing

Content distributor

Content processor(s)

Indexing dispatcher

Search

Index/Search

Query result processor

Key

Heavy

Moderate

Light

FAST Search Disk Usage

Administrative

Administrative services

Name serviceSecurity access

module (SAM)

Content Gatherin

g

Enterprise Crawler

Web Analyzer

Database Connector

Document

Processing

Content distributor

Content processor(s)

Indexing dispatcher

Search

Index/Search

Query result processor

Key

Heavy

Moderate

Light

Server Planning!

You can use your current 64-bit hardwareEnterprise class servers:

2U > 6 disks SAS 2xQuad Core CPUs (mid-range OK)Upgrade the memory to 32GB or more for servers hosting virtual environments

Upgraded RAID controller:Battery Backed Write Cache will improve performance and reliability

Disk Arrays

Direct attached storage provides the best performance for the cost100GB+

IE: 2x146GB SAS drives RAID 1

1TB, 2000 IOPSIE: 8x146GB 10K RPM SAS drives RAID 5

3TB, 3000 IOPSIE: 12x300 GB 10K RPM SAS drives RAID 5/50

Multinode Deployment

Multinode DeploymentAdd FAST Search to existing SharePoint installation

SharePoint 2010 and SQL in place firstFAST Search Admin first, followed by additional servers

SharePoint 2010

SQL

FAST SearchAdmin

FAST SearchServer

FAST SearchServer

Multinode

Admin ServerC:\FastSearch\installer\scripts> .\psconfig.ps1 -action i

-roleName admin -userName "domain\user" -localMachineName fully_qualified_local_server_name –databaseConnectionString database_connection_string -databaseName database_name

Non-admin ServerC:\FASTSearch\installer\scripts> .\psconfig.ps1 -action i

-roleName nonadmin -userName "domain\user" -localMachineName fully_qualified_local_server_name -adminMachineName fully_qualified_local_server_name

Post-Setup Configuration Scriptpsconfig.ps1

FAST Search ServicesConfigurable in deployment.xml file

Service Deployment Notes

admin 1 per installation

document-processor

As needed for feeding

content-distributor 1 per installation

indexing-dispatcher

1 per installation

crawler Single or Multi Includes browserengine

webanalyzer 1 if crawler configured

search-engine Defines row/column layout

Search can be disabled

query 1 or more for query interface

searchcluster Defines indexing rows

deployment.xml

:<host name="demo.contoso.com"> <admin /> <document-processor processes="4"> <crawler role="single"> <searchengine row="0" column="0" /> :</host> :

deployment.xml

:<searchcluster> <row id="0" index="primary" search=“true" /> <row id="1" index="secondary" search="true" /></searchcluster> :

Management and Monitoring

Manageability Key Concepts

Manage search using the administration UI dashboardAdminister search programmatically using PowerShell supportMonitor individual servers using standard tools (e.g. Event Viewer)Monitor farms using System Center Operations Manager (SCOM) alerting

Manageability - PowerShell

PowerShell is standard CLI for ObjectsVerbs, nouns, objects , pipes, and scripts

Get-FASTSearchContentCollectionNew-FASTSearchContentCollectionSet-FASTSearchConfiguration

Allows scripting of advanced configurations85 FAST Search cmdlets!

FAST Search & PowerShell

demo 1. Show the user interface we created

with people search and content search

2. A brief demo of PowerShell

Subsystems and data flow

Manageability – Event Logging

Dogfood & ManagementIndex of Microsoft’s intranet! (~100M documents)

You can do it!

FAST Search extends the capabilities of your SharePoint installation

Integrated search experienceCustomizable query & result featuresFlexible and familiar tools

Related TopicsQ&A

More about FAST Search

Hands On Labs (HOLs)Search Administration and ConfigurationDeveloping to the Query Object ModelSetting Up a Search Center with SharePoint SearchContent Processing with FAST Search for SharePointKeyword Management and Relevancy Tuning with FAST Search for SharePoint

Monday 1:15-2:30PM SPC261 Enterprise Search Overview

Tuesday

9:00-10:15AM SPC396 SharePoint Server 2010 Search - Capabilities Deep Dive

10:30-11:45AM SPC395 FAST Search for SharePoint - Capabilities Deep Dive

1:15-2:30PM SPC3991 Deploying SharePoint Server 2010

2:45-4:00PM SPC3992 Deploying FAST Search for SharePoint

4:30-5:45PM SPC3999 Search Relevancy and Relevancy Tuning

Wednesday

10:30-11;45AM SPC399 A Tour of Great Enterprise Search Applications

1:15-2:30PMSPC394 Overview of Content Acquisition for Search in SharePoint 2010

2:45-4:00PMSPC398 Solving Information Chaos – Advanced Content Processing with FAST Search for SharePoint

4:30-5:45PM SPC363 Social Search

5:45 - 7:00PM “Ask The Experts” (in Exhibit Hall)

Thursday9:00-10:15AM

SPC404 Customizing Search in SharePoint – Building Great Sites with Search

12:00-1:15PM SPC3990 Extending Search with Federation

Relevant Search Sessions

Come and see us at the Enterprise Search Group Stand in the Microsoft Product Pavilion

Far left hand corner of the Exhibition

Remember to fill out your evaluations on MySPC for your

chance to win two HD web cams and a designer mouse

(3 prizes awarded daily)

Learn More about SharePoint 2010

Information forIT Prosat TechNet

http://MSSharePointITPro.com

Information forDevelopers

at MSDNhttp://MSSharePointDeveloper.com

Information forEveryone

http://SharePoint.Microsoft.com

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after

the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.