SharePoint AnalyticsNICKI BORELLCONSULTANT / EVANGELISTSHAREPOINT & OFFICE 365MCSE, MCDBA, MCITP

Analytics is……also party of SharePoint Online

…Usage Analytics is also party of SharePoint Foundation

…a really powerful reporting Engine

All About Analytics

…a perspective on the final result

DB´sPropertie

s

AnalyticsIndexTimer Jobs

Crawler Logs

Events

Configuration

PowerShell analysisenginepssnapin

SharePoint 2013 Analytics

Topics Some fundament

als

Manage Analytics

Search Analytics

Usage Analytics

Events Getting Reports

Some fundamentals

The different types of analyses:

Analytics Processing Component runs two main types of analyses:

• Search analytics• analyzes content in the search index,

• Usage analytics:• analyzes the user actions.

Some fundamentals

Analytics

Search Analytics

Usage Analytics

Some fundamentals Search Analytics Usage Analytics

%working folder

%

Link DB

Analytics Reportin

g

Index

ULS loggs

Analytics Processing Component

WFE

%working folder

%

Analytics Reportin

g

Index

Event Store

Analytics Processing Component

Files, Folders and their interaction

Recap fundamentals Search Analytics Usage Analytics

%working folder

%

Link DB

Analytics Reportin

g

Index

ULS Logs

Analytics Processing Component

WFE

%working folder

%

Analytics Reportin

g

Index

Event Store

Analytics Processing Component

Session Session Room Time

Search architecture and sizing in SharePoint 2013 SPC336 Titian 2201 Wed 5:00pm

Manage Analytics

• Timer Jobs

• PowerShell for SharePoint 2013 Analytics Feature

• Microsoft.Office.Server.Search.Analytics namespace

• Files & Folder Locations

Manage Analytics

Timer JobsUsage Analytics:Usage Analytics Timer Job for Search Application Search

• Periodically schedules processing of the Usage Analytics analysis

SharePoint Foundation Usage Data Processing• Checks for expired usage data at the farm level and deletes the data

SharePoint Foundation Usage Data Import• Imports usage log files into the event store

Search Analytics:Analytics Event Store Retention

• Periodically cleans up the Event Store and the Reporting Database

Analytics Timer Job for Search Service Application• Periodically schedules analytics for Search Service Application

• Analytics feature is not part of the common SharePoint PowerShell Snapin

•Get / Set settings for component using• Get-AnalysisConfiguration [-Name] <string>…• Set-AnalysisConfiguration [-Name] <string>…

PowerShell for Analytics

PowerShell for Analytics

Recap managing Analytics

Analysisenginepssnapin:• Get / Set settings for

component…is about the definition of “how” it

is happening

Enginepssnapin:• Get-Flow

…is about the definition of “what” is happening

! Manipulations are not for production use, nor supported by Microsoft.

! The Content Enrichment Web Service is the primary documented and supported mechanism for implementing "custom" processing logic in SharePoint Search 2013.

Topics Some fundament

als

Manage Analytics

Search Analytics

Usage Analytics

Events Getting Reports

Search Analytics

Search AnalyticsAnalyses in search analytics:

• Anchor text processing

• Click Distance

• Search Clicks

• Social Tags

• Social Distance

• Search Reports

• Deep Links %working folder

%

Link DB

Analytics Reportin

g

Index

ULS Logs

Analytics Processing Component

Search Analytics

Recap Search AnalyticsAnalyses in search analytics:

• Anchor text processing

• Click Distance

• Search Clicks

• Social Tags

• Social Distance

• Search Reports

• Deep Links

Session Session Room Time

Managing Search Relevance in SharePoint 2013 and O365 SPC382 Veronese 2401 Thu 12:00pm

%working folder

%

Link DB

Analytics Reportin

g

Index

ULS Logs

Analytics Processing Component

Usage Analytics

• SharePoint Server 2013 includes some default user usage events:

• Views• Recommendations displayed• Recommendations clicked• …

• In addition to the default events, you can add up to twelve custom events.• All usage events are counted per item, site collection, and tenant.

Usage Analytics

Create Usage event types in SharePoint Server 2013

• You can create up to twelve custom usage event types by using Windows PowerShell.

• A custom usage event has several properties

• You have to add code to the place where the event occurs - for example, when a page loads, or when a user clicks a link or a button.

• This data is then sent to the analytics processing component, where it is recorded and processed.

Events

Usage Events

Recap Usage EventsUsage analytics:

• analyzing usage log information received from the front-end

• generates usage and statistics reports.

• The results from the analyses are added to the items in the search index..

• We can add up to twelve custom events.

Session Session Room Time

Search content enrichment and extensibility in SharePoint 2013 SPC414 Palazzo K, L Wed 1:45pm

WFE

%working folder

%

Analytics Reportin

g

Index

Event Store

Analytics Processing Component

Topics Some fundament

als

Manage Analytics

Search Analytics

Usage Analytics

Events Getting Reports

Getting Reports

• Out of the box reports

• Custom Solutions with PowerPivot

• PowerShell & custom code

Getting Reports

• Usage Analytics:

• Search Analytics:

Out of the box reports

Custom Solutions with PowerPivot

SSISAnalytics

Reporting

[dbo].[SearchReportsData]

Staging DB

Metadata

AnalyticsReportingDB• SnapShot• Backup • Logshipping• etc.

Custom Solutions with PowerPivot

PowerShell & custom code

PowerShell (thx to Radu Tut): Get Usage Report:• $searchApp.GetRollupAnalyticsItemData …

Get Search Report:• $searchApp.GetSearchReport …

Custom Code:

https://github.com/ThorstenHans/SPC340

Getting Reports data using PowerShell

Get analytics reports programmatically

• References

• Microsoft.Office.Server.Search

• Microsoft.Office.Server.Search.Applications

• Access data by using

• SearchServiceApplicationProxy.GetSearchReport

• SearchServiceApplicationProxy.GetRollupAnalyticsItemData

Consume Analytics Data using FTC

• How to get analytics reports programmatically in SharePoint 2013?• http://social.technet.microsoft.com/Forums/de-DE/54310f5f-e8a3-469e-86a3-63781b91670d/how-to-get-a

nalytics-reports-programmatically-in-sharepoint-2013?forum=sharepointdevelopment

• Overview of analytics processing in SharePoint Server 2013• http://technet.microsoft.com/en-us/library/jj219554.aspx

• Custom Events• http://technet.microsoft.com/en-us/library/jj715889.aspx

• Analytics Feature @SharePointTalk.net• http://www.sharepointtalk.net/search/label/Analytics

Helpful Links

Session Session Room Time

Develop Advanced Search-Driven SharePoint 2013 Apps SPC402 Palazzo I, J Tue 1:45pm

Best practices for Hybrid Search deployments SPC306 Veronese 2401 Tue 5:00pm

SharePoint 2013 Search Analytics SPC340 Palazzo M, N Wed 9:00am

How to manage and troubleshoot Search: A practical guide SPC375 Veronese 2401

Wed 10:45am

6 Proven Steps to Get the Best Out of Search in SharePoint 2013 SPC265 Delphino 4001 Wed 1:45pm

Best practices for Information Architecture and Enterprise Search SPC207 Veronese 2401 Wed 1:45pm

Search content enrichment and extensibility in SharePoint 2013 SCP414 Palazzo K, L Wed 1:45pm

Customizing Search experiences with Azure Hosted Data and Bing Maps

SPC321 Veronese 2401 Wed 3:15pm

Futuristic Search applications using Kinect and Yammer! SPC405 Palazzo M, N Wed 3:15pm

Search architecture and sizing in SharePoint 2013 SPC336 Titian 2201 Wed 5:00pm

Effective Search deployment and operations in SharePoint 2013 SPC360 Veronese 2401 Thu 9:00am

SharePoint 2013 Search display templates and query rules SPC322 Palazzo M, N Thu 9:00am

Managing Search Relevance in SharePoint 2013 and O365 SPC382 Veronese 2401

Thu 12:00pm

Searc

h R

ela

ted S

ess

ions

questions?

HTTP://WWW.SHAREPOINTTALK.NET

@NICKIBORELL