from web analytics to engagement analytics
TRANSCRIPT
From Web Analytics to Engagement Analytics
Quality over Quantity
2
Table of Contents Executive Summary ...............................................................................................................................................................................................3
Engagement Analytics ...........................................................................................................................................................................................4
Measuring Quality with Engagement Value Points ............................................................................................................................................5
Engagement Analytics Examples..........................................................................................................................................................................7
Overall Marketing Effectiveness ..........................................................................................................................................................................7
Traffic Sources and Marketing Channels .............................................................................................................................................................9
Campaign Performance ......................................................................................................................................................................................11
Original Source Attribution ................................................................................................................................................................................13
Entry Pages .........................................................................................................................................................................................................14
Accelerating Marketing Effectiveness with Engagement Analytics ................................................................................................................15
3
Executive Summary Today marketers face the same problems online as they did at the turn of the century when one of America’s great business innovators, John
Wanamaker, made the oft-repeated statement: "Half the money I spend on advertising is wasted; the trouble is I don't know which half."
This is of course highly peculiar since in the online world everything is measurable in the most excruciating detail. So what is wrong?
Firstly, we should be measuring quality, not just quantity. But current web analytic tools aim to measure and increase the quantity of people coming to a
website. Web analytics is all about measuring aggregate average quantities; for instance, number of visits, percentage of new visitors, page views,
bounce rates, top assets downloaded, most popular entry pages, most visited pages, and so on. Secondly, we are not connecting the dots. Email is
tracked independently from the web which is tracked independently from the mobile web, social media and mobile apps.
When you meet with a customer online, you are essentially engaging in a conversation. An exchange of communication and commitment is taking place.
The level of commitment exhibited by your customer is the secret ingredient of quality that we call the Engagement Value. And it is the very basis of the
next generation of Engagement Analytics as it is built into Sitecore's Customer Engagement Platform.
Engagement Analytics gives marketers the power to answer Wanamaker's question. Marketers can now understand what drives engagement and
produces bottom line results, not what drives crowds and burns money.
4
An active online marketing strategy can involve hundreds of campaigns, like these
shown here. Tracking conversion rates for so many campaigns can be overwhelming.
Engagement Analytics Engagement Analytics measures quantity, quality, and the relationship between the two. Quantity is everything you know from web analytics today.
Quality is the level of commitment achieved by your customers.
Online marketing analytics tools somewhat express quality as conversion percentages, such as visitors having signed up for a newsletter. The trouble
with this is that when you have more than three conversions the complexity gets overwhelming as the chart of multiple campaigns below clearly shows.
Marketers need this barrier of complexity distilled down to a simple measure of quality; which we call the Engagement Value.
Another measure used by Engagement Analytics is Relevance, the relationship between quality and quantity. If, for example, you run two identical
AdWord campaigns on Google and Bing, and the latter has twice the quality per visit, then you must conclude that the ad running on Bing has more
relevance for the customers it attracts.
Marketers using Engagement Analytics can learn exactly which part of their marketing mix creates the greatest impact, which parts of their website draw
the highest quality visitors, and where they should spend their marketing dollar.
5
Measuring Quality with Engagement Value Points When you meet with a customer online, you are essentially engaging in a conversation. An exchange of communication and commitment is taking place.
Every website has these critical points of engagement where your customer performs a commitment exchange. These are points that increase the
visitor’s engagement, where the visitor and vendor build trust and communication. These are the points that we capture and measure in the
Engagement Value.
For example, just visiting a web page requires little trust and is a one-way transfer of information.
However, registering for a newsletter requires a modest amount of trust between the visitor and site
owner. And the information exchange that comes from that newsletter in turn increases trust and
communication eventually leading to more commitment.
Most websites have multiple critical points of engagement along this ongoing conversation. Each of these
critical points has an Engagement Value based on the level of commitment. It’s like shopping in the brick
and mortar world. The owner of an electronics store might feel some satisfaction watching people
attracted to window displays of TVs, but there is little engagement with the people. The owner gets
excited when people walk into the store. That takes a modest amount of engagement. When a browser
asks 3D TV specific questions, they show an even higher level of engagement. Finally, when the prospect
buys a 3D TV their engagement is undeniable.
What constitutes commitment will vary for each kind of business:
For a commerce site, the sale of goods is a straightforward commitment. The Engagement Value could
simply be the dollar amount sold. The more you sell, the larger the commitment.
For many sites, commitments such as signing up for a newsletter, requesting a sales call, asking a question, creating an account, or revealing your
purchase timeframe, all constitute undeniable commitment on behalf of the customer. We call these transactional commitments. They require a deeper
commitment than just viewing a page or downloading an asset. Going back to the example of a commerce site, signing up for a newsletter or subscribing
for product updates, are also acts of transactional commitment that should be given an Engagement Value.
Some sites may not have points with deeper transactional commitment. On those sites you may need to place the Engagement Value on a specific page
being viewed or a specific asset being downloaded. These points are called referential commitments. Use them cautiously. Referential commitments
Lead Score vs. Engagement Value
Lead score, as known from some vendors, is
very different from Engagement Value. Lead
score is what you use to identify customers
you believe are showing signs of wanting to
commit, but not yet having committed. Lead
score is commonly only of interest in B2B
settings and is used to surface prospects to
the sales force in combination with GeoIP
information. While Sitecore can capture lead
scores it is not usually of importance in
Engagement Analytics.
6
can lure you into faulty conclusions about your website’s effectiveness. Only use referential commitments when your website has no points that require
the deeper transactional commitment.
Two examples where referential commitments cause faulty conclusions are book bestseller lists and Top Hits song lists. Just being on either list
guarantees greater visibility and a perception of desirability and quality. Gaining a spot on the list creates a self-fulfilling prophecy. Once a book or song
is on the list it’s guaranteed more sales, which keeps its sales high. The books or songs only fall off the list when the sales potential is saturated or the
audience becomes bored. This same effect can happen by putting an Engagement Value on an asset and then giving the asset more marketing effort
because you believe it has more value. With more marketing effort it gains more Engagement Value and becomes a self-fulfilling prophecy.
There is far more we can do with Engagement Value Points (EVP) than identify visitors who accumulate value. EVP are key to Engagement Analytics and
key to increasing your marketing effectiveness. EVP are critical to identifying the effectiveness of marketing through the use of your website, email
campaigns, mobile web, landing pages, and more.
For a website with occasional transactional commitments the Engagement Value Points might be:
Newsletter Registration 25 EVPs
Online Pricing Quote 50 EVPs
Request for Demo 100 EVPs
Even with just three such transactional commitments, Engagement Analytics works wonderfully well. The number used as an Engagement Value Point is
not of importance but the ratio between EVPs is important. Here the marketer has established that four newsletter registrations have the same value as
one demo request. Often you will have evidence to help you easily come to such conclusions. In a worst case scenario you will at first have to use your
intuition and later you can validate and refine the Engagement Value through analysis.
How do we create and track these Engagement Value Points and develop a system of Engagement Analytics? The Sitecore CMS makes it easy to apply
Engagement Value Points to critical points on a website, such as registrations and demonstration requests (without coding, of course).
Engagement Value Points are like a currency, which when allocated properly can be converted into real currency. There is an exact correlation in your
website between where there is a high Engagement Value and where revenue is generated. This makes Engagement Value an excellent tool for
forecasting revenue.
7
Engagement Analytics Examples Sitecore’s Engagement Analytics make it straightforward for any marketer, not just web analysts, to identify how and where to improve marketing
effectiveness and customer engagement. Let's take a look at a few examples.
Overall Marketing Effectiveness
Most web analytics charts show the change in visitors over time. However, if we also consider the total EVP accumulated by visitors we can see whether
our online marketing efforts are increasing the overall value we deliver to visitors. The figure on the right below shows that while the rate of visits is
increasing, the total EVP rate is decreasing over the last quarter. This means marketing effectiveness is decreasing – the value being delivered per visitor
is decreasing. A good way to measure this rate of marketing effectiveness is with Relevance. Relevance is the Value per Visit. You can also think of it in
these terms: if your website has more relevance to your customers, your marketing effectiveness will increase.
8
In traditional web analytics, as shown in this Google Analytics screen,
traffic simply measures how many visitors come to your website. Systems
like this only measure quantity and don’t evaluate quality or which traffic
sources produce visitors with the highest quality and value. With systems
like these your website traffic could be increasing while your marketing
effectiveness decreases-yet you wouldn’t even know it. Also, web
analytics systems like these can only analyze a cross-channel marketing
mix after extensive and time-consuming customization and
segmentation.
Engagement Analytics shows you the value and marketing effectiveness of
your website over time. It measures how relevant your website is to visitors
and their level of commitment. In the figure above, the green Relevance
bars (value/visitors) is greater in Q2 than in Q1. This was caused by a
decrease in visitors with a simultaneous increase in value - although there
were fewer visitors in Q2 their quality was better. The result was increased
marketing effectiveness in Q2.
In Q3 the grey line shows a significant increase in visitors, causing the
green Relevance bar to drop back to Q1 levels. That means the website has
significantly increased its visitors, but the Value per Visit has returned to
previous Q1 levels. Marketing managers should use the Executive Insight
Dashboard to investigate what traffic types and campaigns caused such an
increase in Relevance in Q2. Then they should explore how they can again
increase visitor levels while retaining high Relevance.
9
Traffic Sources and Marketing Channels
In Engagement Analytics visits are segmented into their respective traffic source or channels. For example, traffic from Google and Bing aren’t just
"search engine traffic". Search engine traffic is broken down into paid traffic (AdWords), organic search engine traffic (visitors that searched for a term
without using your company name), and organic branded search engine traffic (visitors that searched for a term including your company name). This
enables you to relate each marketing result directly back to the channel and marketing role responsible.
Web analytics can show you the total traffic from a source, but it can’t show you the Engagement Value or Relevance of that source, and normally the
sources do not map to meaningful initiatives in your marketing department. The following figure displays a Google Analytics report giving a high altitude
view of visits by traffic source. From this view you cannot distinguish the important difference between traffic driven as a result of brand awareness
(branded search engine traffic), organic search engine traffic (where you normally invest your SEO efforts), and paid advertisements. If you want to
differentiate between a wide variety of traffic types, then out-of-the box web analytics systems require extensive and time-consuming segmentation and
coding. For many companies this extra overhead means it never gets done. As a consequence your web marketing isn’t as effective as it could be.
With the Engagement Analytics report on the right you can see the percentage of total Engagement Value and Relevance (Value per Visit) for each
channel. You can even drill into the analysis to see the Engagement Value or Relevance by grouped or individual campaigns. The data is there so you can
make accurate marketing spend decisions.
10
Traffic source information for web analytics systems focuses on an IT-
skewed view of sources of aggregate visitors. To see Traffic Source
detail in Google Analytics you have to drill down and this still won’t
show you the Engagement Value or Relevance by traffic type over
time. Web analytics won’t give you insight into which traffic source or
type contributes to visitor commitment and marketing effectiveness.
Using Engagement Analytics you can compare the marketing results of
different traffic types. This gives you the power to tune cross-channel
marketing for optimal effectiveness. In this figure, the extracted pie wedge
shows that organic SEO efforts are responsible for 19.7% of the total site
value. The Relevance of organic SEO is 1.71, shown by the topmost green bar.
The rightmost table shows that Organic SEO Relevance has increased by
almost 32% from the previous year’s quarter. This type of analysis makes it is
easy for you to decide if your SEO investments are paying off compared to
alternative investments.
11
Campaign Performance
With Engagement Analytics it’s obvious which campaigns produce the total greatest value and the highest relevance – just compare the Total
Engagement Value and Relevance for each campaign.
Many web analytics systems identify the campaign that produces the most visitors, but they can’t help you identify the campaigns that produce the
highest quality visitors. The figure on the left shows a Google AdWords screen designed to help you budget your marketing spend between multiple
campaigns. Identifying greater detail in web analytics requires coding custom goals for each campaign, creating segmentation, and building reports. All
that takes time, people, and technical skills. The figure on the right shows the Engagement Analytics chart that helps you quickly identify the campaign
producing the greatest value. When you select a campaign from this chart a pop-up shows you how the campaign’s Relevance, its Value per Visit, is
changing over time. Engagement Analytics is ready-to-run with minimal overhead.
12
Most web analytics systems can show a lot of detail, but that detail makes it
difficult for marketers to identify which campaigns produce the highest
quality and relevance. In this example, Google AdWords is focused on
budgeting your ad dollars rather than helping you maximize your marketing
results.
Engagement Analytics quickly show you which campaigns produce the
best results. In this figure the chart behind shows campaigns sorted by
Relevance (Value per Visit). The green bars in the rearmost chart show
each campaign’s Relevance, so it’s easy to see which campaign
produces the greatest marketing effectiveness. The pop-up chart
shows how the Value, Visits, and Relevance for the selected campaign
change over time.
13
Original Source Attribution
By tracking each visit of each visitor we can attribute Engagement Value or Value per Visit back to the origin of the first visit. This powerful information
enables marketers to understand which original activities drove future engagement. The figure on the right shows the Value per Visit for visitors who
first came to the site through each of the traffic types.
With Engagement Analytics you can determine which traffic type, pages and transaction points are most effective over a long sales cycle. An important
part of marketing analysis is identifying the first point of contact for high value visitors. This lets the CMO know where to focus marketing efforts to
attract new visitors.
The chart on the right shows the Relevance for first contacts. Newsletters, paid search, and blogs have the highest Relevance for contacting new visitors
who later accumulate a high value. This is critical information for the CMO who wants to know which traffic type is most effective.
The chart on the left shows the Relevance for all traffic types across all visits over time. Over the long term newsletters, paid search, and analyst reports
are most effective in delivering Relevance. From these two charts we can see the marketing mix required to capture initial contacts and then retain them
over a long sales cycle.
14
Entry Pages
Engagement Analytics can show you which entry pages lead to high values. The figure on the right makes it obvious which entry pages accumulate the
highest relevance. Most web analytics, like the Google Entry Page screen on the left, are designed to only show which entry pages have the highest
number of visitors. While this might help you increase the number of visitors to your site, it does nothing to help you increase the quality of visitors to
your website. In the figure on the right you can even drill down on a specific entry page to see which traffic sources and search keywords lead to a good
performance on the entry page in question.
Web analytics software, like this Google Analytics screen, enables you
to see which entry pages have a lot of visitors. You can even segment
the view to see how visitors change by time frame, country and other
segments. While these views may help you identify which entry pages
attract a high number of visitors they won’t help you increase the
quality of visitors without an extensive overhead of segmentation and
coding.
Engagement Analytics enables you to quickly see which entry pages
contribute most to the value of your website. The campaigns, keywords, or
topics used in these high-value entry pages can be used to increase the value
of other areas of your website. In this screen campaigns have been sorted by
the Value per Visit or Relevance. Mousing over a campaign shows how it has
contributed to marketing effectiveness over time.
15
Accelerating Marketing Effectiveness with Engagement Analytics Every marketing department needs to know exactly how and where they engage the high-value visitors that are
most likely to become prospects. If you can’t determine how and where to engage high-value visitors, then you are
doing shotgun marketing – you are wasting money by broadcasting campaigns across a wide swath in the hopes of
hitting something of value. In the high-speed world of web marketing you can’t survive with this approach.
To accelerate your marketing effectiveness you must know how to engage customers where they expect and want
to be engaged. And you must coordinate that across multiple marketing channels. Engagement Analytics is clearly
the way to make your cross-channel marketing more engaging and effective.
John Wanamaker would have loved online marketing and Engagement Analytics. But, he’d have to change his quote
about wasting half his marketing budget. With Engagement Analytics he would be saying: “I know why I spend each
marketing dollar and I know exactly where to get the best impact with my next marketing dollar.”
Many companies spend hundreds
of thousands of dollars on Google
AdWords for their own brand. With
Engagement Analytics you can
quickly determine if these funds
might be better allocated to other
areas.