effective techniques for measuring your content's success
DESCRIPTION
Christine Perfetti's presentation from Confab 2011: How can you be confident that your content pages are understandable? How do you assess if the content is appropriate for your audience? How do you ensure you've written content that effectively communicates the essential information? It turns out there are many different techniques for measuring your content. In this presentation, Christine Perfetti will show you some methods you've probably never heard of -- techniques only practiced by the most adventuresome content strategists.TRANSCRIPT
![Page 1: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/1.jpg)
Essential Techniques for Measuring Your Content’s Success
Christine Perfetti www.perfettimedia.com @cperfetti
Perfetti Media
Confab 2011 Conference 1
![Page 2: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/2.jpg)
Perfetti Media
Confab 2011 Conference 2
![Page 3: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/3.jpg)
Perfetti Media
Confab 2011 Conference 3
![Page 4: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/4.jpg)
Perfetti Media
Confab 2011 Conference 4
![Page 5: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/5.jpg)
Perfetti Media
Confab 2011 Conference 5
![Page 6: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/6.jpg)
Perfetti Media
Confab 2011 Conference 6
![Page 7: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/7.jpg)
Perfetti Media
Confab 2011 Conference 7
![Page 8: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/8.jpg)
Perfetti Media
Confab 2011 Conference 8
![Page 9: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/9.jpg)
800,000 of Microsoft’s pages have never been loaded from the server
Perfetti Media
Confab 2011 Conference 9
![Page 10: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/10.jpg)
Measuring your content’s success
Teams have many tools for measuring their content
Web analytics
Traditional usability tests
Advanced content measurement techniques
5 second tests
First click tests
Inherent value tests
Comprehension tests
Catalog-based tests
Perfetti Media
Confab 2011 Conference 10
![Page 11: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/11.jpg)
Are web analytics the solution?
Web analytics are the most common technique for evaluating content
Data sources
Visitor traffic and server logs
Conversion funnels
Search engine logs
Perfetti Media
Confab 2011 Conference 11
![Page 12: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/12.jpg)
Web Analytics Have Limitations
Perfetti Media
Confab 2011 Conference 12
![Page 13: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/13.jpg)
Web Analytics Are Just a Starting Point
Web analytics highlight potential problem areas
Tells you what is happening on the site
Doesn’t tell you why users behave in a particular way
Perfetti Media
Confab 2011 Conference 13
![Page 14: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/14.jpg)
The Best Approach for Content Evaluation
Design teams and content strategists need to observe people interact with their content
Assess where content fails to address users’ questions, concerns, and opportunities
Identify where content successfully excites and engages users
Perfetti Media
Confab 2011 Conference 14
![Page 15: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/15.jpg)
Traditional usability tests
A usability test involves putting your users in front
of your product and observing what they do
Perfetti Media
Confab 2011 Conference 15
![Page 16: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/16.jpg)
Perfetti Media
Confab 2011 Conference 16
![Page 17: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/17.jpg)
Perfetti Media
Confab 2011 Conference 17
![Page 18: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/18.jpg)
Perfetti Media
Confab 2011 Conference 18
![Page 19: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/19.jpg)
Perfetti Media
Confab 2011 Conference 19
![Page 20: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/20.jpg)
How did users perform?
Perfetti Media
Confab 2011 Conference 20
![Page 21: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/21.jpg)
Running a test session
Greet the user
Introduce user to observers
Explain to user how the test will work
Give the user tasks to complete and observe problems they experience
General Q&A
Debrief with observers
Perfetti Media
Confab 2011 Conference 21
![Page 22: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/22.jpg)
Start testing your content
anywhere
Perfetti Media
Confab 2011 Conference 22
![Page 23: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/23.jpg)
Signs of content and design failure
Back button
Pogosticking
Going to Search
FAQs, Help, and Site Map
Perfetti Media
Confab 2011 Conference 23
![Page 24: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/24.jpg)
The Handbook of Usability Testing, 2nd EditionJeffrey Rubin and Dana Chisnell
A Practical Guide to Usability TestingJoseph Dumas and Janice (Ginny) Redish
Don’t Make Me ThinkSteve Krug
Perfetti Media
Confab 2011 Conference 24
![Page 25: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/25.jpg)
Advanced techniques for measuringcontent
Techniques for answering specific questions about your content
5 Second Test
First Click Test
Inherent Value Test
Comprehension Test
Catalog-based Test
Perfetti Media
Confab 2011 Conference 25
![Page 26: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/26.jpg)
Research Question
How do we measure the success of
content pages?
Perfetti Media
Confab 2011 Conference 26
![Page 27: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/27.jpg)
5 Second Page Tests
Quick and dirty technique for measuring content pages
Takes less than 10 minutes to run
Measures if content pages quickly convey their purpose
Perfetti Media
Confab 2011 Conference 27
![Page 28: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/28.jpg)
Sharing your pictures online
You want to post pictures online from your last vacation
You are concerned that the upload process will be difficult
How confident are you that you can upload photos quickly and easily?
Perfetti Media
Confab 2011 Conference 28
![Page 29: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/29.jpg)
Perfetti Media
Confab 2011 Conference 29
![Page 30: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/30.jpg)
Perfetti Media
Confab 2011 Conference 30
![Page 31: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/31.jpg)
Sharing your pictures online
You want to post pictures online from your last vacation
You are concerned that the upload process will be difficult
How confident are you that you can upload photos quickly and easily?
Perfetti Media
Confab 2011 Conference 31
![Page 32: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/32.jpg)
Perfetti Media
Confab 2011 Conference 32
![Page 33: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/33.jpg)
Perfetti Media
Confab 2011 Conference 33
![Page 34: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/34.jpg)
Sharing your pictures online
You want to post pictures online from your last vacation
You are concerned that the upload process will be difficult
How confident are you that you can upload photos quickly and easily?
Perfetti Media
Confab 2011 Conference 34
![Page 35: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/35.jpg)
Perfetti Media
Confab 2011 Conference 35
![Page 36: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/36.jpg)
Perfetti Media
Confab 2011 Conference 36
![Page 37: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/37.jpg)
Not for the Home Page
Perfetti Media
Confab 2011 Conference 37
![Page 38: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/38.jpg)
Research Question
How do we measure the success of
the home page?
Perfetti Media
Confab 2011 Conference 38
![Page 39: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/39.jpg)
Perfetti Media
Confab 2011 Conference 39
![Page 40: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/40.jpg)
First Click Test
Useful method to assess where users first click on your site’s home or entry page
Provide users with a specific task to complete when they arrive at the site
By observing where users first click, it’s a clear indicator whether they’ll eventually be successful
Perfetti Media
Confab 2011 Conference 40
![Page 41: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/41.jpg)
Perfetti Media
Confab 2011 Conference 41
![Page 42: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/42.jpg)
Perfetti Media
Confab 2011 Conference 42
![Page 43: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/43.jpg)
Perfetti Media
Confab 2011 Conference 43
![Page 44: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/44.jpg)
art.yale.edu
Perfetti Media
Confab 2011 Conference 44
![Page 45: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/45.jpg)
Research Question
Do users understand your product or
site’s complex content?
Perfetti Media
Confab 2011 Conference 45
![Page 46: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/46.jpg)
Comprehension Test
Pages containing complex content Such as policies or procedures
How your product works
User comprehension is imperative to their success
Questions determine if users understand content
Perfetti Media
Confab 2011 Conference 46
![Page 47: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/47.jpg)
Perfetti Media
Confab 2011 Conference 47
![Page 48: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/48.jpg)
Research Question
How well does the site communicate the
value of the product or service?
Perfetti Media
Confab 2011 Conference 48
![Page 49: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/49.jpg)
Perfetti Media
Confab 2011 Conference 49
![Page 50: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/50.jpg)
Variant of traditional usability test
Identifies why loyal users love the site/service
Determines if new users see the same value
Inherent value test
Perfetti Media
Confab 2011 Conference 50
![Page 51: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/51.jpg)
Two phase test
Phase I: Identifies the value of the site for loyal users
Ask existing customers to give you a tour of your site or product
Ask them to share what they find most valuable about your product
Phase II: Do new users see the same value?
Perfetti Media
Confab 2011 Conference 51
![Page 52: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/52.jpg)
Research Question
What information is most important to
users?
Perfetti Media
Confab 2011 Conference 52
![Page 53: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/53.jpg)
Catalog-Based Task Testing
User or task understanding is fuzzy
Print brochure/catalog describes products or services
Ask users to review catalog and highlight important content
Can they easily find the same content on your web site?
Perfetti Media
Confab 2011 Conference 53
![Page 54: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/54.jpg)
Perfetti Media
Confab 2011 Conference 54
![Page 55: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/55.jpg)
Thank You!
Web: www.perfettimedia.com
Twitter: @cperfetti
Email Newsletter: UX Ideas
One-day Workshop: Measuring Your Content’s Success
Perfetti Media
Confab 2011 Conference 55
![Page 56: Effective Techniques for Measuring Your Content's Success](https://reader033.vdocuments.us/reader033/viewer/2022052822/554bb064b4c905b3618b58e9/html5/thumbnails/56.jpg)
What about A/B Tests?
5% conversion rate 11.6% conversion rate
Perfetti Media
Confab 2011 Conference 56