emily hossellman-lunch & learn presentation november 4, 2016
TRANSCRIPT
![Page 1: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/1.jpg)
1
Getting Customer ValidationOf Your Product Before Release
![Page 2: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/2.jpg)
2
Meet the Speaker
Emily HossellmanDirector of Marketing @ [email protected]@ehossellmanlinkedin.com/in/emilyhossellman
![Page 3: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/3.jpg)
3
Who is Centercode?
Services Run hundreds of fully managed beta tests and programs
Software Built a complete beta program management platform
Testers Grown a community of 150k+ deeply profiled testers
Content Created a library of free tools and best practices
![Page 4: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/4.jpg)
Agenda
1. The importance of customer validation
2. Running a beta test
a. Planningb. Recruitingc. Managingd. Closing
3. Leveraging the data post-beta
4. Optimizing your beta program
5. Q&A4
![Page 5: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/5.jpg)
5
Role of Customer Validation
![Page 6: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/6.jpg)
The Role of Customer Validation
6
I've built an amazing product.
I'm so excited to launch it.
...But will people like it?
![Page 7: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/7.jpg)
7
Beta Testing =Customer Validation
Real, targeted customers using your product in real environments
Increases quality, improves user experience, validates performance
Other names: CAT, UAT, FUT, Customer Evaluation, Field Trials, Pre-Release
![Page 8: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/8.jpg)
8
Do I Need to Run a Beta Test?
Short answer: Yes
● Any product with an end user needs customer validation
● All product types: B2B, B2C, software, hardware, mobile, new, revision
● Much less expensive and risky to fix issues before launch than after
![Page 9: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/9.jpg)
9
What Beta Brings to the Table
1. Introduces you to your target audience
2. Facilitates a real, meaningful conversation
3. Gives you the opportunity to really listen
![Page 10: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/10.jpg)
10
The Impact of Beta
Development
Product Management
Development/QA
Usability
Product Management
Support
Marketing
Sales
Beta impacts every part of your product:
![Page 11: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/11.jpg)
11
What You Can Achieve During Beta
Not just technical check → Customer validation
● Sanity check / Will they use it
● Out-of-box experience
● Test for interoperability/compatibility
● Prepping support processes
● Marketing insights
● Diversity - more eyeballs, more environments, more use cases
![Page 12: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/12.jpg)
How To Do It Right
12
PeopleA qualified and capable team --
in the right place at the right time.
PlatformA flexible, secure,
beta-focused tool set
ProcessesWell-planned, robust, adaptable processes
![Page 13: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/13.jpg)
13
Running Your Beta
![Page 14: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/14.jpg)
14
The Process
Planning
Recruiting
Shipping/Distribution
Managing
Closing
![Page 15: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/15.jpg)
15
Planning
1. Identify your stakeholders
2. Set (some) objectives
3. Determine your tester breakdown
4. Plan out your schedule
5. Outline your workflows/processes
![Page 16: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/16.jpg)
16
Recruiting
1. Create a qualification process
2. Craft a compelling message
3. Build a community of potential testers
4. Review applications
5. Select a balanced tester team
![Page 17: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/17.jpg)
17
Shipping/Distribution
1. Create a process for shipping/distribution
2. Keep records
3. Complete the new user experience
4. Plan for failed units/downloads
5. Keep your testers in the loop
![Page 18: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/18.jpg)
18
Managing
1. Collect the right feedback
a. Collect a variety of feedback
b. Check alignment from the beginning
c. Get the right details
d. Mimic real world feedback
2. Create a great testing experience
a. Support your testers
b. Build a feedback loop
3. Triage feedback on the backend
![Page 19: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/19.jpg)
19
Closing
1. Get final feedback
2. Distribute incentives
a. Decide whether testers get to keep it
b. Hold onto rewards until the test is over
c. Say "thank you!"
3. Manage the data
d. Clean and organize the data
e. Pull out & highlight interesting insights
f. Get prioritized data to your stakeholders
![Page 20: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/20.jpg)
20
Leveraging the Data
![Page 21: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/21.jpg)
21
Improve Quality
● Prioritize your bugs using scoring
● Attach test platforms
● Use the data to justify changes
![Page 22: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/22.jpg)
22
Prepare Support
● Improve documentation based on hurdles testers faced
● Prepare for known issues
● Build in more customer feedback mechanisms
![Page 23: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/23.jpg)
23
Fuel Marketing & PR
● Build a trove of user generated content (quotes, videos, testimonials)
● Find what testers loved about your product
● Use data to back up marketing claims
● Find new use cases
● Identify/cultivate evangelists
● Leverage your commitment to customer feedback
![Page 24: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/24.jpg)
24
Optimizing Your Betas
![Page 25: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/25.jpg)
Optimizing Your Beta Program
25
● Dedicate the Resources
● Design Quality Feedback Mechanisms
● Improve Feedback Workflow
● Increase Beta Participation
● Invest in Beta Management Tools
People
PlatformProcesses
![Page 26: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/26.jpg)
26
Final Thoughts
● Beta testing is your chance to get true customer validation
● Plan out your priorities and stakeholders
● Set up your test well and the feedback will come naturally
● Trends will emerge, look for alignment
● Listen to the feedback
![Page 27: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/27.jpg)
27
Q&A
Emily Hossellman
Director of Marketing @ Centercode
@ehossellman
linkedin.com/in/emilyhossellman
![Page 28: Emily Hossellman-Lunch & Learn Presentation November 4, 2016](https://reader034.vdocuments.us/reader034/viewer/2022042723/587a06bd1a28ab01268b5b37/html5/thumbnails/28.jpg)
28
Thank You!