custom calculations: your business is unique — shouldn't your metrics be?

34
Custom Calculations Your business is unique — shouldn’t your metrics be? October 14, 2015 Presented by

Upload: looker

Post on 07-Jan-2017

347 views

Category:

Software


0 download

TRANSCRIPT

Page 1: Custom Calculations: Your business is unique — shouldn't your metrics be?

Custom CalculationsYour business is unique — shouldn’t your metrics be?

October 14, 2015

Presented by

Page 2: Custom Calculations: Your business is unique — shouldn't your metrics be?

— This webinar will be recorded

— We will take questions at the end

— Looker demo at the end

Welcome & Webinar Overview

Page 3: Custom Calculations: Your business is unique — shouldn't your metrics be?

Anika Kuesters-Smith,Pre-Sales Analyst

Levi Davis,Professional Services Analyst

Meet our presenters

Page 4: Custom Calculations: Your business is unique — shouldn't your metrics be?

Moving beyond high-level KPIs

Benefits of custom metrics

How to identify key metrics and roll them out to the entire organization

Overview for Today

Page 5: Custom Calculations: Your business is unique — shouldn't your metrics be?

Moving Beyond High-Level KPIs

Page 6: Custom Calculations: Your business is unique — shouldn't your metrics be?

The Case for High-Level Metrics

Increased EngagementUsing visuals to draw in the less data inclined

Clarity and PriorityTeams driving towards a singular goal set

Data-Driven CultureData as the source of truth

Page 7: Custom Calculations: Your business is unique — shouldn't your metrics be?

Profit is going up, up, up!!!

Page 8: Custom Calculations: Your business is unique — shouldn't your metrics be?

Even if high-level metrics look good,

there are often opportunities hidden

in the data

Access to dashboards does not make a data-

driven company

Most people in an organization cannot

move top-level metrics

Digging deeper can yield unexpected opportunities.

Most important business questions are ad hoc by nature

and can’t be answered by a dashboard.

Tying incentives to metrics a person has no control over is

demotivating.

Common Pitfalls of Standard KPIsWhat’s missing?

Page 9: Custom Calculations: Your business is unique — shouldn't your metrics be?

better title

• When the entire organization can engage in ad-hoc investigations, more of the decisions being made are backed by data, and more interesting questions get surfaced.

• Frees the analyst to work on innovative analysis beyond routine reporting.

What happens when you dive deep?

Page 10: Custom Calculations: Your business is unique — shouldn't your metrics be?

What happens when you dive deep?

Infectious Media’s client wanted to better understand their customers’ purchasing behavior.

What happens when you dive deep?

Page 11: Custom Calculations: Your business is unique — shouldn't your metrics be?

What happens when you dive deep?

They found that while men made the initial cable connection purchase (almost always of premium sports packages), women constituted the majority of add-on purchases, and the majority of viewers.

What happens when you dive deep?

Page 12: Custom Calculations: Your business is unique — shouldn't your metrics be?

The Benefits of Custom Analytics

Page 13: Custom Calculations: Your business is unique — shouldn't your metrics be?

Who’s the better employee?

• Every team, team member and project deserve data-driven performance feedback

• Feedback based solely on a manager’s impression is often inaccurate and unfair

Page 14: Custom Calculations: Your business is unique — shouldn't your metrics be?

Taking Incentive Structures to the next level

• Used custom metrics to create an incentive structure for the sales team

• The incentives went beyond pay to actually include promotions,.

• Members of the sales team had constant, real-time access to their performance metrics

Page 15: Custom Calculations: Your business is unique — shouldn't your metrics be?

Taking Incentive Structures to the next level

• These performance metrics went beyond simply counting the number and size of deals

• Sales people are now motivated to sell quality deals.

• Promotions are automatically awarded as a function of these custom metrics!

• These reports were embedded in Salesforce so the sales team would have constant visibility.

Page 16: Custom Calculations: Your business is unique — shouldn't your metrics be?

Ad Hoc Analysis

● Data-driven business process is a series of quick ad hoc analyses

● New custom metrics are developed for each new situation

● Simple questions should not have to be answered by the analyst

● (Analysts should be consulted before major data-drive business decisions)

Page 17: Custom Calculations: Your business is unique — shouldn't your metrics be?

Have a hunch?

It seems like there’s a lot of money coming from North Dakota...

Page 18: Custom Calculations: Your business is unique — shouldn't your metrics be?

Test it!

● Custom metrics allow ad hoc analysis

● Custom analytics allows anyone’s hunch to be investigated

● You may need to use creativity to find the right metric

Page 19: Custom Calculations: Your business is unique — shouldn't your metrics be?

Beware of Spurious Correlations!

Results need to be repeatable, based on sound business logic, and analysts still need to check results

Page 20: Custom Calculations: Your business is unique — shouldn't your metrics be?

A Story From the Field: Creating Metrics to Predict Fraud

● Wanted to catch expense fraud -- without

having to review every item.

● Had previously focused on highest spenders,

but weren’t detecting much fraud here.

Page 21: Custom Calculations: Your business is unique — shouldn't your metrics be?

A Story From the Field: Creating Metrics to Predict Fraud

● Among top predictors of fraud was the total number of

expenses.

● Created a weighted score to surface “risky” individuals

who warrant manual review - whether for a health

intervention or fraud report!

● Shaved 3-5% annually off of tens of millions of annual

expenses (!!)

FOUR cell phone plans?!

Page 22: Custom Calculations: Your business is unique — shouldn't your metrics be?

How to Identify Key Metrics

Page 23: Custom Calculations: Your business is unique — shouldn't your metrics be?

Identifying Key Metrics

Define What do we want to drive?

QuantifyHow can we measure it?

Act and RefineHow do we improve?

Page 24: Custom Calculations: Your business is unique — shouldn't your metrics be?

Be creative!

• If you can’t measure something directly, find a proxy

• Or, measure the opposite.• Example: Can’t measure

customer happiness? Can you measure

• Engagement with the product?

• Social media shares?• Unhappiness?

Define: Be Creative!

Page 25: Custom Calculations: Your business is unique — shouldn't your metrics be?

Quantify: Set up tracking

• We were delivering trainings without

knowing their impact

• Created quiz to measure understanding

of key concepts

• Gave quiz to trainees at the end of

training session

• Loaded results into Looker

• Trainings were optimized

Page 26: Custom Calculations: Your business is unique — shouldn't your metrics be?

Maybe it’s not a yes/no question!

Data Democracy

Should analysts teach SQL to non-technical people?

“[Becoming a data-driven] will never happen in your company until people who don’t know SQL can ask questions on their own.”

- Ben Porterfield

Act and Refine: Data Democracy

Page 27: Custom Calculations: Your business is unique — shouldn't your metrics be?

• How Upworthy re-imagined their measure of success to align with their organization’s goals

• From Upworthy’s “About Us” Page:• Sensational and substantial. Entertaining and enlightening.

That's what you can expect here: no empty calories. Just a steady stream of the most irresistibly shareable stuff you can click on without feeling bad about yourself afterwards

• “20 pageviews! Zero user satisfaction!”• Daniel Mintz, Head of Data and Analytics at Upworthy

How do you measure success?

Page 28: Custom Calculations: Your business is unique — shouldn't your metrics be?

Identifying Key Metrics

Define Attention for meaningful content

QuantifyAttention Minutes

Act and RefineAdjust Marketing and Engagement Strategies

Elena Rowell
[email protected] [email protected] This slide is in here 2x (also slide 23). Is that intentional?
Anika Kuesters Smith
intentional! this is about how the upworthy story fits into the procedure described on 23
Page 29: Custom Calculations: Your business is unique — shouldn't your metrics be?

The Results

Page 30: Custom Calculations: Your business is unique — shouldn't your metrics be?

The Results

Page 31: Custom Calculations: Your business is unique — shouldn't your metrics be?

Conclusions

• To gain more understanding and control over your business, evaluate if you’re using the right metrics.

• Create KPIs that address the goals of the organization as a whole, and of the individuals and teams within it.

Page 32: Custom Calculations: Your business is unique — shouldn't your metrics be?

Q & A

Page 33: Custom Calculations: Your business is unique — shouldn't your metrics be?

Thank you

• This webinar will be posted on looker.com tomorrow.

• Demo Looker at looker.com/demo or stick around for the live demo!

Page 34: Custom Calculations: Your business is unique — shouldn't your metrics be?

Thank you