ammi workshop · 2018. 9. 17. · to know your direction, you need to know your data. to know what...

27
#NACAC18 AMMI WORKSHOP SMARTER. FASTER. STRONGER. | BI AND ANALYTICS IN ENROLLMENT Matthew Ellis Rockhurst University, MO

Upload: others

Post on 04-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

AMMI WORKSHOPSMARTER. FASTER. STRONGER. | BI AND

ANALYTICS IN ENROLLMENT

Matthew Ellis

Rockhurst University, MO

Page 2: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

WHO AM I?

212 Years | 82,000+ Students Enrolled

Page 3: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

Education is the most powerful

weapon which you can use to

change the world. – Nelson Mandela

3

Page 4: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

ENROLLMENT MANAGEMENT IS HOW OLD?

• Started in 1976

• Jack Maguire at Boston College is credited with the term and concept in

an article he wrote in Bridge Magazine

• Even then, institutions were seeking to learn more about how their own

operations worked amidst change

• BC was struggling. Birthrates were dropping and there was a concern

about the rising cost of college (sound familiar ☺).

• First official enrollment data: admit questionnaire focused on marketing

channels

4

Page 5: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 85

A BRIEF HISTORY LESSONComplicated Systems: Linear, predictable systems that prize efficiency and

effectiveness

Pioneered by mechanical engineer Frederick Taylor in the

1890’s.

He was considered one of the very first management

consultants

Works well when you have predictable input and controlled

systems (assembly line)

Admissions/EM was based on this up until the 20th century

Page 6: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 86

A BRIEF HISTORY LESSON

Emerging field of study in both mathematical modeling and philosophy

Used in management, chemistry, economics, computer science, etc.

Seeks to better understand how the relationships between parts of a system give

rise to its collective behavior, which in turn forms a relationship with its ecosystem

Complex Systems: Non-linear, multi-variable systems that prize agility and

outcome over process and mechanics

Page 7: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 87

Page 8: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 88

WHAT’S YOUR BIGGEST CHALLENGE?

Page 9: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 89

Great ideas executed poorly

often look just like bad ideas executed well

So how do we ensure that we’re executing a good idea well?

Page 10: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

WHAT IS BI AND WHO THE HECK CARES?

10

Data Information Decisions Actions

Let’s be honest: most organizations stop

here and call it a day…

Page 11: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 811

EVOLUTION OF BI AND ANALYTICS

Page 12: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

DESCRIPTIVE

• Funnel reports and conversions

• Event/visit show and no show rates

• Class profile metrics

• Outbound activity and tactics

• Marketing engagement rates

12

Page 13: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

DIAGNOSTIC

• Financial aid matrix analysis

• Comparative model performance

• Competitive analysis

• Surveys

• National Student Clearinghouse

• Market research on tuition, brand, etc.

13

Page 14: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

PREDICTIVE

• Application of past funnel conversions

• Model scoring

• Financial aid matrix leveraging

• Admit/enrollment qualifiers

14

Page 15: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

PRESCRIPTIVE

• Model score augmentation

• Model score overrides

• Rapid response contact models

• Mindset/persona identification

• Proactive aid leveraging

• Amazon the universe

15

Page 16: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

CASE STUDY | VIP APPLICATION

• Descriptive: Drop in completion rate from previous year

• Diagnostic: Shift in days to completion and decision

• Predictive: History showed that apps completed pre-Nov 1 and with less than 30

days to decision yielded 5-7% higher than post Nov 1 and 31+ days

– ACTION POINT: Create VIP app incentive to drive up pre-Nov 1 completions and re-

design processing to manage influx and reduce time to decision

• Prescriptive: Monitor days to completion and intensify drip comms based on time

away from thresholds

16

Page 17: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

CASE STUDY | MICRO MATRIX

• Descriptive: Fastest growing populations are first-gen, lower income,

underrepresented

• Diagnostic: Previous history of enrolling EFC segments below 10,000 low and

dropping. Past tuition increase strategy out-pricing future growth segment (prior

base segment stagnant). Still too much lost yield on fringes of matrix cells.

• Predictive: Yield of students below 10,000 EFC trending down due to economics.

Yield of students above 10,000 EFC trending down due to rising competition.

– ACTION POINT: Create new need based aid program that adapts to the growth

population. Create a micro matrix.

• Prescriptive: Instead of falling into one of 130 matrix cells optimized for yield. An

optimization point is calculated for every individual student

17

Page 18: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

SO HOW DO I BUILD A BI CULTURE?

• Be obnoxiously curious

• Be an example (if you ask for it…use it)

• Recruit obnoxiously curious allies to also be examples

• Become bff’s with the data gurus

• MacGyver until you can Ironman

• Go raw

• Build room for pipelines and exploration

• BYOBI

• Over time, build a data fabric

18

Page 19: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

STRATEGY OF BI

• Have a strategy

– Chicken and egg on this one. To know your direction, you need to know your

data. To know what data to look at, you need to know your direction. Just

start somewhere.

• What get’s measured gets managed

• Set KPI’s (Drivers and Outcomes)

– Tip: Besting YTD does NOT mean you’re on track…you might just be racing

towards the cliff at a higher speed

19

Page 20: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

STRUCTURE OF BI

• Data warehouse

– SIS

– CRM

– Service Platform

– EMS

• Dashboards (eliminate the table – GO VISUAL)

– Democratize the data

• Predictive and Prescriptive require action oriented integrations (think

CRM codes/scores, etc.)

20

Page 21: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

TOOLS WE USE

• NRCCUA Data Lab: Funnel Analysis

• Tableau: Visualize things for leadership

• Slate Reports/Analytics: Live understanding of activity

• MOZ: Strength of SEO and SEM

• R and Python (the heavy hitters use this)

• 3rd Party prospect to enroll, inquiry to enroll models: Targeting and

modeling

• In-house aid leveraging model: Targeting and revenue composition

21

Page 22: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

COMMON BI PITFALLS

• Survivorship bias – WWI Planes and Enrollee Surveys

• Correlation vs. Causation – Drownings and Nick Cage films : Reg events

and yield

• Anchoring bias – Is this scholarship too low?

• Availability bias – One angry parent = zombie apocalypse

• Illusion of validity – More data does not always equal better data

• KISS

• Feed the elephant and the rider. Stats + Stories = Hearts + Minds

22

Page 23: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

BE PREPARED FOR REACTIONS

• Disprove with data (actually a healthy BI culture response)

• Disagree with anecdotes (most common)

• Discredit the source (hitting a nerve)

• Ignore the intelligence (hang in there buddy)

23

Page 24: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

COURSES YOU SHOULD CONSIDER

• BI 101

• Data visualization

• Marketing/social media analytics

• Organizational change

• Presenting/verbal communication

• Grad programs in business intelligence, analytics, data science

24

Page 25: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

ENROLLMENT MANAGEMENT MATURITY MODEL

25

Source: NRCCUA

Page 26: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

WHERE IS YOUR ORGANIZATION?

26

Page 27: AMMI WORKSHOP · 2018. 9. 17. · To know your direction, you need to know your data. To know what data to look at, you need to know your direction. ... Strength of SEO and SEM •

# N A C A C 1 8

THANK YOU!

Matt Ellis

Associate Provost for Enrollment Management

[email protected]

27