evaluation matrixes v2

Decision Matrixes

@wickedgeekie - 2010

A series of solutions has been identified, how can I find out which one fits best the project requirements? How can I justify this selection? How can I conduct this selection with many people?

Welcome to decision matrixes. This is an example matrix. Does this look familiar?

What is a decision matrix?A decision making techniquewhich enables to– catalogue options– identify options’ strengths and weaknesses– rank options against project requirements– identify the option fitting most closely project

requirements– documents decisions for future reference– conduct all of the above with 1 or more

people

Decision matrixes can be as complex as one wants them to be...

Walk-through exampleFanta want to promote their new product on Facebook by enabling users to download a voucher.

Which Facebook product is best suited for this?

Designing the matrix:Inserting the criteria

\ Criteria

Can feature a voucher for download / how

Control over UGC

Page visibility

Is it scalable to future offers?

Listing the decision criteriaThe page features a voucher, or a link to oneThe brand remains in control of user generated content of the pageThe page must be highly visible to generate a high volume of downloadsThe solution must be scalable for future promotions

Designing the matrix: Adding the propositions

Propositions \ Criteria

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan pageGroup pageEvent pageApplicationListing the propositionsA list of possible formats of page has been drawn, and form the propositions:

A Group pageA Product or Fan pageAn Event pageAn Application

Filling in the matrix: comments

Propositions \ Criteria

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan page

Yes / hyperlink to external page

Scalable by group owner (anonymous)

When users join or post

Yes, page can be updated

Group page Yes / hyperlink to external page

Scalable by group owner (published)

When users join or post

Yes, page can be updated

Event page Yes / hyperlink to external page

Scalable by group owner (published)

When users join or post

Page has a time limit

ApplicationYes / within the application and/or as hyperlink to external page

Scalable on landing page, total on application by group owner (anonymous)

When users join or post or use the application

Yes, the application is like a micro-site. Landing page can be updated

Scoring the propositions for one criteria is much easier as the understanding of what the criteria is is consistent

Adding a ranking scale: 1- lowest desirability to 5 – highest desirability

Propositions \ Criterion

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan page

Yes / hyperlink to external page

Scalable by group owner (anonymous)

When users join or post

Yes, page can be updated

Group page Yes / hyperlink to external page

Scalable by group owner (published)

When users join or post

Yes, page can be updated

Event page Yes / hyperlink to external page

Scalable by group owner (published)

When users join or post

Page has a time limit

ApplicationYes / within the application and/or as hyperlink to external page

Scalable on landing page, total on application by group owner (anonymous)

When users join or post or use the application

Yes, the application is like a micro-site. Landing page can be updated

4

3

5

2 433

5

11

22

4

5

5

5

Keeping only ranking scores

Propositions \ Criterion

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan pageGroup pageEvent pageApplication

4

3

52 4

33

5

11

224

5

5

5

Check if the scores are spread enough: this validates the criteria

Propositions \ Criterion

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan pageGroup pageEvent pageApplication

4

3

52 4

33

5

11

224

5

5

5

1 4 2 1

These criteria get scores that are too clustered, they may not be valid – or use weighing to differentiate them

Adding weighing

Propositions \ Criterion

Can feature a voucher for download / how (weigh=3)

Control over UGC(weigh=2)

How is it visible(weigh=1)

Is it scalable to future offers? (weigh=1)

Product / Fan pageGroup pageEvent pageApplication

4x3= 12

3x3= 9

5x2= 102 4

3x3= 93x3= 9

5x2= 10

1x2= 11x2= 1

224

5

5

5

Not all criteria are equal, add weighing to distinguish most/least important

Calculating totals

Propositions \ Criterion

Can feature a voucher for download / how (weigh=3)

Control over UGC(weigh=2)

How is it visible(weigh=1)

Is it scalable to future offers? (weigh=1)

Product / Fan pageGroup pageEvent pageApplication

4x3= 12

3x3= 9

5x2= 102 4

3x3= 93x3= 9

5x2= 10

1x2= 11x2= 1

224

5

5

5 2616

1731

The last result has the highest total, it matches best the criteria selected.

Calculating totals

Propositions \ Criterion

Can feature a voucher for download / how

Control over UGC

How is it visible

Is it scalable to future offers?

Product / Fan pageGroup pageEvent pageApplication

4

3

52 4

33

5

11

224

5

5

5 1591118

Criteria can be added or removed, the results are easy to updateHelps manage scope creepAll stakeholders can contributeGreat for sorting findings of a mind map

In the UX work process...• Can help clarify requirements across the

team• Documents why a solution is selected• Can be conducted with or without the client,

depending on timing/internal consensus• Can be a deliverable if the question is:

“what solution is best and why?”• Stakeholders may need to be explained

what it is and why it’s useful

References• Kepner-tregoe:

http://www.decide-guide.com/kepner-tregoe.html

• Mike Swanson: http://blogs.msdn.com/mswanson/archive/2008/07/20/my-decision-matrix.aspx