ushahidi toolbox - real-time evaluation

Toolbox #3

Real-‐Time Evalua-on

So you’ve done all of the planning to implement your Ushahidi/Crowdmap pla?orm. We’re here to help you self-‐evaluate how it’s working!

Video Audio Image Text

TWO WAYS TO USE THIS TOOLBOX 1)  The project is happening now….I’m ready to learn about how the project is

doing to make immediate changes to improve the project!

2)  Well… My project is over, but I want to learn about the successes and challenges!

✔

✔

A

B

The first step is to ask the following big ques-ons….

•  Is the project fulfilling its goals?

•  Is the project fulfilling its objec-ves?


Answer the following big ques-ons…. Video Audio Image Text

Goals: Do you agree or disagree with the following statement?

Strongly disagree

strongly Agree

agree disagree undecided

The project has : “Goals from implementa5on toolbox, panel #4, imported here”

Strongly disagree

strongly Agree

agree disagree undecided

The project has : “Objec5ves from implementa5on toolbox, panel #4, imported here”

Objec<ves: Do you agree or disagree with the following statement?

Why? more

goals….

Why? More

objec-ves….

How are you achieving your program objec-ves?


Which parts of your project is working well? and helping to achieve your objec-ves?   Partnerships   Technology   Campaign/Messaging   Informa-on Flows Ac-on/Feedback

  Communica-on   Maps/Visualiza-on Informa-on Security   Volunteers/Teams Other, please describe______

Which parts of the project need improvement and may be preven-ng the project from achieving its objec-ves

  Partnerships   Technology   Campaign/Messaging   Informa-on Flows Ac-on/Feedback

  Communica-on   Maps/Visualiza-on Informa-on Security   Volunteers/Teams Other, please describe______

User ac5ons: A) select 2 from “working well” and 2 from “needs improvement. B) select all that apply

So now you’ve learned from & evaluated your project …What

are your ac-on plans for change?


Some way to auto-‐import the selected categories on slide 6. Here is a RTE example

Findings Ac<on Plan Check-‐in (EXAMPLE) Partnerships-‐ We have a strong rela-onships with our community partners, we trust each other. We have monthly mee-ngs to keep our rela-onship strong. (SUCCESS!)

(write your ac5on plan here ) We will con5nue to have monthly mee5ngs, and will look for people to support the workshop space to help con5nue to bring people together.

(when will you check in to see how you’re doing with your ac-on plan?)

(EXAMPLE) Informa-on Security-‐ our informa-on security plan is working, Our servers are secure and there is a con-ngency plan. Our partners provide monthly feedback about their concerns. There has been no security events yet. (SUCCESS)

(EXAMPLE) Volunteers-‐ It has been hard to keep our volunteers. They say the long hours and travel are difficult. It is difficult for the project manager to train each new volunteer every day. (CHALLENGE)

Print your ac-on plan now!….

Print out your Evalua-on Here are the different parts of your evalua-on

(you can click on each one to print specific sec5ons) –  (autofill in base on what is check on slide 5)

–  (autofill in base on what is check on slide 5) –  (autofill in base on what is check on slide 5)

–  (autofill in base on what is check on slide 5) –  (autofill in base on what is check on slide 5) –  (autofill in base on what is check on slide 5)

•  Print all of your checklists and ac-on plan Print your self-‐evalua-on

report here….

Partnerships Checklist Video Audio Image Text

1. Which partnerships in your project are working well? Why?

2. Which partnerships in your projects are difficult? Why?

  3. Is there trust between your partnerships? Why or why not?

  4. If your audience include local communi-es are they also your partners? How is it going?

Technology Checklist Video Audio Image Text

  1. How is the technology support ( example, server support, PHP support, ***)? What are the challenges?

  2. Do you feel your partners, volunteers, and audience are comfortable with the technology? (SMS, ushahidi instance/crowdmap, etc, viewing the map)

  3. Are your volunteer or teams who are responsible to processing messages, reports, comfortable with the technology? What are the challenges?

Campaign/Messaging Checklist Video Audio Image Text

  1. Do you believe that your audience (or crowd) understand the purpose of sending in informa-on? Why or Why not.

  2. Do you believe that your audience understands what you are doing with the informa-on? And how they will be able to see the results?

  3. Are the expecta-ons of your audience the same as your expecta-ons? Why or Why not?

  4. What needs to con-nue…..   to keep your messaging/campaign successful and sustainable?   to improve your campaign strategy.

Informa-on Flows Checklist Video Audio Image Text

  1. Are you collec-ng the type of informa-on you planned on? Is it helping you achieve your goals and objec-ves? How? How not?

  2. How are you analyzing informa-on ( verifying, confirming, mapping) What is working well and what can be improved?

  3. Do you feel now that your categories are appropriate, why or why not?

  3. Click here to evaluate and revise ( or re-‐evaluate) your informa-on flow diagram

Ac-on/Response/Feedback Checklist


  1. Is the informa-on collected being used in the way you planned?   2. Have you been communica-ng back to your target audience/or the public?   3. How well do you and your partners feel the report and maps are returning to decision makers for program change?

  4. If it has been more difficult than you thought to share informa-on and the maps with your par-cipants and audience, why do you think this is happening? 5. Click here to see your informa-on flow and feedback diagram, what would you keep the same and what would you do differently?

Communica-ons Checklist


  1. Are your par-cipants/crowd communica-ng/sending you informa-on in ways that you thought? Why or why not?

  2. What part of these communica-on successes are due to technology?

  3. What part of these communica-on successes are due to trust, other reasons?

Maps/Visualiza-on Checklist


1. What do the dots on the map mean to your project? To your par-cipants? To Others?

  2. Are people specifically using the map for decision making and ac-on? How are they using it? If they are not, what are they telling you as the reasons why they are not using it?

  3. How do all of your audiences have access to the map? Do they know the way to find needed informa-on on the map? If they can’t or have difficulty, why? How have they told you ways to improved the access and find informa-on on the map?

Informa-on, Privacy and Security Checklist


  1. Do you have a current program strategy for privacy and security? If so what is working well, what will need improvements? If not write here what your strategy will be.

  2. How is your project managing the risks of sharing informa-on (including the maps)?

  3. Ask all of your partners and contact your par-cipants to ask them if they feel secure providing informa-on. List the answers here.   3. If your partners and par-cipants tell you they are worried about privacy what are their recommenda-ons on improving?

Teams/Volunteer Checklist Video Audio Image Text

  1.   2.

  3.

(Create your own) Checklist Video Audio Image Text

  1.

  2.

  3. 4. 5. 6.

THANK YOU FOR COMPLETING TOOLBOX #3!

Please save this file and add your name to the title, then return it to [email protected] or wiki.ushahidi.com

You will receive a report from Toolbox #3 to use in your project.

In your email please send comments on how you would like this tool improved or changed!

Thank you for being a very important part of Ushahidi’s User community!

ushahidi toolbox - real-time evaluation

Documents

project fullling

audio image text goals

video audio image text

following big quesons

implementa5on toolbox

following statement

ushahidicrowdmap pla

im ready