the 3 rs of impact reporting

30
Cooperative Extension Professionals Working Above the Line: The 3 R’s – Telling the Extension Story with Impact Reports

Upload: rebecca-white

Post on 25-Dec-2014

59 views

Category:

Education


0 download

DESCRIPTION

Professional development training on impact reporting developed for Louisiana Cooperative Extension Service professionals.

TRANSCRIPT

Page 1: The 3 Rs of Impact Reporting

Cooperative Extension Professionals Working Above the Line:

The 3 R’s – Telling the Extension Story with Impact Reports

Page 2: The 3 Rs of Impact Reporting

Rebecca WhiteProfessorOrganization Development & Evaluation

Page 3: The 3 Rs of Impact Reporting

RELEVANCERESPONSE

RESULTS

3-step Process

12

3

Page 4: The 3 Rs of Impact Reporting

The 3 R’s -Telling the Extension Story

Step 1 – Developing Your Relevance Section

Page 5: The 3 Rs of Impact Reporting

Step 1: Relevance

• The reason why and the situation

• 3-5 sentences • Limit to 100-150 words

Page 6: The 3 Rs of Impact Reporting

Step 1: Relevance Includes 4-5 sentences:1. Importance of the

issue2. How issue was

identified3. How education

can help 4. A target audience 5. Clearly stated

program goal(s)

Page 7: The 3 Rs of Impact Reporting

Relevance ExampleThe 2011 Ag Summary reports the gross farm value of soybeans in XYZ Parish was $15.5 million. Data in the LA Ag Summary has shown a steady decrease in the acreage of soybeans produced in XYZ Parish over the last 5 years. Reducing input costs by educating producers on ways to improve efficiency can help them stay in business. One hundred twenty soybean producers in XYZ Parish were targeted for a four year educational outreach program. The goal of the program was to for XYZ Parish soybean farmers to adopt recommended farm practices to achieve sustainable management of their soybean resources and protect the environment. (105 words long)

Page 8: The 3 Rs of Impact Reporting

The 3 R’s – Telling the Extension Story

Step 2 – Developing Your Response Section

Page 9: The 3 Rs of Impact Reporting

Step 2: Response Describe what you did

List educational methods used Note when and where activities were conducted Identify partners and collaborators

May be narrative or bulleted Include acknowledgements Limit to 150-200 word

Page 10: The 3 Rs of Impact Reporting

Response Example A multi-faceted educational program was conducted targeting 120 soybean producers in XYZ Parish from 2008 - 2012. The program included :

Series of six presentations were given at each annual soybean field day held in northeast Louisiana on soybean production best practices

Monthly newspaper column in the ABC Gazette addressing current farm production issues. Readership is 3,000.

Educational exhibit at the State Farm Bureau convention held in XYZ Parish in June 2010

Field demonstrations at eight cooperating farms Virtual seminar in Spring 2009 on Farm Financial Management Development of a soybean production website in 2008 360 farm visits - 40 on nutrient management/water quality issues Annual pesticide safety seminars

Partners in this educational endeavor included Farm Bureau, the Soybean Growers Association, the ABC Gazette and local aerial applicators. (137 words)

Page 11: The 3 Rs of Impact Reporting

The 3 R’s – Telling the Extension Story

Step 3 – Developing Your Results Section

Page 12: The 3 Rs of Impact Reporting

Step 3: Results

Describe:

1. How effectiveness of the program was evaluated Explain evaluation or assessment strategy (1-2 sentences) Indicate response rate (1 sentence)

2. Changes that occurred as a result of the program List significant results in order of importance,

including both numbers & percentages

3. Summarize results

Page 13: The 3 Rs of Impact Reporting

Step 3 - Results: Evaluation Strategy

Pre- and post-tests were used to assess science investigatory and critical thinking skills of 120 eighth grade students.

The physical activity logs of 587 fifth graders were analyzed to determine physical activity patterns.

A survey was conducted at field days to gather benchmark data regarding soybean production practices using a 20-item instrument.

Page 14: The 3 Rs of Impact Reporting

Step 3 - Results: Response Rate

A total of 608 of 780 (78%) fifth graders who participated in the program completed both the pre- and post-test.

80% of the producers in attendance at the field days (n=124) completed the post-program survey.

Note: If you are going to use percentages, be sure to use actual numbers, too.

Page 15: The 3 Rs of Impact Reporting

Step 3 - Results: List in Order of Importance

Behavior - Documented behavior change, intent to change behavior

Learning - Knowledge gained, skills acquired, attitudes changed

Order responses Demographics Satisfaction What’s next

Page 16: The 3 Rs of Impact Reporting

Step 3 - Results: Behavior

84% of the 608 fifth grade students who completed the program tasted at least one new fruit and one new vegetable during the program.

559 of 608 (92%) participants increased their number of minutes of physical activity by 30 minutes on 5 of 7 days.

Approximately three-fourths (76%) of soybean producers surveyed adopted at least two new management practices as a result of the program.

Page 17: The 3 Rs of Impact Reporting

Step 3 - Results: Behavior (Intention to Change)

Over ½ (58%)of the students in the program indicated they would choose fresh fruit or vegetables over chips for a snack.

118 of 124 respondents (95%) indicated they intended to implement at least one new BMP.

30% of those who participated in the SET program indicated they would choose a more science-oriented career as a result of participating in the program.

Page 18: The 3 Rs of Impact Reporting

Step 3 - Results: Knowledge, Skills & Attitudes

492 out of 608 (81%) learned the number of servings of fruits and vegetables they should eat each day.

54% of producers indicated that they understood proper spray conditions at a good or excellent level before the program and 93% said they understood proper spray conditions at a good or excellent level after the program.

72% of students reported that they were less afraid of

science after the SET program than they were before.

Page 19: The 3 Rs of Impact Reporting

Step 3 - Results: Demographics

Describe program participants Age Gender Income levels Years farming or as a 4-H member Area (parish, region, state, etc.) Size of herd or acreage Educational level

Page 20: The 3 Rs of Impact Reporting

Step 3 - Results - Satisfaction 100% of the respondents stated they were mostly or

completely satisfied with the information being easy to understand.

579 of 608 (95.24%) of respondents stated they were mostly or completely satisfied with the helpfulness of the information in making decisions about their own situation.

Page 21: The 3 Rs of Impact Reporting

Step 3 - Results: SummarizingResults indicate that the Childhood Obesity Prevention Program in XYZ Parish met its objectives of increasing the consumption of fruits and vegetables and increasing physical activity in 5th grade students. The greatest behavior changes were associated with trying new fruits and vegetables and becoming more physically active. This program will be expanded next year to include 6th and 7th grade physical education teachers and students.

Page 22: The 3 Rs of Impact Reporting

Future Program Actions

Note how these results will be beneficial in the future

As we continue to address the childhood obesity issue in XYZ County, this program has helped to guide future program efforts. We now know that the program is effective and can be used with other youth to improve overall physical health and reduce the incidence of obesity-related chronic diseases later in life. This program will be expanded next year to include 6th and 7th grade students.

Page 23: The 3 Rs of Impact Reporting

Agriculture Results Example

A survey was sent to 120 farmers participating in the program to measure programmatic impact using a 20-item instrument. Ninety-six (80%) of the producers completed the survey. Seventy-two (75%) of the 96 soybean producers surveyed

adopted at least two of ten new management practices as a result of the program.

Eighty respondents (83%) indicated they intended to implement at least one new BMP in the future.

Eighty-nine (93%) said they understood proper spray conditions at a good or excellent level after the program.

Page 24: The 3 Rs of Impact Reporting

Ag Results Example (cont.)

Sixty (63%) of the respondents had participated in the Master Farmer program in previous years; eight participated during (2014)

Eighty-seven (91%) of respondents stated they were mostly or completely satisfied with the timeliness of information.

Results indicate that the Soybean Producers Extension Program in XYZ Parish met its goal of farmers adopting recommended farm practices to achieve sustainable management of their soybean resources and protect the environment. The greatest behavior change was farmers adopting recommended Extension soybean management practices. (160 words long)

Page 25: The 3 Rs of Impact Reporting
Page 26: The 3 Rs of Impact Reporting
Page 27: The 3 Rs of Impact Reporting

Final Impact Report Tips

Proofread the report Check your stats Don’t use jargon Format appropriately Write for your target audience Submit impact report regularly Share impact reports with stakeholders

Page 28: The 3 Rs of Impact Reporting

Impact Reporting Summary

Write toward the Three R’s Relevance Response Results

Page 29: The 3 Rs of Impact Reporting

Mastering Impact ReportsCan be as easy as 1 – 2 - 3

Page 30: The 3 Rs of Impact Reporting

Rebecca WhiteProfessorOrganization Development & Evaluation