1

Real Money. Real World. Annual Report for 2012 Signature Program Evaluation

Submitted by Kathy Michelich May 31, 2013

1. The program is implemented across the state (e.g., who, where, how, how many, how long, etc.),

Over the past eight years, RMRW has connected thousands of teenagers to a practical learning experience from the Ohio State University. And, although youth are the target consumers, entire communities are strengthened by bringing people together to work on a common educational goal. First developed by OSU Extension in 2005, Real Money. Real World. (RMRW) is a hands-on experience that gives young people the opportunity to make financial choices similar to those they will make as adults. Youth explore lifestyle choices, budgeting, and develop vital money management skills. Data for Real Money. Real World. was generated through two sources for 2012: 1. The online Lime survey system was used to capture results of the participant surveys completed by youth immediately following the RMRW learning experience. 2. OSU Extension staff entered their personal efforts for providing RMRW into the Research in View (RiV) system individually. A brief report from each: 1. 2012 Participant Survey Data via the online Lime system: RMRW participant evaluations were entered by 49 counties. The number of participants entered into the online data system for each county is noted as well as the lead Extension contact in each county the table below:

2

2012 youth participants entered into data system

44 Counties entered participant survey data for RMRW work in 2012

Ohio State University Extension Educator/Program Coordinator –Primary RMRW Contact

56 Adams Carolyn Belczyk

607 Allen Tracy Orians

515 Auglaize Elizabeth Miller

1638 Butler Jackie Lankfer - Program Asst

59 Clermont Margaret Jenkins

107 Clinton Tracie Montague

111 Cuyahoga Greg Siek

25 Darke Rhonda Williams

57 Defiance Teresa Johnson

401 Delaware Laryssa Hook

37 Erie Mary Beth Albright

745 Fairfield Shannon Carter

120 Fayette Kim Hoppes PA

258 Franklin Beth Boomershine

75 Fulton Jill Stechschulte

76 Geauga Terri Worthington

280 Guernsey Lisa K. Bradley

182 Hamilton Betsy DeMatteo

842 Hancock Barb Brahm

211 Hocking Joyce Shriner

600 Holmes Kate Shumaker

96 Jefferson Joseph Maiorano

607 Knox Larry Hall

69 Licking Sally McClaskey PC

75 Lorain Minnie Taylor

3

39 Lucas Cynthia Toler

1403 Medina Marcia Kroft - PA

59 Mercer Barb Phares and Barb Hennard

345 Miami Demetria F. Woods

152 Montgomery Betty Wingerter

269 Muskingum Vicki Reed

42 Noble Nancy Snook

110 Paulding Staci Hiler - PA

280 Perry Jessica Rockey

563 Pickaway Michelle Treber, Joy Sharp

511 Putnam Jason Hedrick

57 Seneca Ann Golden

139 Shelby Laura Norris

264 Trumbull Marie Economos, Michelle Adkins

24 Tuscarawas Christine Kendle

109 Van Wert Heather Gottke - PC

655 Warren Steve Brady

387 Wayne Sherry Nickles

81 Williams Jeff Dick

TOTAL:

13, 338 Youth participant surveys entered into Lime online data system for 2012

Records indicate that 40 counties entered participant survey data in 2011. More counties were active in 2011 but they failed to provide data. Data entry improved in 2012 with 44 counties entering participant survey data.

4

2. 2012 Research in View data report: There were 63 counties plus Adventure Central and a Toledo Area activity center reporting RMRW into RiV for 2012. Three of the reporting counties provided only 2011 narrative and numbers so they likely did not conduct RMRW in 2012. One location described a consumerism activity for youth that was not RMRW. The RiV data report provided did not have youth or volunteer numbers broken down by county/location. I used the reporter’s RiV narrative sections to generate a county study of their numbers. The following counties have at least one staff member reporting participation RMRW in 2012 according to the May 22nd Research in View spreadsheet:

Number of 2012 youth

participants written into

narrative of RiV (when provided)

2012 Participant

Surveys entered into

Lime:

Counties/Locations reporting RMRW

work in 2012

Number of staff

members reporting:

Staff row number(s) on the

May 2013 RiV report for 2012

work:

255 56 Adams 1 16

-- 0 Adventure Central 1 13

4,124 (EERA #) 4,124 (EERA #)

607 Allen 2 110 88, 89

-- 0 Ashtabula 1 68

Over 400 Over 600

515 Auglaize 2 96 105

93 0 Brown 1 69

1,648 **

1638 Butler 2 47,48 128

285 0 Champaign 1 101

-- 0 Clark 1 97

59 59 59

59 Clermont 3 70 102 120

5

Over 200 **

Over 525

107 Clinton 3 100 90

141

93 111 Cuyahoga 1 127

-- 25 Darke 2 143 14

3,179 (EERA #) 57 Defiance 1 72

About 450 401 Delaware 1 66

-- 38 38

37 Erie 3 10, 11, 12 38

63, 64

--- 745 Fairfield 0 --

360 360 360 360 360

120 Fayette 5 25, 26 41 73

75, 76 122, 123

850 --

258 Franklin 2 19 112,113, 114

4,124 (EERA #) 75 Fulton 1 134

-- 76 Geauga 0 --

** 0 Greene 1 53, 54

-- --

284 235

280 Guernsey 4 20,21 17 71 85

-- -- --

182 Hamilton 3 37 40 67

922 --

4,124 (EERA #)

842 Hancock 3 24 42

140

246 -- --

0 Hardin 3 106, 107, 108, 109 87

115, 116

45 (but not in their county)

0 Harrison 1 136

4,124 (EERA #) 0 Henry 1 119

-- --

0 Highland 2 29 50

6

-- --

211 Hocking 2 124 91, 92

599 600 Holmes 1 125

93 96 Jefferson 1 148

607 --

607 Knox 2 51 15

619 0 Lake 1 95

299 69 Licking 1 86

7 0 Logan 1 36

75 75 Lorain 1 137, 138

-- 39 Lucas 0 --

Over 200 Over 200 Over 200

0 Mahoning 3 52 98, 99

131, 132

About 1,570 1403 Medina 1 81

58 458 (Auglaize & Mercer

combined)

59 Mercer 2 111 56, 57

-- 345 Miami 1 147

375 375

152 Montgomery 2 144 65

-- -- 35

0 Monroe 3 44 83

149

-- 269 Muskingum 0 --

103 --

42 Noble 2 129 35

-- 0 Ottawa 1 36

4,124 (EERA #) 110 Paulding 1 60, 61

280 280 280

280 Perry 3 119 126

145, 146

593 -- --

563 Pickaway 3 139 121 27

4,124 (EERA #) 511 Putnam 1 55

** 0 Richland 1 135

-- 18

0 Sandusky 2 77 133

7

109 0 Scioto 1 142

58 57 Seneca 1 43

-- 139 Shelby 1 104

-- 0 Summit 1 78, 79, 80

-- --

264 Trumbull 2 39 8

24 125 24 --

24 Tuscarawas 4 74 9

31, 32 82

50 0 Union 1 84

4,124 (EERA #) 109 Van Wert 1 45, 46

-- 769

--

655 Warren 3 22, 23 94 33

Approx. 400 -- --

Est. 400

387 Wayne 4 103 62 28 58

4, 124 (EERA #) 4, 124 (EERA #)

81 Williams 2 38 59

Plus a Toledo area Youth Consumerism activity had 65 youth reported into RMRW

1 117

Adding the highest number of youth reported in each county from either RiV or Lime (excluding EERA

numbers) Total Youth: 17,453

109 Extension staff reporting RMRW into RiV

2012 ** Note: 2011 narrative was used by reporter so number of youth reported is likely flawed and was therefore not listed in table. 109 OSU Extension staff reported working on RMRW in 2012. Reporting staff included Educators, Program Coordinators, Program Assistants, Office Associates, and Office Assistants. Two staff members reported but location of their RMRW is unclear. There are many discrepancies in the report regarding the number of youth participating. Causes include: staff members from the same county reported different numbers, the

8

RiV spreadsheet lists the same staff member reporting more than once, individuals working the same event entered county numbers in separate reports so that their VITA/performance reports accurately reflected their work, EERA group work and their resulting bulk number reporting, and merely estimating the numbers. By adding only the highest number of youth reported from each county from either the RiV report or the Participant Survey Data report, the total number of youth experiencing RMRW in 2012 was 17,453. This is lower than the RiV report of 20,131, but higher than the Participant Survey Data report of 13,338 but 17,453 is likely much more accurate than either RiV or Lime. The RiV numbers of youth served rarely matched the Lime participant surveys entered. This is not surprising as it is normal to have participants who do not complete or return their surveys. Normally, therefore, the RiV number was higher than the Lime surveys but in two counties (Cuyahoga and Jefferson), the number on RiV was lower than the participant surveys entered into Lime. Four counties (Fairfield, Geauga, Lucas, and Muskingum) entered Lime survey results but no one from their county reported RMRW into RiV. 65 counties/locations reported provided the Signature Program Real Money. Real World. in 2012 on RiV. Four of these either reported only 2011 narrative or did not provide RMRW curriculum, leaving 61 confirmed RMRW counties/locations in 2012. 20 counties reporting RMRW in 2012 failed to enter any participant Lime survey data. Two of these counties were provided instructions for entering their 2013 participant surveys back in February. Three are on the 2012 report but their narrative refers only to 2011 work so they likely did not provide RMRW in 2012. The remaining 15 counties will soon receive a notice and instructions on how to enter their participant survey data and the importance of doing so in 2013.

RMRW has spread beyond Ohio. In 2011, the National Program Leader - Family & Consumer Economics at USDA, NIFA sought out details regarding RMRW and shared it nation-wide. Marathon Petroleum regularly provides over 30 volunteers and encouraged employees outside Ohio to seek out and volunteer at RMRW in their communities. I regularly receive calls and emails from Educators in other state asking about RMRW. The 2013 curriculum is on schedule to be available to counties by August 1, 2013. The new curriculum will be available to OSU Extension and all land grant universities. An in-service is being planned for August to train Extension professionals on how to use the curriculum and to assure all staff know how to use the Lime survey system.

9

2. The program achieves the anticipated short-term, mid-term, and/or long-term changes in knowledge, attitudes, skills, practices, or conditions

RMRW is a peer-reviewed, academically sound curriculum that incorporates the Experiential Learning Model. Students learn financial concepts in the classroom then take their knowledge to the spending simulation to be put into action. Learning by doing is followed by a session where youth connect RMRW to real-life situations.

The most recent data driven results study was conducted in 2009. Summary reports indicate a strong correlate between the teaching and simulation and change in knowledge and attitudes. I plan to use the data entered in 2012 to develop a similar report in the fall of 2013.

3. The program elevates the public’s knowledge of OSUE.

RMRW has been long recognized as a wonderful tool for community engagement and expanding public knowledge of OSU Extension. RMRW was invited to present at the poster session at the Outreach and Engagement forum on May 2, 2013.

RMRW elevates the public’s knowledge of Extension primarily because of the simulation that requires 14 booths staffed by adults. In 2012, a reported 3,019 volunteers invested 12,524 hours into RMRW. Local volunteers come from all walks of life. Most are business owners and community leaders who do not ordinarily volunteer with Extension.

This mix of professionals is combined with parents who champion RMRW. An OSU Educator stated: “I have only to ask and they come running to help me with this program.” RMRW volunteers truly reflect community in action, using OSU Extension as their platform.

4. Proposed program marketing, communication, implementation and evaluation methods and strategies are followed.

I wrote and designed a flyer in 2011 that was printed and used at the Ohio School Board Association conference and is now used across Ohio to increase awareness of RMRW and expand the program. The RMRW curriculum revision will include a new participant evaluation as well as a long-term evaluation. This will strengthen our ability to report the breadth and scope of the impacts of RMRW.

10

5. Signature Program Leader work and results of 25% appointment. Due to a complete revision of the RMRW curriculum that included leading a team of six Educators and a peer review, more than 25% of my time was invested as RMRW Leader in 2012. I am responsible for 74% of the authorship of the publication that is to be ready for sale by August 1, 2013. Duties included, but were not limited to: January:

- Emailed tailored messages to counties throughout Ohio conducting RMRW, planning to conduct, RMRW or previously conducted RMRW.

- Sent counties end of the year stat reports and encouraged follow up with Kim Showalter.

- Emailed suggestions for revision needs to AD of FCS and to Educator in Hancock County who is working on a college RMRW experience.

- Worked to sell RMRW Tech Team equipment. Emailed seven retailers with inventory and explanation. No buyers. Worked with business office to assure donation of equipment followed University policy and donated equipment to Head Start and Goodwill Industries.

February: - Updated the active county list including the key contacts, email

addresses, phone numbers, record of report completed for 2011, and plans to conduct RMRW in 2012.

- Emailed developed list to Progressive Insurance representative in Cleveland who wanted to help recruit volunteers state-wide.

- Emailed active county list to Tom Archer. - Had a phone conference with Tom Archer and Karen Bruns regarding

forming a RMRW revision team and strategy for updating the data. - Collected information regarding possible revision team members.

Discussed possible members from FCS Health Finances team with Nancy Stelulak.

- Emailed potential revision team members a brief survey and followed up.

- Revised team task list - Met with Jane Wright regarding possible funding and curriculum

development strategies. - Accepted appointment for .25 FTE RMRW state coordinator effective

July 1, 2012.

11

March: - Established the 2012 RMRW revision team consisting of three FCS

Educators and three 4-H Educators. Began the communication process of task communication including drafting a team agreement.

- Assured that all team members signed agreement. - Sought and secured a grad student through Caezilia Loibl to update

data in 2009 RMRW. Provided the grad student a written task list and May 31 deadline.

- Communicated with Karen Bruns regarding the possibility of funds for publication and marketing of revision.

- Reported out to the Healthy Finances Team regarding RMRW. - Communicated with strong RMRW advocate from Franklin County

who is conducting RMRW in several public schools. She is willing to serve as an informal outside reviewer when the 2012 revision is complete.

- Updated team task list and emailed update to revision team. - Provided Karen Bruns ideas on how RMRW College version could be

included in the Huntington Bank donation recipient project. - Established meeting place for April 13 meeting at 4-H Center. - Spoke to CommTech Dave Scardena and invited him and others from

CommTech to April 13th meeting. - Took photos of Warren County RMRW posters and downloaded those

taken of Hancock County posters as well. Combined photos into a power point for team review.

April:

- Established the 2012 RMRW revision team consisting of three FCS Educators and three 4-H Educators. Began the communication process of task communication including team agreement.

- Sought and secured a grad student through Caezilia Loibl to update data in 2009 RMRW. Provided the grad student a written task list and May 31 deadline.

- Communicated with Karen Bruns regarding the possibility of funds for publication and marketing of revision.

- Reported out to the Healthy Finances Team regarding RMRW. - Communicated with strong RMRW advocate from Franklin County

who is conducting RMRW in several public schools. She is willing to serve as an informal outside reviewer when the 2012 revision is complete.

- Updated team task list and emailed update to revision team. - Provided Karen Bruns ideas on how RMRW College version could be

included in the Huntington Bank donation recipient project.

12

- Established meeting place for April 13 meeting at 4-H Center. - Spoke to CommTech Dave Scardena and invited him and others from

CommTech to April 13th meeting. May:

- Interfaced via email with RMRW revision team throughout the month to provide information and reminders of tasks.

- Met with Revision Team via WebX on May 29 - Responded to requests for information regarding starting RMRW and

additional queries. - Serve as lead for the RMRW College Simulation proposal. Wrote and

submitted one-page proposal to Karen Bruns immediately following conference call with OSU Student Affairs representative on May 3. Responded to May 24 request for revision of proposal on May 28 with revision.

June: - Provided RMRW revision team the latest curriculum update I wrote

and provided them clear task lists with a due date of July 11. - Scheduled Revision Team WebEx for July 26 - Responded to requests for information regarding starting RMRW and

additional queries. - Interfaced with Karen Bruns, Barb Brahm regarding college-level

simulation proposal. - Manned Smart Money conference Extension booth and distributed

RMRW materials. July:

- Serve as lead author and coordinator of team effort. Provided on-going guidance and motivation to team members to finish their pieces by deadlines.

- Held team WebX to discuss progress and next steps of 2012 revision. - Drafted and emailed “guidance needed” correspondence to OSU

Extension Administration regarding the RMRW customer and revision funding source.

- Corresponded with CommTech to secure quote for poster kit addition and forwarded such to OSU Extension Administration.

- Provided information to out-of-state queries and in-state questions regarding data entry and coordinating a RMRW program.

- Sent out a reminder to all active RMRW counties regarding importance to entering data.

13

August: - Reviewed and revised latest draft of curriculum by incorporating

team submissions and creating new narrative as needed. - Met with Huntington bank representatives and OSU professionals in

Columbus to discuss merits of RMRW partnering with Huntington Bank.

- Met in Columbus with OSU Administration regarding the RMRW customer and revision and funding source. Settled questions and concerns.

- Drafted correspondence based on OSUE Administration guidance received and emailed “All Extension” regarding changes coming to RMRW in 2013.

- Corresponded with CommTech to secure final quote for curriculum/poster kit.

- Provided information to queries regarding data entry and coordinating a RMRW program.

- Attended and reported on RMRW at the Healthy Finances Team meeting in Columbus.

September: - Serve as lead author and coordinator of team effort to revise

curriculum. Provided on-going guidance and motivation to team members including direct reminders of the commitment they made to the team.

- Provided team members the task of “playing” a role to test the new product.

- Finalized Federal Withholding Tax table and inserted into revised curriculum.

- Provided information to queries regarding data entry and coordinating a RMRW program.

October:

- Continue as lead author and coordinator of team effort to revise curriculum. Provided on-going guidance and motivation to team members.

- Followed up with team members regarding the results of the spending simulation.

- Established next face-to-face meeting with revision team. - Provided information to queries regarding data entry and

coordinating a RMRW program. November:

- Researched data sources. Revised as needed. - Wrote sections of narrative for team template from which to work.

14

- Coordinated all-day webX to work on final draft. - Re-wrote communications booth section and forwarded to team.

Received team feedback and I revised again. - Scheduled additional 4 hour meeting in Columbus to continue work

on final draft – secured meeting room and equipment for this meeting.

- Interfaced with Jane Wright regarding editing process. Invited her to join our webX.

- Communicated with Kirk Bloir regarding the peer-review process and timing of such.

- Provided information to queries regarding data entry and coordinating a RMRW program.

December: - Led an in-person revision team meeting that latest four hours.

Assigned additional tasks to all members with a firm due date. - Re-wrote as needed to prepare piece for final review. - Submitted final draft to Kirk Bloir with cover letter requesting peer

review. - Forwarded entire curriculum to outside reviewer not employed by

Extension and asked her to review piece as well. - Wrote up tracked revision efforts and forwarded information and

assignment of percentages of authorship to each co-author. Interfaced with Karen Bruns and team members regarding my assignment of such.

- Provided information to queries regarding data entry and coordinating a RMRW program.

- Worked with Kim Showalter to get end of the year data reports from counties.

- Wrote and emailed suggested narrative for Educators to use on their RiV report.

- Worked in Riv to identify where and how to report on RMRW - Made personal phone calls to ten county offices regarding lack of

data and/or to identify the lead Educator in the county. - Spoke with Mark Light and Jason Hedrick regarding moving the

college awareness project to a separate team. Provided name of person from RMRW revision team who is interested in serving on their curriculum development team should they chose to pursue this route.