results of the 2010-2011 pilot fitness assessment training and looking ahead to statewide...
TRANSCRIPT
![Page 1: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/1.jpg)
Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead
to Statewide Implementation
Mike Metzler (Georgia State University)Christi Kay (HealthMPowers)
Shannon Williams (GSU)Jeff Rupp (GSU)
Rodney Lyn (GSU)Mary Ann Phillips (GSU)
Kari Hunt (GSU)
![Page 2: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/2.jpg)
Legislation and DOE Rules S.H.A.P.E. partnership Selection of fitness assessments 2010-2011 fitness assessment training pilot Evaluation of fitness assessment training
and testing Looking ahead to 2011-2012 Q&A
Overview
2
![Page 3: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/3.jpg)
Beginning in 2011 an annual fitness assessment in grades 1-12 (Pre + post optional)
All classes taught by a certified physical education teacher
Individual results communicated to parents or guardians
Aggregate results reported to DOE
Georgia Official Code (20-2-777)
3
![Page 4: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/4.jpg)
At least minimum amount of physical education instruction provided:-- Elementary: 90 clock hours/year-- MS H/PE instruction provided-- HS 1 semester Health/1 semester Personal Fitness
Recognition
Georgia Official Code (20-2-777), con’t
4
![Page 5: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/5.jpg)
• Governor's Office
• Georgia Department of Education
• Georgia Department of Public Health
• Maternal and Child Health, Division of Public Health
• Children’s Healthcare of Atlanta
• Atlanta Falcons Youth Foundation (AFYF)
• The Arthur M. Blank Family Foundation
• The Atlanta Braves Foundation
Student Health and Physical Education (S.H.A.P.E.) Partners
5
![Page 6: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/6.jpg)
Selects five components of FITNESSGRAM®
Determines requirements for each grade re: assessments
Plans to implement pilot training in five counties 2010-2011
Decides to conduct evaluation of the pilot training
DOE Fitness Advisory Committee
6
![Page 7: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/7.jpg)
Combines both an educational assessment and a reporting software program
Designed to promote lifelong physical activity
Based on the latest research on children’s fitness
Health related
Uses criterion-referenced standards
FITNESSGRAM®
7
![Page 8: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/8.jpg)
PACER /Mile Run – Aerobic Capacity
Curl-Ups – Muscular Strength and Endurance
900 Push-Ups – Muscular Strength and Endurance
Back-Saver Sit and Reach - Flexibility
Height and Weight – To Calculate Body Composition as BMI
Fitness Assessment Components
8
![Page 9: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/9.jpg)
GA DOE Fitness Assessment and Reporting Requirements
9
![Page 10: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/10.jpg)
Fall of 2010 Designed and coordinated by
HealthMPowers Eight hours, in one day Used three certified FG trainers Trained 290 teachers in four counties: --Bibb, Hall, White, Gwinnett, Lowndes
(selected but completed testing early)
2010-2011 Pilot FITNESSGRAM® Training
10
![Page 11: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/11.jpg)
Level 1– Trained by certified trainers
Level 2– Trained fully by Level 1’s
Level 3—Untrained (e.g. substitute teacher, parent)
2010-2011 FITNESSGRAM® Training
11
![Page 12: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/12.jpg)
Information about the Fitness Assessment Program
FITNESSGRAM® testing training
Fitness testing
Data entry accuracy and management
Preparing and distributing FITNESSGRAM® reports
Scope of the Evaluation of the Pilot
12
![Page 13: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/13.jpg)
“Ticket out the Door” (comment slips after the training sessions)
Observations of teachers conducting fitness testing
Analysis of time to administer FITNESSGRAM®
Teacher item responses on surveys (after completing testing)
Teacher comments on surveys (after completing testing)
Evaluation of Pilot FITNESSGRAM®
Testing Training
13
![Page 14: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/14.jpg)
The teachers were very complimentary about the design of the training materials and the quality of the instructors:
“Seeing the tests in practice. Hearing a thorough explanation of each test”
“Seeing the tests on video then actually doing them to make sure we were accurate”
“Mistakes to look for were outlined. Helpful hints to teach tests to kids”
“Ticket out the Door”
14
![Page 15: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/15.jpg)
The teachers expressed some challenges, including:
“Pre/post test all students in 9 weeks. It will reduce instructional time”
“Getting the students to buy into the testing. Being serious about doing their best”
“Getting ‘old timers’ to get on board”
“Ticket Out The Door”
15
![Page 16: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/16.jpg)
A trained observer and certified FITNESSGRAM® test administrator observed 22 teachers administering different combinations of the testing components between December of 2010 and May of 2011. The observations were made at 4 elementary schools, 4 middle schools, and 2 high schools.
The purpose was to check teachers’ adherence to FG protocols taught in the training sessions.
Observations of Teachers Conducting Fitness Testing
16
![Page 17: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/17.jpg)
Observations of Teachers Conducting Fitness Testing
Test component# of items
on checklist
Mean percent correct and
includedLow % -- High
%
Push Ups
7 77.6% 28.6% -- 100%
PACER
6 73.8% 28.6% -- 100%
Back Saver Sit & Reach
9 66.7% 44.4% -- 100%
Curl Ups
11 56.4%* 9.1% -- 81.8%
*This mean would be 68.1% without the very low score of 9.1% by a Level 3 tester17
![Page 18: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/18.jpg)
Observations of Teachers Conducting Fitness Testing
Percent Correct
and Included
Level 1
74.5%
Level 2
47.5%
Level 3*
33.3%
*Only one Level 3 tester was observed
18
![Page 19: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/19.jpg)
Reliability observations checked for differences between scores recorded by teachers/volunteers/students and those recorded by independent, trained recorders. The trained observers’ counts would be made strictly according to each test’s protocol, and then recorded along with the count made by the teacher, volunteer, or student who was assigned that responsibility.
We conducted 296 observations and comparisons across all components of the FITNESSGRAM® test.
Observations of Teachers Conducting Fitness Testing
19
![Page 20: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/20.jpg)
Observations of Teachers Conducting Fitness Testing
Test component Difference (%)
Push-Ups 45.0
Curl Ups 40.7
Sit and Reach 33.3
PACER 4.9
Height 0.3
Weight 0.3
20
![Page 21: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/21.jpg)
During the on-site observations, one of the trained observers recorded the start/stop times for each group of tested children, and noted how many students were being tested at that time. From that, it was possible to calculate a time estimate for testing a (hypothetical) group of 30 students in the same physical education class.
It should be noted that the number of students to be tested at one time in each test was based on the recommendations of a trained and highly experienced certified FITNESSGRAM® trainer.
Analysis of Time to Administer FITNESSGRAM®
21
![Page 22: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/22.jpg)
Test Test at once Time ~Total TimePACER 6 15:00 mins 75 mins Sit & Reach 1 2:45 mins 80 mins Height & Weight 1 1:00 mins 30 mins Push Ups 4 2:30 mins 20 mins Curl Ups 4 2:30 mins 20 mins
The total estimated time to properly test those 30 students is 225 minutes, almost 4 hours of class time.
Analysis of Time to Administer FITNESSGRAM®
22
![Page 23: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/23.jpg)
Analysis of Time to Administer FITNESSGRAM®
Scenarios:
PE for 1 day/week for 30 mins: 8 classes/8 weeks ~20% of annual PE
PE for 2 days/week for 30 mins: 8 classes/4weeks ~10% of annual PE
PE for 3 days/week for 30 mins. 8 classes/~3 weeks ~7% of annual PE
PE for 5 days/week (9 weeks) for 45 mins: 5 classes/1 week ~11% of 9 weeks
23
![Page 24: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/24.jpg)
Analysis of Time to Administer FITNESSGRAM®
Tim
e
Accuracy
24
![Page 25: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/25.jpg)
The FITNESSGRAM® training was well-organized and effectively presented:
Strongly agree 52%
Agree 40%
Teacher Item Responses on Surveys
(After Testing)
25
![Page 26: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/26.jpg)
I feel well-prepared to test the students at my school using the FITNESSGRAM® assessments:
Strongly agree 51%
Agree 37%
Teacher Item Responses on Surveys
(After Testing)
26
![Page 27: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/27.jpg)
The teachers still expressed that the training was beneficial and effective, but after testing they again expressed concerns about time and other constraints:
“It is very time consuming. It's hard doing the testing by yourself.”
“I don’t feel I can trust students to watch for form breaks and give accurate scores on those [sit and reach, curl ups, push up], so it is taking quite a long time to get those done.”
Teacher Comments on Surveys(After Testing)
27
![Page 28: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/28.jpg)
To provide an extensive information campaign so teachers can better understand why they are conducting the fitness tests.
To provide suggestions for teachers who have to test large numbers of students at one time, such as how to conduct the test and how to keep the other students occupied.
To urge teachers to re-familiarize themselves with the instruction checklist prior to administering each of the tests and have it with them during the testing.
Selected Recommendations from the Pilot
28
![Page 29: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/29.jpg)
To urge teachers not to exceed the recommended number of students taking a test at the same time, based on their level of experience with FG.
To urge teachers not to use students in elementary grades to count and record scores for other students.
To develop an on-line “booster” training module to refresh teachers’ memory right before testing.
To require that the training of Level 2 and Level 3 testers be documented for compliance with level 1 training.
Selected Recommendations from the Pilot
29
![Page 30: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/30.jpg)
-- June - December 2011: Training ~2,500 teachers trained for testing (Level 1)
-- November - December 2011: Import student information into FITNESSGRAM®
-- January 2012 - February 2012: Practice testing/pretesting (optional)
-- March 1 - May 5 2012: Implement assessment; record and report scores
-- May 1 – June 15 2012: Schools deliver student reports to parents
-- October 2012 : The first Georgia Report to the Governor
2011-2012 Timeline
30
![Page 31: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/31.jpg)
Training is scheduled for 150 local systems Provide information for IT and student information
representatives from local systems Student information imported into FG 9.0 Teachers trained via webinar on how to enter student
assessment data ( December 2011 – January 2012) Data entry, and reporting available after January 1,
2012 Data collection will be done via a secure web based
location using Fitnessgram 9.0
2011-2012 Statewide Implementation
31
![Page 32: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/32.jpg)
Equipment for assessment:-- Sit and Reach Box-- Scale-- Height Measure Strip-- FG Kit (additional items needed to test)
Data and reporting:-- FG 9.0 web based program -- Licensing-- Data Collection Space
2011-2012 Statewide Implementation
32
![Page 33: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/33.jpg)
Funding has been secured to develop an e-learning module to help improve teacher observation. Proposed 4 parts:
1. Tutorial of correct performance
2. Tutorial of common form breaks
3. Game/Activity to evaluate form breaks of a single
execution (sit and reach, curl ups and push ups)
4. Game/Activity to evaluate correct execution in a
series of 10 (curl ups and push ups)
2011-2012 Statewide Implementation
33
![Page 34: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/34.jpg)
FERPA:The parties will safeguard the confidentiality of the student data as required by the Federal Family Educational Rights and Privacy Act (FERPA) and other applicable laws and regulations. No release of data, reports, information, or output of any kind based on the data will include any information that could be identifiable or linked to a specific person.
2011-2012 Statewide Implementation
34
![Page 35: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/35.jpg)
FITNESSGRAM® Georgia (http://www.fitnessgram.net/Georgia/)
FITNESSGRAM® (http://www.fitnessgram.net/home/)
The S.H.A.P.E partnership (http://georgiashape.org/)
Georgia Department of Education – Health and Physical Education (http://www.doe.k12.ga.us/ci_services.aspx?PageReq=CIServHealthPhys
) Website includes all materials provided in the training manual. (e.g. all training PPTs, all communication pieces including sample letters, newsletters, frequently asked questions, information for school websites, tips for success from the field, fitness testing one pagers and station cards, and more.
Resources
35
![Page 36: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/36.jpg)
Therese McGuireProgram Specialist
Health and Physical EducationGeorgia Department of Education
DOE Contact
36
![Page 37: Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi](https://reader035.vdocuments.us/reader035/viewer/2022062803/56649f055503460f94c1a477/html5/thumbnails/37.jpg)
Time for Questions
37