FOSTERING EVIDENCE-BASED CULTURES IN K-12 SCHOOLS: GATHERING DATA FROM AN

ONLINE APPLICATION SYSTEMD r . M a r y E . Y a k i m o w s k i

M s . S a r a h D . N e w t o nU n i v e r s i t y o f C o n n e c ti c u t

Transition to the Connecticut State Standards and System of AssessmentsThird Annual Connecticut Assessment

Crown Plaza, CromwellRocky Hill, CTAugust, 2012

PowerPoint available at: HTTP://WWW.EDUCATION.UCONN.EDU/ASSESSMENT/

SESSION DESCRIPTIONThe University of Connecticut’s Neag School of Education is well-known for a culture in evidence-based decisions leading to continuous improvement (Freed & Huba, 2000; Neag Assessment Committee, 2012; Yakimowski & Coleman, 2009). Among the tools that are used is an on-line application system, which affords the opportunity to efficiently gather data from different stakeholders. Then, the information is analyzed and multi-angulated to make changes so that courses, programs, departments, or the school can improve. As school district personnel are aware, grade K-12 institutions need data to inform for evidenced-based decisions as well. Personnel need information from students, parents, alumni, staff, and community members. In this interactive session, presenters will share and discuss the Neag School’s use of an online application system as generalized to a K-12 setting. For example, presenters will facilitate discussions about accessing and using an on-line application system to gather data on such things as students’ feelings about the school climate, alumni’s opinions regarding about the strengths and areas for improvement regarding their high school education, teachers’ professional development needs, and parents’ perceptions of strengths and areas for improvement with regard to transportation and other issues. Additionally, the presenters will discuss item format, electronic dissemination, and reporting functions.

OVERVIEW Purpose Comparisons (K-12 with HE) Planning Stages

Identifying Stakeholders Specifying Information Needed Merging Stakeholders with Information Needed Selecting Tool to Acquire Information (Evidence)

If selecting online application system… General Examples Specific Examples Process

Group Activities

PURPOSE School Improvement Continuous Improvement Response to Intervention Assessment Evidence-based Culture

COMPARISONS

Similarities and Differences Stakeholders Policy Makers Accreditation Agencies Employers

Formal/informal decisionsCommittee Structures

Incorporation of “Good” Data

CYCLE OF CONTINUOUS IMPROVEMENT

NEAG SCHOOL OF EDUCATION

NEAG SCHOOL OF EDUCATION ASSESSMENT

PLAN

ASSESSMENT PLAN

OVERVIEW Purpose Comparisons (K-12 with HE) Planning Stages

Identifying Stakeholders Specifying Information Needed Merging Stakeholders with Information Needed Selecting Tool to Acquire Information (Evidence)

If selecting online application system… General Examples Specific Examples Process

Group Activities

PLANNING STAGES: IDENTIFYING STAKEHOLDERS

StudentsStaff

TeachersAdministrators

Board of EducationCommunity Members

CSDE (maybe)

PLANNING STAGES: SPECIFYING INFO NEEDED

Professional DevelopmentSchool ClimateParent Interest

Teacher Evaluation/AssessmentEmployer SurveyAlumni Opinions

Transportation Issues

PLANNING STAGES: MERGING STAKEHOLDERS WITH INFO NEEDED

Stakeholders: Students Staff Teachers Administrators Board of Education Community Members

Information Needed: Professional

Development School Climate

PLANNING STAGES: MERGING STAKEHOLDERS WITH INFO NEEDED

Stakeholders: Students Staff Teachers Administrators Board of Education Community Members

Information Needed: Professional

Development School Climate

PLANNING STAGES: SELECTING A “TOOL” BASED UPON

INFO NEEDEDExisting Data

Acquiring New Data

ONLINE APPLICATION SYSTEM

ONLINE APPLICATION DESIGN

(ITEM = QUESTION)

APPLICATION WRITING TIPS

ITEM OPTIONS

RADIO BUTTONS

List – horizontal or vertical - from which one option may be selected

Examples from the Professional Development Evaluation:

DROP DOWN LISTS

A drop down menu from which one option can be selected

Example from the School Climate Questionnaire:

CHECKBOXES List from which multiple options can be selected.

Examples from the Parent Education Interest Inventory:

RATING SCALES

Radio button scale consisting of consecutively-numbered options

Example from the Employee Survey:

MATRICES

A grid of questions

Examples from the High School Climate Survey:

OPEN-ENDED SINGLE-LINE TEXT Free-form text with formatting rules

Examples from the Parent Education Interest Inventory:

OPEN-ENDED MULTI-LINE TEXT

Free-form text in a box with a specified number of rows and columns

Examples from the Elementary School Climate Survey:

SELECTING ONLINE SYSTEM: PROCESS

Invitation to Participate with Cover Letter

• Purpose• Why THEY are asked for info• Anonymous, confidential, aggregate

info• Timeline

Invitation to Participate Example:

Cover Letter Example:

School Climate Questionnaire Example

APPLICATION EXAMPLE Parent Education Interest Inventory – Invitation to Participate

Parent Education Interest Inventory – Cover Letter

APPLICATION EXAMPLE

Parent Education Interest Inventory – Invitation Letter

APPLICATION EXAMPLE

Parent Education Interest Inventory – Invitation Letter

APPLICATION EXAMPLE

Parent Education Interest Inventory – Invitation Letter

APPLICATION EXAMPLE

Parent Education Interest Inventory – Invitation Letter

APPLICATION EXAMPLE

EXAMPLES Elementary School Climate Survey

http://uconn.checkboxonline.com/esclimate2012.aspx Employee Survey http://uconn.checkboxonline.com/employee2012.aspx High School Climate Survey

http://uconn.checkboxonline.com/hsclimate2012.aspx Parent Education Interest Inventory

http://uconn.checkboxonline.com/parentinterest2012.aspx Professional Development Evaluation

http://uconn.checkboxonline.com/profdev2012.aspx School Climate Questionnaire

http://uconn.checkboxonline.com/climate2012.aspx

REPORT EXAMPLES

Pie charts Bar graphs Tables Qualitative responses

CHECKBOX LIVE DEMO

Degree/Certification Count Percent

Bachelor's 73 10.3Master's 431 60.56th Year Certificate 112 15.7Doctorate 96 13.5

Total: 712 100.0

Code: 1: Very unsatisfied; 3: Neither satisfied nor unsatisfied; 5: Very satisfied

EXAMPLES AND LIVE DEMOAN OFFER … TO YOU

Dr. Mary E. Yakimowski mary.yakimowski@uconn.edu 860-486-2848

Ms. Sarah D. NewtonUniversity of Connecticut