Using the ETS Criterion Online Writing System to Enhance and Assess Learner-Centered Writing Proficiency

Robert Ussery, Assistant Vice Chancellor for Academic Affairs Robert Ussery, Assistant Vice Chancellor for Academic Affairs

North Carolina A&T State University North Carolina A&T State University http://qed.ncat.edu

The Redesign Alliance ConferenceThe Redesign Alliance Conference Orlando, FloridaOrlando, Florida March 18, 2008March 18, 2008

CRITERION

A web-based service developed by A web-based service developed by Educational Testing Service to:Educational Testing Service to: Evaluate writing skillsEvaluate writing skills Provide instant score reporting and Provide instant score reporting and

diagnostic feedback to:diagnostic feedback to:

Both students and instructorsBoth students and instructors

Benefits - for Students

Improve writing skillsImprove writing skills

Empower the learnerEmpower the learner

Work independently at own pace Work independently at own pace

Access 24/7 from any computerAccess 24/7 from any computer

Get immediate detailed feedbackGet immediate detailed feedback

Enhance communication with instructorEnhance communication with instructor

Benefits - for Instructors

Adds value to instructional activitiesAdds value to instructional activities

Saves time by providing an efficient tool to:Saves time by providing an efficient tool to: administer class assignments administer class assignments grade essaysgrade essays comment on student work comment on student work review student portfoliosreview student portfolios concentrate on course content concentrate on course content

Access to CRITERION

Student access is browser-basedStudent access is browser-based

http://criterion.ets.orghttp://criterion.ets.org

Instructor access is browser-based

http://criterion.ets.orghttp://criterion.ets.org

I

NCA&T OBJECTIVES

Provide online writing evaluation systemProvide online writing evaluation system

Deploy as a learning toolDeploy as a learning tool

Campus-wideCampus-wide

Across the curriculumAcross the curriculum

Enhance writing proficiencyEnhance writing proficiency

SCOPE

Freshman student orientationFreshman student orientation New faculty orientationNew faculty orientation Faculty trainingFaculty training 45% of enrollment subscribed in 200345% of enrollment subscribed in 2003 100% of enrollment subscribed 2004-07100% of enrollment subscribed 2004-07 11stst Year English Placement – 2005-07 Year English Placement – 2005-07

SCOPE Cont’d

Writing labsWriting labs Center for Academic ExcellenceCenter for Academic Excellence Various disciplinesVarious disciplines Graduate levelGraduate level

How We Use Criterion at NCAT

Remediation and basic skills classesRemediation and basic skills classes AssessmentAssessment Online writing coursesOnline writing courses Practice for high-stakes writingPractice for high-stakes writing Writing across the curriculumWriting across the curriculum

EXPERIENCE AND RESULTS

Compared final grades in freshman English Compared final grades in freshman English sections Fall 2005sections Fall 2005

Group 1: Criterion assignments requiredGroup 1: Criterion assignments required Group 2: No Criterion assignments Group 2: No Criterion assignments Group 1 mean was significantly higherGroup 1 mean was significantly higher

Implications

Enhanced Student Learning OutcomesEnhanced Student Learning Outcomes Beneficial Impact on RetentionBeneficial Impact on Retention Very Cost Effective Very Cost Effective

WHERE TO FROM HERE

Rigorous learning outcomes assessmentRigorous learning outcomes assessment Explore proficiency requirementExplore proficiency requirement

EnglishEnglish University studiesUniversity studies Other disciplinesOther disciplines

Thank you for attending

NCA&T Support Site

http://qed.ncat.edu/ir&p/availabl.htm