523 richardson project evaluation plan

7/17/2019 523 Richardson Project Evaluation Plan

http://slidepdf.com/reader/full/523-richardson-project-evaluation-plan 1/3

Shelly RichardsonTwitter Team Professional Development Forum

Project Evaluation Plan

Primary Evaluation Goals

The goal of this program evaluation is to measure the effectiveness of the coursedesign in promoting community building in an online environment. Course effectivenessis measured by assessing the course introduction, learning outcomes, learnerassessment tools, learner interaction, course technology and usability.

Evaluation Components and Methodology

Based on knowledge gained in the EDTECH Evaluation course, the development of aprogram evaluation plan should include both formative and summative assessmentcomponents. The following evaluation tools will be implemented in the Twitter TeamProfessional Development forum:

• A pre-course evaluation with stakeholders based on the evaluation rubric.Included in this evaluation will be an area for essay format feedback, allowingstakeholders the opportunity to offer suggestions for improvement

• A mid-unit evaluation of course based on the evaluation rubric will gatherlearner feedback data. Included in this evaluation will be an area for essayformat feedback, allowing learners the opportunity to offer suggestions for

improvement. This is placed mid-unit so that formative changes can be made,if necessary.

• A post-course evaluation with learners and stakeholders, based on theevaluation rubric. Included in this evaluation will be an area for essay formatfeedback, allowing learners and stakeholders the opportunity to offersuggestions for improvement.

Assessment Instruments

The assessment instruments being used for program evaluation are an evaluation

rubric created (See Appendix I) for this purpose and surveys that are built-in structuralcomponents in the Canvas Learning Management System.

Evaluation Method Criteria

The creation of the K-State Libraries Twitter Team Professional Development Forumis the follow-up step in the K-State Libraries Twitter Program. In the fall of 2014, agoals-based evaluation of this program was conducted that surveyed the libraryTwitter followers. This evaluation produced results based on user perceived



"usefulness" of the Twitter Program objectives. As the Twitter Team creates theinformation disseminated to the library Twitter followers, it is logical that they shouldbe aware of the Twitter Program Objectives. One of the goals of this forum is to createa familiarity and understanding of these objectives.

As the 2014 Twitter Program evaluation was structured on a goals-basedmethodology, it is logical that the K-State Libraries Twitter Team ProfessionalDevelopment Forum also use this method. Boulmetis and Dutwin describe the goals-based method of evaluation as, "any type of evaluation based on the knowledge of--and reference to--the goals and objectives of the program, person or product." (p.109)Therefore, not only will the participant knowledge of the Twitter Program objectives bemeasured, we will also measure community building participation in this course.

An evaluation rubric has been created based on both the Quality Matters Standardsfor Higher Education, Fifth Edition, and the specific learning outcomes of thisprofessional development forum. The rubric focuses on gathering data that measureseffectiveness of the course introduction, learning outcomes, student assessment

tools, learner interaction, course technology and usability.

References

Boulmetis, J., & Dutwin, P. (2011). The ABCs of evaluation: Timeless techniques for program and project managers (3rd ed.). San Francisco: Jossey-Bass.

Higher Ed Program Rubric | Quality Matters. (2013). Retrieved April 14, 2015, from

https://www.qualitymatters.org/rubric

https://www.qualitymatters.org/rubric



Appendix I

Evaluation Rubric for K-State Libraries Professional Development Forum

https://drive.google.com/file/d/0B2JR19YBZHuFNTlEVlY5a3dzMUE/view?usp=sharing



523 richardson project evaluation plan

Documents