1 assessment and evaluation for online courses associate professor dr. annabel bhamani kajornboon...

36
1 Assessment and Assessment and Evaluation for Evaluation for Online Courses Online Courses Associate Professor Dr. Associate Professor Dr. Annabel Bhamani Kajornboon Annabel Bhamani Kajornboon ([email protected]) ([email protected]) CULI’s 6 CULI’s 6 th th Intl Conference: Facing ELT Intl Conference: Facing ELT Challenges Challenges Nov. 27- 29, 2006 Nov. 27- 29, 2006

Upload: giles-reed

Post on 22-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

1

Assessment and Assessment and Evaluation for Online Evaluation for Online

CoursesCourses

Assessment and Assessment and Evaluation for Online Evaluation for Online

CoursesCoursesAssociate Professor Dr.Associate Professor Dr.

Annabel Bhamani Kajornboon Annabel Bhamani Kajornboon ([email protected])([email protected])

CULI’s 6CULI’s 6thth Intl Conference: Facing ELT Intl Conference: Facing ELT Challenges Challenges

Nov. 27- 29, 2006Nov. 27- 29, 2006

Page 2: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

2

Focus•Assessment•Evaluation

Page 3: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

3

Introduction• Computers a part of education• T technology & pedagogical problems• T concern attend seminars, conferences etc.• “In keeping with a learner-centered approach,

evaluation and assessment should be part of the learning-teaching process, embedded in class activities and in the interactions between learners and teachers” (Harasim et al. 1996:167).

Page 4: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

4

Terminology• E-learning and online – interchangeably• Assessment– -the act of judging or assessing a

person, situation or event -learning outcomes assessment

provides what ss know and can do at specific points

designed to improve learning

Page 5: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

5

Evaluation (1)

• Assess effectiveness of an ongoing program in achieving its objective(s)

• Relies on standards of project design to distinguish a program’s effect from those of other forces

• Aims at program improvement through a modification of current operation

Page 6: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

6

Evaluation (2) • Collect infor. (assessments) to make

informed decisions about continued instruction, programs, or activities.

• Evaluation can assess both the process and outcomes.

• Judging the quality, value or worth of a program or student performance using established criteria, using gathering data.

Page 7: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

7

Evaluation (3)• Process of determining the

adequacy, value, outcomes and impact of instruction & learning,

• Assessment at a point in time of the value, worth of impact of a project or program,

• Can be conducted at various points in a project.

Page 8: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

8

Technology

E-learning course

Teacher Students

Chart 1: Linkage of e-learning courses to assessment and evaluation

Assessment &Evaluation

s

Page 9: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

9

Action-Reflection Cycle Planning

Reflecting Acting

Observing

Page 10: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

10

Websites Assessments• Quiz• Test• Papers

Let's look at examples of websites assessment

Page 11: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

11

Examples of Websites Assessments

2Example A: About English as a nd Langua PPPPP P PPPPPPPP-–//

• There are15 questions. Ss click the m ouse to answer the question.

• Ss are given 10 seconds to answer eac h question with only one correct answer.

• Feedback is provided at the end of the quiz.

Page 12: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

12

Example A: About English as a 2nd Language Prepositions of

Place – in/at/on

Page 13: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

13

Example A: About English as a 2nd Language Prepositions of Place –

in/at/on (2)

Last line from previous example: More prepositions quizzes

• Example B 2: About English as a nd La PPPPP P PPPPPPPP-–//

• Feedback is given for correct answer

Page 14: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

14

Example B : About EnglishLanguage Prepositions of Place –

in/at/on-

Page 15: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

15

Example C: About English as a 2nd Language Prepositions of Place – in/at/on- If ss do not click an answer the following

appears

Page 16: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

16

If students click the incorrect answer the foll owing appears

look at Example D: 2About English as a nd Lang PPPPP P PPPPPPPP-–//

Page 17: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

17

Example D: Prepositions of Place

That answer was not correct.

Page 18: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

18

Example E: Lang. Prep. of Place (1)

• When students complete the quiz, the score will appear and other quizzes are offered.

• Let’s look at the score and what else is offered.

Page 19: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

19

Example E: Lang. Prep. of Place (2)

Page 20: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

20

Other form of assessments

• Electronic portfolios• Computer-based work checklist• Peer review• Sheets• Close texts• Learning logs• Multimedia projects

Page 21: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

21

Example G: Example of Portfolio Scoring Rubric

Page 22: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

22

E-portfolio• It is a collection of students’ work

that shows students’ efforts, progress, and achievements in more or more areas or the curriculum.

Page 23: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

23

Example H: E-portfolio

Page 24: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

24

Example I: E-portfolio

Page 25: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

25

What to include in an e-portfolio?

Collection can include:• Ss participation in selection content• Criteria for selection• Criteria for judging merits• Evidence of ss self-reflection• A collection of ss best work or efforts,

ss choose samples to meet assignment. Show growth & development.

Page 26: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

26

What is necessary to create e-portfolio?

• Equipment• Software• Training• Play• Plan

• An assessment tool depending on knowledge level of T, time T have & can invest

Page 27: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

27

Example J: Example of an e-portfolio

Page 28: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

28

E-Portfolio• An e-portfolio is an organized,

purposeful collection of students’ work that displays knowledge, understanding, skills, accomplishments, interest and achievement over a period.

• Time and planning is essential.

Page 29: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

29

Example l: Sarah’s work

Page 30: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

30

Example M: T’s feedback (1)

Page 31: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

31

Evaluation(1)

• The evaluation can be conducted via qualitative methods which are often used.

• They tell the program’s story by capturing and communicating the participants’ stories.

• The action-reflection cycle can be used.

Page 32: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

32

Evaluation (2)

It would be assessing the program.• Systematic collection of information

about the activities characteristics, and outcomes of programs to make judgments about the program, improve program effectiveness and/or inform decisions about future programs.

Page 33: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

33

An Example of Evaluation

(Research) (1)

• Aj arns teaching oral com. courses were interviewed to find out the pr

edicaments they were facing.• W hat were some of the problem s t

hey had encountered teaching,• The interviews were analyzed.• The data was presented in a matrix

form to find a common thread.

Page 34: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

34

An Example of Evaluation

(Research) (2)

• Kajornboon (2005) investigated issues th at teachers face in teaching oral com. in t he Thai context and examined existing te

aching method in oral communication th at teachers found effective and productiv

e. • T he study aimed to provide a practical gui

deline or checklist to assist ajarns in teac hing oral communication in order to impro

ve students’ language development.

Page 35: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

35

Conclusion• Web assessment & evaluation can take

many dimensions.• T set their goal and know what they wan

t to measure, such as the course, studen ts, or program.

• T choose to do assessment or evaluatio n that is best for their students and cour

se.

Page 36: 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing

36

Q & A• Comments• Questions• Thank youEmail: [email protected] annabelbk@yahooSubj.: assessment/evaluation