using similarity rating tasks to assess case reuse in problem solving

1
4. METHODOLOGY 4. METHODOLOGY Using Similarity Rating Tasks to Assess Case Reuse in Problem Solving Fran Mateycik, 1 and David Jonassen 2 , N. Sanjay Rebello 1 1 Kansas State University, 2 University of Missouri This work is supported in part by US National Science Foundation under grant DUE-06185459. REFERENCES REFERENCES 2. QUESTIONS 2. QUESTIONS To what extent do students focus on principle similarities and differences? Given problem pairs, how do students’ similarity ratings of the pairs change after the group learning interviews? How do student ratings compare with faculty ratings? 1. BACKGROUND 1. BACKGROUND Facilitate the development of conceptual schema using case reuse. Conducted semester long treatment in algebra-based physics. 2 Individual interviews conducted at mid- and end- points of semester. Asked to rate problem pairs of varying similarity 5. RESULTS 5. RESULTS Given problem pairs with facial differences: Students are seemingly seemingly unfocused unfocused on Principle Similarities during 1st interview. 1st interview. Students begin to focus begin to focus on Principle Similarities during 2 2 nd nd Interview Interview . . Student rating of problem Type B (Surface Different and Principle Similar) increases significantly. Student rating of problem Type B looks more 6. Summary 6. Summary 3. THEORY 3. THEORY 1 Surface and Principle Differences Surface different problems: multiple contexts can be associated with a principle. Principle different problems: Problems are not associated by the same principles. Principles are basic rules or assumptions. 4 Categories of Pairing FS FD PS A A B B PD C C D D Facial Similarity (FS) Facial Difference (FD) Principle Similarity (PS) Principle Difference (PD) Type C Type C: Pairs are FS and PD Students are given 8 problem pairs in the order of A,A,B,B,C,C,D,D 4. METHODOLOGY 4. METHODOLOGY Research Design Research Design 1 2 3 4 5 6 7 8 1.2-D Kinematics 2.Force 3.Rotational Motion 4.Work-Energy 5. Rotational Motion 6. Pressure in Fluids 7. Simple Harmonic Motion 8. Standing Waves & Resonance Group Learning Group Learning Interviews Interviews 1 st Individual Interview Screening Interview 2 nd Individual Interview Evolving Evolving Protocol Protocol Finalized Finalized Protocol Protocol N=10 Students Enrolled in Algebra-based physics Participating in weekly Group Learning Interviews Method: 2 Individual Interviews 50 minutes each 1 st Individual Interview at mid-point of semester 2 nd Individual Interview at end of semester Students rate similarities between problem pairs F Facial D Difference ( FD FD) : roller coaster vs. gun P Principle D Difference ( PD PD) : friction vs. no friction F Facial S Similarity ( FS FS) : both roller coasters P Principle S Similarity ( PS PS) : both no friction Type A Type A: Pairs are FS and PS Type B Type B: Pairs are FD and PS Type D Type D: Pairs are FD and PD F Facial D Difference ( FD FD) : roller coaster vs. gun P Principle S Similarity ( PS PS) : both no friction F Facial S Similarity ( FS FS) : both roller coasters P Principle D Difference ( PD PD) : friction vs. no friction (continued) (continued) 1.T.J. Nokes & B.H.Ross, AIP Conference Proceedings 951, 7-10 (2007). 2.M.T.H. Chi, P.J. Feltovich, and R. Glaser, Cognitive Science 5 (2), 121-152 (1981). 3.L. Hsu, et al., American Journal of Physics 72 (9), 1147-1156 (2004). 4.D.H. Jonassen, Educational Technology and Research and Development 48 (4), 63- 85 (2000). 5.D. Gentner, Cognitive Science 7 (2), 155-170 (1983). A > B (p-value 0.000) B < C (p-value 0.003) C > D (p-value 0.008) Interview 1 Ratings Significant Differences: A B C D Similarity rating Significant Difference: C > D (p-value 0.014) Interview 2 Ratings Differences between A & B, B & C are no longer significant A B C D Similarity rating Differences between B & C in Interview 2 Interview 2 negligible compared to Differences between B & C in Interview 1 Interview 1 Interview 1 & 2 Ratings Interview 1 Interview 1 Interview 2 Interview 2 A B C D Similarity rating Similarity rating Interview 2 & Faculty Ratings Interview 2 Interview 2 Faculty Faculty A B C D Students’ end- semester ratings for three of the four problem types are similar to four volunteer faculty ratings.

Upload: burke

Post on 06-Jan-2016

28 views

Category:

Documents


3 download

DESCRIPTION

1. BACKGROUND. Facilitate the development of conceptual schema using case reuse. Conducted semester long treatment in algebra-based physics. 2 Individual interviews conducted at mid- and end-points of semester. Asked to rate problem pairs of varying similarity. REFERENCES. 2. QUESTIONS. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Using Similarity Rating Tasks to Assess Case Reuse in Problem Solving

4. METHODOLOGY4. METHODOLOGY

Using Similarity Rating Tasks to Assess Case Reuse in Problem SolvingFran Mateycik,1 and David Jonassen2, N. Sanjay Rebello1

1Kansas State University, 2University of Missouri

This work is supported in part by US National Science Foundation under grant DUE-06185459.

REFERENCESREFERENCES

2. QUESTIONS2. QUESTIONSTo what extent do students focus on principle similarities and differences?

Given problem pairs, how do students’ similarity ratings of the pairs change after the group learning interviews?

How do student ratings compare with faculty ratings?

1. BACKGROUND1. BACKGROUNDFacilitate the development of conceptual schema using

case reuse.

Conducted semester long treatment in algebra-based physics.

2 Individual interviews conducted at mid- and end-points of semester.

Asked to rate problem pairs of varying similarity

5. RESULTS5. RESULTS

Given problem pairs with facial differences:Students are seeminglyseemingly unfocusedunfocused on Principle

Similarities during 1st interview.1st interview.Students begin to focusbegin to focus on Principle Similarities during

22ndnd Interview Interview..Student rating of problem Type B (Surface Different and

Principle Similar) increases significantly.Student rating of problem Type B looks more expert-like.

6. Summary6. Summary

3. THEORY3. THEORY1Surface and Principle Differences

Surface different problems: multiple contexts can be associated with a principle.

Principle different problems: Problems are not associated by the same principles.

Principles are basic rules or assumptions.

4 Categories of Pairing

FS FD

PS AA BB

PD CC DD

Facial Similarity (FS)

Facial Difference (FD)

Principle Similarity (PS)

Principle Difference (PD)

Type CType C: Pairs are FS and PD

Students are given 8 problem pairs in the order of A,A,B,B,C,C,D,D

4. METHODOLOGY4. METHODOLOGY

Research DesignResearch Design

1 2 3 4 5 6 7 8

1. 2-D Kinematics

2. Force

3. Rotational Motion

4. Work-Energy

5. Rotational Motion

6. Pressure in Fluids

7. Simple Harmonic Motion

8. Standing Waves & Resonance

Group Learning InterviewsGroup Learning Interviews

1st Individual Interview

ScreeningInterview

2nd Individual Interview

Evolving ProtocolEvolving Protocol Finalized ProtocolFinalized Protocol

N=10 StudentsEnrolled in Algebra-

based physicsParticipating in weekly

Group Learning Interviews

Method:2 Individual Interviews

50 minutes each1st Individual Interview at mid-point of

semester2nd Individual Interview at end of semester

Students rate similarities between problem pairs

FFacial DDifference (FDFD) : roller coaster vs. gun

PPrinciple DDifference (PDPD) : friction vs. no friction

FFacial SSimilarity (FSFS) : both roller coasters PPrinciple SSimilarity (PSPS) : both no friction

Type AType A: Pairs are FS and PS

Type BType B: Pairs are FD and PS

Type DType D: Pairs are FD and PD

FFacial DDifference (FDFD) : roller coaster vs. gun PPrinciple SSimilarity (PSPS) : both no friction

FFacial SSimilarity (FSFS) : both roller coasters PPrinciple DDifference (PDPD) : friction vs. no friction

(continued)(continued)

1. T.J. Nokes & B.H.Ross, AIP Conference Proceedings 951, 7-10 (2007).

2. M.T.H. Chi, P.J. Feltovich, and R. Glaser, Cognitive Science 5 (2), 121-152 (1981).

3. L. Hsu, et al., American Journal of Physics 72 (9), 1147-1156 (2004).

4. D.H. Jonassen, Educational Technology and Research and Development 48 (4), 63-85 (2000).

5. D. Gentner, Cognitive Science 7 (2), 155-170 (1983).

A > B (p-value 0.000)B < C (p-value 0.003)C > D (p-value 0.008)

Interview 1 Ratings

Significant Differences:A

B

C

D

Sim

ilarit

y ra

ting

Significant Difference:

C > D (p-value 0.014)

Interview 2 Ratings

Differences between A & B, B & C are no longer

significantA

B

C

D

Sim

ilarit

y ra

ting

Differences between B & C in Interview 2Interview 2

negligible compared to Differences

between B & C in Interview 1Interview 1

Interview 1 & 2 Ratings

Interview 1Interview 1

Interview 2Interview 2A

B

C

D

Sim

ilarit

y ra

ting

Sim

ilarit

y ra

ting

Interview 2 & Faculty Ratings

Interview 2Interview 2

FacultyFacultyA

B

C

D

Students’ end-semester ratings for three of the four problem types are similar to four volunteer

faculty ratings.