maria c.r. harrington©2008 [email protected] virtual trillium trail 2003-2008 presentation to paee...

13
Maria C.R. Harrington ©2008 [email protected] Virtual Trillium Trail 2003- 2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian Village, Bolivar, PA USA Maria C.R. Harrington School of Information Sciences University of Pittsburgh 135 North Bellefield Avenue Pittsburgh, PA 15260 USA

Upload: martin-alexander

Post on 13-Jan-2016

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Virtual Trillium Trail 2003-2008Virtual Trillium Trail 2003-2008

Presentation to PAEE Conference 2008February 28 – March 2, 2008, Antiochian Village, Bolivar, PA USA

Maria C.R. HarringtonSchool of Information SciencesUniversity of Pittsburgh135 North Bellefield AvenuePittsburgh, PA 15260 [email protected]

Page 2: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Demo Virtual Trillium Trail Demo Virtual Trillium Trail

Page 3: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Trillium Trail Study - May 2007 Trillium Trail Study - May 2007

Page 4: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

• Environment Main Effect: The Real Environment results in significantly higher Total learning activity than the Virtual.

• A one-way, within-subject ANOVA, with repeated measures in counterbalanced order, shows a significant and strong effect:

– F(1,11) = 4.68, p = 0.05

• Thus giving supporting evidence that the Real (M = 4.5, SD = 2.71) resulted in more Total learning activity than the Virtual learning activity (M = 2.83, SD = 3.43).

– H1a: μ Total Activity (Real) > μ Total Activity (Virtual)

Total Map Annotations ResultsTotal Map Annotations Results

Page 5: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Plant Only Annotations ResultsPlant Only Annotations Results

• The Real and Virtual Environments are equal for in-curriculum, Plant-only learning activity data subset. For the data subset of Plant-only map learning activity, a One-Way, within-subject ANOVA, with repeated measurements in counterbalanced order, shows no effect:

– F(1,11) = 0.00, p = 0.95.

• Thus, for Plant-only data subset learning activity, the Real (M = 2.75, SD = 1.96) and the Virtual (M = 2.83, SD = 3.43) are identical.

– H20: μ Plant-only Activity (Real) = μ Plant-only Activity (Virtual)

Page 6: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Main Effects: EnvironmentMain Effects: Environment

Out of Curriculum Real is Superior = MORE LEARNING

In-Curriculum Material of Plant Only are Equal!!

Page 7: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Main Effects: OrderMain Effects: Order

Second Field Trip, Real or Virtual shows more Inquiry Activity.Practice Makes Perfect!

Page 8: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

What does this mean?What does this mean?

• Interaction, Yes

• Interaction was found for Total map annotations by Group. The one-way, between-subjects ANOVA produced evidence of interaction for the Total map annotation learning activity

– F(1, 5) = 30.69, p = 0.003.

• H6a: Total Activity: Interaction Groups x Order

• Thus, some factor is effecting the variables in a non-constant way…

• What is going on????

Page 9: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

The Salamander-EffectThe Salamander-Effect• Some probability distribution of events that occur only in the real

environment, and result in highly salient, personally meaningful recordings and memories. Episodic “Teachable Moments” are critical design features.

Page 10: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Transfer Effects: Virtual to Real?Transfer Effects: Virtual to Real?

• If there is no transfer of skill, in-situ learning activity should be the same. If there is a significant difference, then there is evidence of transfer.

• The t-test for two independent groups (one-tail, post-hoc analysis) has been carried out to help explain the results.

• For the total map annotations, there was a significant difference,

– t = -2.29, df = 10, p = 0.023 (one-tailed, α = 0.01), between the conditions, Real(First) (M = 2.8, SD = 2.6) and Real(After Virtual) (M = 5.8, SD = 1.9), in the Independent Samples t-test.

– This result gives supporting evidence of the value of priming for the Real first with the Virtual, as the mean value significantly increased from 2.8 to 5.8 counts.

• H8a: Total Activity: μ Real(First) < μ Real(After Virtual)

Page 11: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

Transfer Effects: Real to Virtual?Transfer Effects: Real to Virtual?

• If transfer effects behave like order effects, could not the opposite relationship be true?

• Could we see transfer from Real to Virtual?

• In the past, such an analysis was impossible for life-critical training, such as pilot flight training, medical student operation simulation, or combat military training. But, for educational and learning applications, the question is valid and viable.

– The results for Total map learning activity show the Virtual(After Real) (M = 3.8, SD = 2.4) to be significantly higher

– t = -3.88, df = 10, p = 0.00 (one-tailed, α = 0.01)

– than the Virtual(First) (M = 0.0, SD = 0.0) in the Independent Samples t-test.

– This result gives supporting evidence of the value of reinforcement of the Real with the Virtual, as the mean value significantly increased from 0.0 to 3.8 counts. Note that no learning activity occurred in the Virtual when used First and independently.

• H9a: Total Activity: μ Virtual(First) < μ Virtual(After Real)

Page 12: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

ConclusionsConclusions

1. Real is superior overall, when Ethnographic data and statistical trends are considered.

2. High Fidelity Photo Realistic Virtual Reality Systems can match the Real Experience ONLY for in curriculum data

3. Order effect: “Practice makes perfect” Very strong and significant Order Effects in both Total and Plant Only Map Annotations.

4. Interaction: “Salamander Effects” -> critical design feature.

5. Transfer in both directions, with Real to Virtual showing stronger effects and stronger for in curriculum data.

6. Main Contribution = > use real and virtual together for maximized learning, prime before real, and reinforce after real.

Page 13: Maria C.R. Harrington©2008 mharring@pitt.edu Virtual Trillium Trail 2003-2008 Presentation to PAEE Conference 2008 February 28 – March 2, 2008, Antiochian

Maria C.R. Harrington ©2008 [email protected]

The Virtual Trillium Trail 2003-2008 The Virtual Trillium Trail 2003-2008

Maria C.R. HarringtonSchool of Information SciencesUniversity of Pittsburgh135 North Bellefield AvenuePittsburgh, PA 15260 [email protected]