tbl conference – 1 june 2007 1 to adopt or not adopt tbl: a diffusion of innovation perspective...
TRANSCRIPT
![Page 1: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/1.jpg)
1
TBL Conference – 1 June 2007
To adopt or not adopt TBL: To adopt or not adopt TBL: a diffusion of innovation perspectivea diffusion of innovation perspective
Mark Freeman & Susan McGrath-Champ
![Page 2: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/2.jpg)
2
Adopt or not?
![Page 3: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/3.jpg)
3
Research aims and motivation
Aim– To better understand the TBL adoption decision
Motivation– Little research on teachers (+ others) experiences– Little research grounded in (innovation) theory– Useful for potential adopters, developers & mgrs
![Page 4: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/4.jpg)
4
Adopt which bits?
![Page 5: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/5.jpg)
5
ContextAustralia
• National research performance exercise• National teaching performance fund
University• On-campus, research-intensive, “Sandstone”• 47,000 commuter students
School (Faculty) Economics and Business • 10,000 students (30% international)• 300 teachers in 11 comprehensive disciplines• Research required and teaching freedom • Transformation since 1999 • Embedded L&T support staff• TBL trial 2006-7
![Page 6: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/6.jpg)
6
Research literature
Innovation in higher education– Typically student experience/tool/method– Teacher experience often peripheral– Nearby peer (Bennett, 01) in ‘tribe’ (Beecher 91)– Other stakeholders (Bell & Bell, 05)
TBL– Approach (Michaelsen et al, 02)– Students enjoyment, engagement, skills, achievement
(Levine et al, 04)– 11 medical teachers in 10 schools (Thompson et al; 07)
![Page 7: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/7.jpg)
7
The “Chasm”
Rogers Diffusion of Innovation
0
10
20
30
40
50
60
70
80
90
100
Innovators2.5%
Early Adopters13.5%
Early Majority34%
Late Majority34%
Laggards 16%
Cum
ulat
ive
%
![Page 8: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/8.jpg)
8
Diffusion of innovation research
Individual factors (eg. Rogers 95,03)– Relative advantage – Cultural compatibility– Trialability– Visibility– Complexity
Non individual factors (Frambach et al, 02)– Internal – External
![Page 9: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/9.jpg)
9
Research method
• Staff interviews – 5 with adopting teachers
• 1 dropped and 1 repeat• Accounting, HR, Ethics
– 4 adoption supporters (TA, Tech, Dev, AMgr)– Questions
• Demographics and context• Model used (Assessment weight? # Quests & quizzes?
Appeals? Problems? Peer assessment?)• 7 open-ended adoption factors
– Transcribed – Categorised by factor
• Student perceptions survey and comparison on marks
![Page 10: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/10.jpg)
10
Relative advantageAdopter+ Quality of learning+ Student experience+ Love instant feedback+ Increase interaction+ Fun factor+ Job satisfaction+ Long term time benefit
- Initial cost (if not supported)- Writing suitable Q- Right teaching space hard
Supporters+ Active learning strategy (AMgr)
+ Less time/$ on marking (TA)
+ The whole TBL model (TA)
- Admin work on quiz & data (TA)
- Technical skill of adopter (Tec)
- Risk of failure (AMgr)
- Might rethink teaching (AMgr)
![Page 11: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/11.jpg)
11
Cultural compatibility
Adopters
+ Paradigm shift to teaching
+ Free to choose teaching style
+ UG students naturally disposed
+ Confident teachers fine
- Few peers interested
- Relinquish control of class
- PG students less comfortable
Supporters+ Fits role of Office of L&T
(Tech)
+ Disrupts dominant ‘telling’ paradigm (Dev)
+ Fits disciplines trialled (AMgr)
+ Fits actual adopters (AMgr)
- Research vs teaching (AMgr)
![Page 12: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/12.jpg)
12
Complexity
Adopters
+ Process straightforward
+ Depends on attitude
- Need to see to believe
- Requires support
Supporters
+Technical staff (Mgr/Dev)
- Varies by % TBL used (AMgr)
- Might rethink teaching (AMgr)
- Technical skill matters (Tec)
- Harder larger class (AMgr)
![Page 13: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/13.jpg)
13
Visibility
Adopters
+ Evident in team quiz results
+ Only if observed in action
+ Students can spread word too
- Inadequate promotion eg. web
Supporters
+ Seeing demystifies (Dev)
+ Hearing peer teaching hum is persuasive (AMgr)
+ Research & conference papers visible (AMgr)
![Page 14: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/14.jpg)
14
Trialability
Adopters
+ Can break into bits
- Need all bits to be truly effective
Supporters
+ Technical support necessary (Tec/Mgr)
+ If interactive Q already used eg. Clickers (AMgr)
- Take a few cycles to refine and get ROI (Dev)
- Big bother for adopting all bits once-off (AMgr)
![Page 15: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/15.jpg)
15
Internal organisation
Adopters+ Extra TA resource+ Enthusiasm & evidence of
developer+ L&T leadership + L&T support
- Inflexibility marking support policy
Supporters+ A budget meant quick
responses possible (Tec)
+ ‘sense of something’ (TA)
+ Strategic positioning under new dean (AMgr)
- Education of adopters (Tec)
![Page 16: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/16.jpg)
16
External environment
Adopters+ Responsive equipment
supplier+ Question banks
- Corrupt publisher question bank
- Prior “TBL” experience
Supporters+ Evidence success
elsewhere (AMgr)
+ Increased rankings pressure (AMgr)
![Page 17: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/17.jpg)
17
Themes
Attributes of sample teachers All student-centred & confident teachers (Thompson, p.254; 2007) All value teaching personally and/or in peer ‘tribe’ All prepared to take some risks
Still face challenges Threshold factors vary and dissipate over time (Thompson, p.253; 2007) Variation apparent with early adopter/mainstream Chasm Course redesign even if pro-interaction and have some Q developed Support stakeholders & context matter lots
Other teachers Not recalcitrant (Newton, p.423; 03)
Just burned, busy, besotted with main reward game
![Page 18: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/18.jpg)
18
Sustainability1. Develop local support systems Appeal to mainstream not early adopter (Anderson et al 98) Online FAQs and templates Online case studies (with video; honest cost/benefits list) Encourage incremental adoption Central equipment supply & maintenance Central JIT development support (both technical & pedagogical)
2. Align local policies Build and allocate appropriate teaching spaces Reward innovation not just teaching quality Reward evaluation and pedagogical research (Anderson et al 98) Grant provisions include collaboration & evaluation report
![Page 19: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/19.jpg)
19
Sustainability
3. Facilitate communities of practice Provide internal opportunities for sharing
• TBLers
• Innovators
• Disciplinary tribe eg. through research seminars
Practice needs to survive champion
![Page 20: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/20.jpg)
20
Conclusion
Case studies of adopter experience important & vary• High impact of formal & informal support structures • High impact of stakeholder’s conception of teaching
Limitations overcome with future research• Ground in other models of diffusion • Bigger, multiple site, unbiased sample• Quantitative• Look for impact of different % of TBL adoption and consider
adopters either side of ‘chasm’• Current http://www.surveymonkey.com/MySurveys.asp?u=768203913765
![Page 21: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/21.jpg)
21
Thank you ….
Q&A
![Page 22: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/22.jpg)
22
Add results: Student perceptions survey
Overall Agree Disagree
Recommend TBL next year 80% 7%
Recommend TBL to other units 65% 13%
More effective learning than other units 48% 19%
![Page 23: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/23.jpg)
23
Add results: Student perceptions survey
Components of TBL Agree Disagree
Regular testing helped progressive learning 81% 7%
In-class IRAT encouraged preparation 99% 1%
IRAT ensures all contribute to team 94% 1%
Prefer do both IRAT and TRAT (not one) 78% 6%
Prefer IRAT not assessable 14% 60%
Prefer TRAT not assessable 7% 72%
![Page 24: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/24.jpg)
24
Add results : Student perceptions survey
Benefits of double testing (IRAT + TRAT) Agree
Increased understanding of concepts 65%
Increased my critical thinking about international HRM 51%
Helped me learn new ways to approach questions 57%
Improved my marks 52%
Other (negotiate, communicate, active) 17%
![Page 25: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/25.jpg)
25
Add results : Student perceptions survey
Challenges of double testing (IRAT + TRAT) Agree
None experienced 38%
Discussion of the team quiz answers 29%
Uneven preparation by team members 26%
Other (talking between teams; teacher’s job to teach; insufficient time)
17%
![Page 26: TBL Conference – 1 June 2007 1 To adopt or not adopt TBL: a diffusion of innovation perspective Mark Freeman & Susan McGrath-Champ](https://reader035.vdocuments.us/reader035/viewer/2022062619/55151e51550346a80c8b6138/html5/thumbnails/26.jpg)
26
Add results : Student perceptions survey
Components of TBL Agree Disagree
Team RAT developed team skills 80% 7%
Team RAT helped me learn 67% 9%
Team problems helped apply quiz learning 80% 6%
Discussion after TRAT ensures good learn 79% 9%
Team problems too simple to be helpful 20% 63%