student content evaluation uc & r april 2009
DESCRIPTION
Power point presentation detailing research to develop student content evaluation tool for use with online communities. Presented at U C & R meeting at De Montfort University 28th April 2009TRANSCRIPT
Using online workshops to Using online workshops to enhance student content enhance student content evaluation skills for VLE evaluation skills for VLE learning communitieslearning communities
De Montfort University RITA project 2008 – 2009
Mike Leigh, Lucy Mathers & Kaye Towlson
Session coverageSession coverage
BackgroundMethodologyResultsConnectionsFuture Applications
BackgroundBackgroundCross faculty/department RITA bid Build on work of previous RITA
funded project by Mike Leigh and Lucy Mathers◦revealed a significant gap between
information evaluation skills acknowledged by students and those manifest in work.
Wanted to develop an evaluative framework and publish on VLE for use when posting selected subject materials.
Methodology: Strand 1Methodology: Strand 1Lectures and LabsLectures and LabsEmbedded in curriculum.
◦2 different modulesSimilar assessment task
◦group or individual wiki◦Post material, mainly from the
internet to aid understanding of a negotiated topic.
◦Evaluate material posted. Group or peer evaluation of
material◦article review
Methodology Strand 1Methodology Strand 1Lectures and LabsLectures and Labs
Session re: information evaluation◦“Skill for life”, real life examples,
5W’s, 4C’sLab sessions run to enable the
creation and development of wikisLab sessions run to enable peer
evaluation of articles followed by feedback
Development of ISEMDevelopment of ISEMAnecdotal feedback reveals
improvement in quality of materials posted
Used criteria specified in info evaluation sessions (5 W’s) to develop Information Source Evaluation Matrix (ISEM)
Needed to test ISEM
Methodology Strand 2: Methodology Strand 2: UG and PG WorkshopsUG and PG WorkshopsSelf-assessment of info evaluation
skills (Likert Scale) “before and after”
Presentation/ refresher of the “5 Ws”
Intro to the ISEMApplication of ISEM to subject
specific materialRevised self-assessmentComments on ISEM application
Workshop Results 1Workshop Results 1UG and PG ISEM FeedbackUG and PG ISEM Feedback
Use of the ISEM positively received by UGs and PGs
All engaged with the matrix, its purpose and application
Recognition of importance of relevance and reliability
Some criteria valued more than others
Workshop results 2Workshop results 2Suggestions for ISEM Suggestions for ISEM improvementimprovementAll suggestions were positiveSome suggested a variation in
points allocation to reflect importance of individual criteria
Use of colour codingInclusion of space for
annotations, especially useful for future comparison
Inclusion of space for citation
ConnectionsConnectionsWith existing work:
◦Learner developed wiki of sources for module
◦UCPD: Researching business information Working with different communities
◦Academics and students from Faculty of Technology
Doing library stuff but not as “The Library”…student engagement
Confirmations….smugness not allowed
Project Results… so farProject Results… so farProject aim: To develop an evaluative
framework, publish on VLE for use when posting selected subject materials.
ISEM is offered as the pilot frameworkSelf-assessment Likert Scale to be
adjusted in the light of workshopsClear potential for developing
information evaluation skills as matrix clearly raises awareness and forces application
Future ApplicationsFuture Applications
Develop online tools, make available via VLE◦Offer as a generic tool?
Scope for future research:◦Application and implication of ISEM
in different subject areas and at different levels
◦May identify key criteria for specific subject areas