sociedade portuguesa de inovação information society technologies programme accompanying measures...

Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação

Information Society Technologies ProgrammeInformation Society Technologies Programme

Accompanying MeasuresAccompanying Measures

(IST-2001-32633)(IST-2001-32633)

SponsorSponsor

Innovation in e-Learning Seminar


To disseminate, stimulate discussion and creative To disseminate, stimulate discussion and creative suggestions with regard to identified best practices in e-suggestions with regard to identified best practices in e-LearningLearning

ObjectiveObjective



9:159:15 IntroductionIntroduction9:309:30 Project Objectives and Applied MethodologyProject Objectives and Applied Methodology10:30 10:30 BreakBreak10:4510:45 Project Results – Case StudiesProject Results – Case Studies11:3011:30 Roundtable DiscussionRoundtable Discussion12:0012:00 LunchLunch13:1513:15 Presentations and Input From ParticipantsPresentations and Input From Participants15:1515:15 BreakBreak15:30 15:30 Next StepsNext Steps16:0016:00 Closing CommentsClosing Comments

AgendaAgenda



Project ObjectivesProject Objectives&&

Applied MethodologyApplied Methodology



Project Objectives & Applied Methodology

Project ObjectivesProject Objectives GeneralGeneral Objective Objective SpecificSpecific Objective Objective

Applied Methodology Applied Methodology Identification of e-Learning SitesIdentification of e-Learning Sites Initial EvaluationInitial Evaluation

- StructureStructure- ApplicationsApplications

Final EvaluationFinal Evaluation- Learner ModelsLearner Models- Soft Skills & Informal LearningSoft Skills & Informal Learning- Communities of LearningCommunities of Learning

Dissemination ActivitiesDissemination Activities

DecemberDecember 2002 2002


Project Objectives

To stimulate To stimulate creativitycreativity, and to enhance education and , and to enhance education and training systems for lifelong learning. (IST 2001 Key training systems for lifelong learning. (IST 2001 Key Action 3.2.1 – Self Learning for Work)Action 3.2.1 – Self Learning for Work)

General ObjectiveGeneral Objective



Project Objectives

To conduct a study on innovative structures and To conduct a study on innovative structures and applications of e-Learning within the United States applications of e-Learning within the United States and Europe.and Europe.

To foster innovative e-Learning development To foster innovative e-Learning development through dissemination of “best practice” innovative through dissemination of “best practice” innovative structures and applications. structures and applications.

Specific ObjectivesSpecific Objectives



Applied Methodology

e-Learning Sites:e-Learning Sites:

• Internet based learning that is focused on the Internet based learning that is focused on the delivery of content (text, audio, video, delivery of content (text, audio, video, animation, simulation) in a training format. animation, simulation) in a training format.

Identification of e-Learning SitesIdentification of e-Learning Sites

Description

Reasoning

Reflection



Applied Methodology

Utilized the four leading search engines based on the Utilized the four leading search engines based on the Jupiter Media Matrix’s ratings for “audience reach”, Jupiter Media Matrix’s ratings for “audience reach”, 2002 (searchenginewatch.com).2002 (searchenginewatch.com).

• Microsoft NetworkMicrosoft Network• YahooYahoo• GoogleGoogle• America OnlineAmerica Online


Description

Reasoning

Reflection



Applied Methodology

Conducted a search with the term “e-learning” and Conducted a search with the term “e-learning” and selected only sites with a focus on students as the end selected only sites with a focus on students as the end user.user.

• About 50 sites identifiedAbout 50 sites identified


Description

Reasoning

Reflection



Applied Methodology

Search engines are the most common method for Search engines are the most common method for identifying Internet sites. Theme “Self-learning for identifying Internet sites. Theme “Self-learning for work” - accessible existing sites.work” - accessible existing sites.

Assumption: leading e-Learning sites have the Assumption: leading e-Learning sites have the knowledge to leverage search engine and directories knowledge to leverage search engine and directories to attract end users.to attract end users.

Assumption: the term “e-learning” is a universal Assumption: the term “e-learning” is a universal term applied across Europe and the United States term applied across Europe and the United States for Internet based learning.for Internet based learning.


Description

Reasoning

Reflection



Applied Methodology

Restricted search due to assumptions – the term “e-Restricted search due to assumptions – the term “e-learning” and e-learning sites ability to leverage learning” and e-learning sites ability to leverage search engines.search engines.

• Other options are also highly restricted such as Other options are also highly restricted such as surveys of members of relevant associations surveys of members of relevant associations (European Distance Education Network – (European Distance Education Network – EDEN) that rely on a significant response rate. EDEN) that rely on a significant response rate. There is always a low interest for participating There is always a low interest for participating in evaluations!in evaluations!


Description

Reasoning

Reflection



Applied Methodology

Restricted search due to assumptions – the term “e-Restricted search due to assumptions – the term “e-learning” and e-learning sites ability to leverage learning” and e-learning sites ability to leverage search engines. (Continued)search engines. (Continued)

• Possibly limited to English based sites – 6 % of Possibly limited to English based sites – 6 % of the resulting sites were non English based.the resulting sites were non English based.


Description

Reasoning

Reflection



Applied Methodology

Resulting sites represented a diversity of Resulting sites represented a diversity of organisation structures (private for profit, organisation structures (private for profit, associations, etc.) but no traditional universities.associations, etc.) but no traditional universities.

• A lack of university focus on the general public A lack of university focus on the general public market.market.

• Opportunity to transfer innovative activities to Opportunity to transfer innovative activities to the traditional university sector – dissemination the traditional university sector – dissemination activities.activities.


Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation Identified a set of criteria to evaluate the sites’ structures Identified a set of criteria to evaluate the sites’ structures

and applications.and applications.

Evaluated the sites based on the set of criteria.Evaluated the sites based on the set of criteria.

Identified the top 5 sites with regard to structures.Identified the top 5 sites with regard to structures.

Identified the top 5 sites with regard to applications.Identified the top 5 sites with regard to applications.

Identified the top 20 sites overall (structures / Identified the top 20 sites overall (structures / applications).applications).

Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation Analysis of structures accounted for 7 specific criteria:Analysis of structures accounted for 7 specific criteria:

Objectiveness of the MissionObjectiveness of the Mission – clearly – clearly stated/understoodstated/understood

Unique Design and Structure of the InterfaceUnique Design and Structure of the Interface

Aesthetics of the Web siteAesthetics of the Web site – draw interest and – draw interest and appealingappealing

Usability and NavigationUsability and Navigation – user friendly – user friendly

Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation Analysis of structures accounted for 7 specific criteria Analysis of structures accounted for 7 specific criteria

(continued):(continued):

Adaptability to the WebAdaptability to the Web – course content adapted or – course content adapted or simply a written documentsimply a written document

Appropriateness of the Course Appropriateness of the Course StructureStructure – take into – take into account subject (Accounting includes problem account subject (Accounting includes problem solving simulations)solving simulations)

Support AvailableSupport Available – (contact information, call – (contact information, call centre)centre)

Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation Analysis of applications accounted for 4 specific criteria:Analysis of applications accounted for 4 specific criteria:

Technological CharacteristicsTechnological Characteristics –course specific –course specific (Audio, video, animation, whiteboards)(Audio, video, animation, whiteboards)

DegreeDegree of Interaction of Interaction with with OtherOther StudentsStudents (Synchronous interaction via audio/video/chat, (Synchronous interaction via audio/video/chat, email)email)

Degree of Interaction with a TutorDegree of Interaction with a Tutor (Synchronous (Synchronous interaction via audio/video/chat, email)interaction via audio/video/chat, email)

Pedagogical ToolsPedagogical Tools –course specific (exercises, –course specific (exercises, quizzes, simulations)quizzes, simulations)

Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation

Previous works:Previous works:

• Previous studies within the e-learning field: Previous studies within the e-learning field: LGUIDE – The e-Learning ExpertsLGUIDE – The e-Learning Experts

• Thesis: “A Framework for Comparing Web-Thesis: “A Framework for Comparing Web-Based Learning Environments” Based Learning Environments”

Description

Reasoning

Reflection



Applied Methodology

Initial EvaluationInitial Evaluation

Subjective component to the evaluation, although Subjective component to the evaluation, although limited.limited.

Short list of criteria sources – a need to review the Short list of criteria sources – a need to review the sources utilized with other existing sources – sources utilized with other existing sources – American Society for Training & DevelopmentAmerican Society for Training & Development, , Expert PapersExpert Papers

Clear need to develop widely accepted criteria to Clear need to develop widely accepted criteria to assess e-Learning practices – DG Education & assess e-Learning practices – DG Education & Culture “eLearning call for Proposals”, September Culture “eLearning call for Proposals”, September 20022002

Description

Reasoning

Reflection



Applied Methodology - Recap

Evaluation: site applications

Evaluation: site structures

Formation of a single ranking Summaries of top 20 sites

Evaluation: best practices. 1. Learner Models 2. Soft skills & informal

learning 3. Communities of learning

Identification of “best practices” & best practice case studies.

Project Seminar

Refinement of project findings and report

Public dissemination of

results



Applied Methodology

Final EvaluationFinal Evaluation Evaluated the top 20 e-Learning sites with regard to the Evaluated the top 20 e-Learning sites with regard to the

following 3 areas:following 3 areas:

• Learner ModelsLearner Models – – focus on focus on flexible, personal models flexible, personal models for learning.for learning.

• Soft Skills and Informal LearningSoft Skills and Informal Learning – focus on the – focus on the developmentdevelopment of soft skills (communication, of soft skills (communication, teamwork, leadership, project management, etc) and teamwork, leadership, project management, etc) and applying informal learning.applying informal learning.

• Communities of LearningCommunities of Learning – focus on identifying and – focus on identifying and implementing virtual communities, individuals with implementing virtual communities, individuals with similar learning needs, within and across similar learning needs, within and across organisational boundaries.organisational boundaries.

Description

Reasoning

Reflection



Applied Methodology

Final EvaluationFinal Evaluation

Description

Reasoning

Reflection

Learner Models evaluation was based on 10 criteria:Learner Models evaluation was based on 10 criteria:

Skills Skills GapGap AnalysisAnalysis – skill level evaluation prior to – skill level evaluation prior to coursecourse

Tutor Tutor AvailabilityAvailability

Student Student FlexibilityFlexibility – course scheduling – course scheduling, course , course navigationnavigation

Control of Control of Screen InformationScreen Information – student level – student level interfaceinterface

Defined Defined ObjectivesObjectives – course purpose, expected – course purpose, expected performanceperformance



Applied Methodology


Description

Reasoning

Reflection

Learner Models evaluation was based on 10 criteria Learner Models evaluation was based on 10 criteria (continued):(continued):

Self Self Assessment Assessment – periodically preferred– periodically preferred

Content Content IntegrationIntegration – – audio, videoaudio, video, slide show, , slide show, animationanimation

Document Document ManagementManagement – bibliography – bibliography, e-books, e-books

Help Help FacilitiesFacilities – beyond a tutor such as links, help – beyond a tutor such as links, help deskdesk

Simple Simple User InterfaceUser Interface – user friendly, consistent – user friendly, consistent interfaceinterface



Applied Methodology


Description

Reasoning

Reflection

Soft Skills and Informal Learning evaluation was based Soft Skills and Informal Learning evaluation was based on 7 criteria:on 7 criteria:

Interaction ActivityInteraction Activity – promoted and actual – promoted and actual interactioninteraction

Reward Reward – recognition or reinforcement of – recognition or reinforcement of accomplishmentsaccomplishments: diploma, certificate: diploma, certificate

TransferTransfer – relate course to the student’s “real – relate course to the student’s “real world”world”

EnvironmentEnvironment – – positive environmentpositive environment, tolerance of , tolerance of errors, appropriate feedbackerrors, appropriate feedback



Applied Methodology


Description

Reasoning

Reflection

Soft Skills and Informal Learning evaluation was based Soft Skills and Informal Learning evaluation was based on 7 criteria (continued):on 7 criteria (continued):

Communication Communication InteractivityInteractivity – level of interaction: – level of interaction: student / student and student / instructorstudent / student and student / instructor

MotivationMotivation – ability to motivate the student – ability to motivate the student, justify , justify the need to learnthe need to learn

Student Centred Student Centred – ability to manage depth and – ability to manage depth and scope of learning, schedule, contribution.scope of learning, schedule, contribution.



Applied Methodology


Description

Reasoning

Reflection

Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria:criteria:

Clearly Stated PurposeClearly Stated Purpose – establish a foundation for – establish a foundation for the community of learningthe community of learning

Experienced ModeratorsExperienced Moderators – ability to initiate and – ability to initiate and guide discussionsguide discussions

Registration System Registration System – to allow students to present – to allow students to present themselves to the community and provide the themselves to the community and provide the community a structurecommunity a structure



Applied Methodology


Description

Reasoning

Reflection

Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria (continued):criteria (continued):

Synchronous ToolsSynchronous Tools – allow real-time interaction – allow real-time interaction (chat rooms, discussion boards, virtual meetings)(chat rooms, discussion boards, virtual meetings)

Asynchronous ToolsAsynchronous Tools – ability to initiate and guide – ability to initiate and guide discussions (e-mail, message posting on web forums)discussions (e-mail, message posting on web forums)

Group Problem Solving Group Problem Solving – foster groups with – foster groups with objectivesobjectives within the course structure within the course structure



Applied Methodology


Description

Reasoning

Reflection

Communities of Learning evaluation was based on 8 Communities of Learning evaluation was based on 8 criteria (continued):criteria (continued):

Scheduled EventsScheduled Events – ability to increase student – ability to increase student awareness of group activities on particular topicsawareness of group activities on particular topics

Level of InteractionLevel of Interaction – final result: existence of actual – final result: existence of actual communitiescommunities with activity with activity



Applied Methodology


Description

Reasoning

Reflection

EC defined key topics of learningEC defined key topics of learning

Previous works:Previous works:

• Previous studies within the e-learning field: Previous studies within the e-learning field: LGUIDE – The e-Learning ExpertsLGUIDE – The e-Learning Experts

• Thesis: “A Framework for Comparing Web-Based Thesis: “A Framework for Comparing Web-Based Learning Environments” Learning Environments”

• Various articles and reports from “experts”Various articles and reports from “experts”



Applied Methodology


Description

Reasoning

Reflection

Subjective component to the evaluation, although Subjective component to the evaluation, although limited.limited.

Short list of criteria sources – a need to review the Short list of criteria sources – a need to review the sources utilized with other existing sources – sources utilized with other existing sources – American Society for Training & DevelopmentAmerican Society for Training & Development

Clear need to develop widely accepted criteria to Clear need to develop widely accepted criteria to assess e-Learning practices – DG Education & assess e-Learning practices – DG Education & Culture “eLearning call for Proposals”, September Culture “eLearning call for Proposals”, September 20022002



Applied Methodology

Letter of Interest to about 750 individuals Letter of Interest to about 750 individuals involved/interested in Distance Learning involved/interested in Distance Learning

About 60 responses directly interested in the About 60 responses directly interested in the project findingsproject findings

• SeminarSeminar

• E-mail final reportsE-mail final reports

• Website: spi.pt/innoelearningWebsite: spi.pt/innoelearning

Dissemination ActivitiesDissemination Activities



ContactsContacts

December 2002December 2002Sociedade Portuguesa de InovaçãoSociedade Portuguesa de Inovação

Sociedade Portuguesa de InovaçãoEdf. Les PalacesRua Júlio Dinis, 242 – Sala 208 4050-318 Porto, Portugal

Tel: 351-22-6076400 Fax: 351-22-6099164

E-mail: [email protected]

sociedade portuguesa de inovação information society technologies programme accompanying measures...

Documents

methodology elearning

elearning seminar slide

term elearning

self learning

lifelong learning

sociedade portuguesa

applications of e

internet based learning