an information systems design theory for e-learning

An Information Systems Design Theory for E-Learning

http://flickr.com/photos/mushon/197192003/

David Joneshttp://davidtjones.wordpress.com

http://flickr.com/photos/druclimb/282597447/

Overview

The QuestionThe Hole

The Method

The cycles 1.Build it and they will come2.Build what they want, fast

Reflections, implications & conclusions


Overview


The Method



Ch 2Ch 1

Ch 3

Ch 4&5

Ch 6


Overview


The Method



http://flickr.com/photos/oberazzi/318947873/

How do you design, implement and support an information system that effectively and efficiently supports e-learning within an institution of higher education?

http://flickr.com/photos/themadlolscientist/2543882652/

Theory type Says1. Analysis What is2. Explanation What is, how, when, where3. Prediction What is and what will be4. Explanation & prediction

What is, how, why, when, where and what will be

5. Design and action How to do something

(Gregor, 2006)

Ps Framework

ISDT for e-learning

Gregor & Jones, 2007 ???


There has been little or no theoretically grounded and rigorous research into the structures and processes required to encourage the adoption of e-learning and to facilitate disseminate knowledge at the organisational level

(Alavi & Leidner, 2001)

More models, that demonstrate the transferability and scalability of e-learning, are required

(Salmon, 2005)

http://flickr.com/photos/nnova/2236873782/

2 generations actionresearch 1996-2004

ReflectReflect

PlanPlan

ActAct

WatchWatch

Webfuse

7 publications

27 publications

ISDT

PsFramework

Recognition by senior management

http://flickr.com/photos/dougtone/3009783534/

Great staff adoptionInside Outside

Greater flexibility and resilence

InnovationCustomisation to context

Increased trust


Overview


The Method



A summary

http://www.flickr.com/photos/zamario/338382819/

E-learning orthodoxy

By adopting a single domineering concept of method all our thinking…becomes imprisoned by this one concept…..It limits not only our understanding, but our empirical observations….can cause us to ignore activities that do not fit within a methodical frame

(Truex, Baskerville & Travis, 2000)

http://flickr.com/photos/tonymangan/754511201/

http://flickr.com/photos/rcstanley/30366555/

http://flickr.com/photos/fatmandy/267252461/

http://flickr.com/photos/blakeimeson/2743011812/

http://flickr.com/photos/boskizzi/3241710/

Orthodoxy showing signs of managementfads, fashions and bandwagons

(Birnbaum, 2000; Pratt, 2005)

Home built systems

Blackboard or WebCT

Open source LMS

1995-2000

1999/2000 – 200?

2005-??

(Australia, UK, USA, NZ, Canada)

http://flickr.com/photos/emagic/56206868/

http://flickr.com/photos/nelsonlai/1258727102/

It is realistic to recognize that implementing e-learning is a hugely complex undertaking with multiple contexts and stakeholders—and risks.

(Pittard, 2004)


Management fashion is "relatively transitory collective beliefs, disseminated by the discourse of knowledge entrepreneurs, that a management technique is at the forefront of rational management progress”

(Abrahamson and Fairchild, 2003)

Amplified by hyperbole…, the fashionable vision may exert a strong, if transitory, normative pull among managers.

(Swanson and Ramiller, 2004)

Awareness TestAwareness Test

http://www.youtube.com/watch?v=aYl_yQZq1HY


E-learning orthodoxy



http://flickr.com/photos/toneray/2509037534/

(Mischra and Koehler, 2006)

Having a framework goes beyond merely identifying problems with current approaches; it offers new ways of looking at and perceiving phenomena and offers information on which to base sound, pragmatic decision making.

Theory for understanding(Gregor, 2006)

http://flickr.com/photos/joits/225824796/

The Ps Framework

A decision/sense making to aid understanding ofinstitutional implementation of e-learning

(Jones, 2008; Jones, Vallack & Fitzgerald-Hood, 2008)


Past experience People

Place

Product Process

Purpose

Pedagogy

PlacePlacePedagogyPedagogy

ProcessProcess

PurposePurposeProductProduct

PastPastExperienceExperience

PeoplePeople



Use the Ps Framework

To highlight the moon-walking bear

To understand


ProcessProcess



PeoplePeople



Most HEIs are struggling to engage a significant percentage of students and staff in e-learning

(Salmon, 2005)

There remain concerns about the quality of the learning and teaching and about the return on the investment in e-learning

(Bates, 2009)


…not particularly innovative, may limit the incentive to innovate, limited in quality and may restrict the ability to integrate with other systems

(Alexander, 2001; Anonymous, 2004; Paulsen, 2002

http://flickr.com/photos/drift-words/11846265/

Surprise has been expressed at how quickly university learning and teaching…has been modified to incorporate the use of learning management systems

(West, Waddoups, Graham, 2006)

almost universal adoption of just two different commercial LMSs by the Australian higher education sector

(Coates, James & Baldwin, 2005)

http://flickr.com/photos/digital_freak/183688774/


Orthodoxy showing signs of managementfads, fashions and bandwagons

(Birnbaum, 2000; Pratt, 2005)

Home built systems

Blackboard or WebCT

Open source LMS

1995-2000

1999/2000 – 200?

2005-??


ProcessProcess



PeoplePeople


As of 2005 almost every higher education institution is planning to make use of an LMS

(Salmon, 2005)

http://flickr.com/photos/cloud_nine/15354825/


LMS are based on an overly simplistic understanding of the relationship between teachers, knowledge and student learning.

(Coates, James, Baldwin, 2005)


No LMS supports student critical thinking, generation of knowledge and collaborative teamwork

(Bonk & Dennen, 1999)


Tools are never value-neutral but arereplete with values and potentialitieswhich may cause unexpected responses

(Westera, 2004)

LMS design embeds particular world views(Dron, 2006)

Some LMS values

Based on USA higher educationCourse Instructors

Course offering-based

Closed from outside world

Web-based

Integrated enterprise system

Only handle courses with 999 or less students

http://flickr.com/photos/wildlifebiologyguy/3085729458/

Based on scarcity – must provide all


most commercial systems require the institution to modify its existing practices to accommodate the system

(Dodds, 2007)

we should change people's behaviour because information technology systems are difficult to change..

(Sturgess and Nouwens, 2004)

http://flickr.com/photos/elycefeliz/3211943653/


ProcessProcess



PeoplePeople



Remember this quote?




It’s about software development methods



There are alternatives

http://flickr.com/photos/extraketchup/459020985/

Developer-based methods

Assume adopters will see benefits ofnew systems and use them

(Jones and Lynch, 1999)





Build it and they will come





The new product will automatically replace inferior products or systems

(Surry and Farquhar, 1997)







The new product will automatically replace inferior products or systems

(Surry and Farquhar, 1997)

Product focus

http://flickr.com/photos/genemoo/2498690521/

Teleological design process

Attributes TeleologicalUltimate purpose Goal/purposeIntermediate goals EfficiencyDesign focus ResultsDesigners Explicit designerScope PartProcess Problem solvingProblems Complexity/conflictManagement CentralisedControl Master plan

(Introna, 1996)


Teleological-based design(Introna, 1996)

To be teleological is to set and achieve objectives, it is to be purpose driven…

Setting goals and achieving them is the essence of "success" in the teleological society





Strategic planning





Strategic planning

Mission statements





Strategic planning

Mission statements

Quality assurance




Strategic planning

Mission statements

Quality assurance

Information systems developmentand governance


Time

CostAnalysis & Design

Maintenance

Replacement

Big up front design (BUFD)

(Truex, Baskerville and Klein, 1999)

http://flickr.com/photos/i-marco/244541946/

Foundations

based on the idea of modernism where human rationality and methods of inquiry can achieve their ultimate purpose of discovering and identifying universal truths

(Baskerville, Travis & Truex, 1992)

http://flickr.com/photos/michaelsarver/23033010/

Foundations

Assumes the aim is to develop stable systemswith primary goals of low maintenance andlong life spans



Foundations




Podcasts

Foundations




Podcasts

Blogs and Wikis

Foundations




Podcasts

Blogs and WikisSecond Life

http://flickr.com/photos/vernhart/1422048648/

Alternatives?


AttributesAttributes TeleologicalTeleological AteleologicalAteleologicalUltimate purpose Goal/purpose HarmonyIntermediate goals Efficiency HomeostasisDesign focus Results Means/processDesigners Explicit designer ParticipantScope Part WholeProcess Problem solving Local adaptationProblems Complexity/conflict TimeManagement Centralised DecentralisedControl Master plan Rules/regulators

(Introna, 1996)


PushPush PullPullDemand anticipated Demand uncertainTop-down design Emergent designCentralised control Decentralised controlProcedural ModularTightly coupled Loosely coupledResource centric People centricRestricted participation Open participationFocus on efficiency Focus on innovationFew major re-engineering efforts Rapid, incremental innovationZero-sum rewards Positive-sum rewards

(Seely Brown & Hagel, 2005)


IdealisticIdealistic NaturalisticNaturalistic

Achieve ideal state Understand a sufficient of present to stimulate evolution

Privilege expert knowledge, analysis and interpretation

Favour enabling emergent meaning at the ground level

Separate diagnosis from intervention

Diagnosis and intervention intertwined with practice

(Kurtz & Snowden, 2007)


Overview


The Method



A summary

Mismatchhttp://flickr.com/photos/danielkongos/2790446307/

http://flickr.com/photos/danielkongos/2790446307/

E-learning Orthodoxy

Product

E-learning Reality

Process

People are not rational

Massive change

It is a wicked problem

……

Universities aren’t a business

Academics are knowledge workers

Place

Purpose

Pedagogy

Past Experience

People

http://flickr.com/photos/danielkongos/2790446307/

The emphasis on rationality, linearity and clarity of purpose embodied within planned change models means that they are unlikely to be successful within higher education

……

(Kezar, 2001)

Place

The Technology Alliance

http://flickr.com/photos/cote/36400135/

(Geoghegan, 1994)

http://flickr.com/photos/autanex/808866285/http://flickr.com/photos/autanex/808866285/

How does the mind work?How does the mind work?

http://www.cognitive-edge.com/blogs/dave/2008/05/a_keynote_in_perth.phphttp://www.cognitive-edge.com/blogs/dave/2008/05/a_keynote_in_perth.php

People


ProcessProcess



PeoplePeople



Use the Ps Framework

To highlight the moon-walking bear

To understand


Overview


The Method



http://flickr.com/photos/victornuno/467298464/

Research aims to generate knowledge

Expressed as theory


(Gregor, 2006)

Type Question ExamplesI. Analysis What is? Taxonomies (e.g. Bloom's),

frameworks

II. Explanation How & Why? Structurational model of technology (Orlikowski 1992)

III. Prediction What will be? Org size predicting innovativeness, Moore's Law

IV. Explanation & Prediction

What is, how, why and what will be?

Most traditional view of theory, General system theory, TAM

V. Design & Action

How to do it? Codd's theory of relational database design

Questions about knowledge

Domain

http://flickr.com/photos/thomashawk/310965213/

Structural/ontological

Epistemological Socio-political

(Gregor, 2006)


Domain




(Gregor, 2006)

Is it interesting to information systems?

What are the boundaries?


Domain




(Gregor, 2006)

Scholars in Information Systems can offer vision on structures and processes to effectively implement technology-mediated learning initiatives

(Alavi & Leidner, 2001)


Domain




(Gregor, 2006)

What is theory?

How is theory expressed?

What is a contribution to knowledge?


(Gregor, 2006)

Type Question ExamplesI. Analysis What is? Taxonomies (e.g. Bloom's),

frameworks

II. Explanation How & Why? Structurational model of technology (Orlikowski 1992)

III. Prediction What will be? Org size predicting innovativeness, Moore's Law

IV. Explanation & Prediction

What is, how, why and what will be?

Most traditional view of theory, General system theory, TAM

V. Design & Action

How to do it? Codd's theory of relational database design

What is theory?

Kernel TheoriesKernel Theories

Meta-Requirements

Meta-Requirements

Meta-DesignMeta-Design

DesignMethodDesign

Method

Testable design productand process hypothesesTestable design productand process hypotheses

(Walls, Widmeyer, El Sawy, 1992)

How is theory expressed? http://flickr.com/photos/dullhunk/380814854/

Empirical plane

Theory plane

ArtifactArtifact

Artifact

Artifact

Artifact

Artifact

Theoryscope

Principles of form/constructs

Justificatory knowledge

Principles ofgeneration

If X has property Z then QIf Y has property Y then P

Instantiation

Artifactmutability

Artifact

Artifact

Artifact

ArtifactArtifactTestable hypotheses

(Lyytinen, 2008)http://flickr.com/photos/wallyg/438188176/


Domain




(Gregor, 2006)

What is a contribution to knowledge?

Design-science research guidelines

(Hevner et al, 2004)

Design as artifactProblem relevance

Research contributions Design evaluation

Research rigor Design as a search process

Communication of researchhttp://flickr.com/photos/ross/63787005/

Principles for theory building (Gregor, 2008)

Artifact centralityArtifact purposefulness

Artifacts are systems Design research variants

Differing logics Types of theory

Mid-range theorizingInterior and exterior modes

http://flickr.com/photos/moonwire/830986515/


Domain




(Gregor, 2006)

How is theory constructed?

http://flickr.com/photos/nnova/2236873782/

2 generations actionresearch 1996-2008

ReflectReflect

PlanPlan

ActAct

WatchWatch

Webfuse

7 publications

27 publications

ISDT

PsFramework

Design research and action research are“historically, practically, ontologically, epistemologically and methodologicallyquite different”

(Iivari, 2007)

http://flickr.com/photos/jacksonboyle/516196211/

http://flickr.com/photos/zhushman/3040818512/

Design research != Design theory


Domain




(Gregor, 2006)

Is there agreement?

Are there ethical issues?

http://flickr.com/photos/zhushman/3040818512/

Design research != Design theory

Socio-political and design research

Emphasis on utility(Cole, Purao, Rossi & Sein, 2005)

Increase relevance

(Hevner, March, Park and Ram, 2004)

http://flickr.com/photos/broken_simulacra/95706899/

Role of theory and artifact

Is it a paradigm?Is it CS or IS? Yes

(Hevner, et al, 2004)

Lack of consensus on objectives and outputs of design research

(Vaishnavi and Kuechleer, 2004)

Is it consulting? (Gregor, 2008)

(Venable, 2006)

Role of kernel theory(Iivari, 2007)

http://flickr.com/photos/stephenliveshere/483840217/

Is it core?

It is absolutely clear that design science research cannot be (value-free)

(Iivari, 2007)

Means-end oriented

InterpretiveCritical

http://flickr.com/photos/wonderlane/2090966628/

http://flickr.com/photos/wonderlane/2090966628/

It is absolutely clear that design science research cannot be (value-free)

(Iivari, 2007)

Means-end oriented

InterpretiveCritical

achieve a rich understanding of how an IT artifactis really appropriated and used and what its effects are, without confining the focus on the given ends of its initial construction


Overview


The Method



Period Title Description1996 to now


System based on hypermedia templates

1999 to 2004

Give them a reason to come

Diffusion theory, design patterns for requirements

2000 to 2004

Build what they want, faster

Agile development, design patterns for architecture

(Jones and Gregor, 2004)

Action Research Cycles

http://flickr.com/photos/garon/2238688001/

http://flickr.com/photos/garon/2238688001/

Period Title Description1996 to now


System based on hypermedia templates

1999 to 2004

Build what they want, fast

Diffusion theory, design patterns, agile development

(Jones and Gregor, 2004)

Action Research Cycles

By early 199960 full-time staff users

Total staff???

Only 5 made significant use

1998/99 49% of content requests for 2 courses (1 staff member)

T1, 1998 83% of content was for 1 course

425 teaching staff employed by Infocom (2001-2004)

353 (83%)used system

And 445 fromoutside Infocom

http://flickr.com/photos/maktownkid/2199965525/

I identify myself as coming from the technophobic extreme of the faculties (I have an Arts background) but even I find the systems the team have set out relatively easy to use

..the precedent of other IT systems made available in Infocom (…) suggests that it would be extremely user friendly for people with very limited computer competence/confidence.

(Behrens, Jamieson, Jones and Cranston, 2005)

(Jones, Cranston, Behrens and Jamieson, 2004)

The key to easy use of OASIS is that it is not a off the shelf product that is sooooo generic that it has lost its way as a course delivery tool.

the best thing about teaching and learning in this faculty in 2003 would be the development of technologically progressive academic information systems

that provide better service to our students and staff and make our teaching more effective. Webfuse and MyInfocom development has greatly assisted staff to cope with the complexities of delivering courses across a large multi-site operation.

(CQU, 2004, p21)


Overview


The Method




How do you design, implement and support an information system that effectively and efficiently supports e-learning within an institution of higher education?

Hypermedia templates, software wrappers, COTS, OO & design patterns

Hypermedia templates, software wrappers, COTS, OO & design patterns

http://flickr.com/photos/dullhunk/380814854/

Distance education and e-learning literature – Ps Framework

Distance education and e-learning literature – Ps Framework

Diffusion theory, design patterns, agile and ateleological dev.

Diffusion theory, design patterns, agile and ateleological dev.

Non func: variety, change, integration.Fun: info dist, communication….

Non func: variety, change, integration.Fun: info dist, communication….

Adopter-focused dev; pattern mining, XP

Adopter-focused dev; pattern mining, XP

Kernel theories

Meta-requirements

Designmethod

Hypermedia tmpl, platform indep, open source, design patterns

Hypermedia tmpl, platform indep, open source, design patterns

Possible to construct a system using templates as COTS/wrappers. Instantiations will be more flexible, open and customizable. Instantiations will be more acceptable leading to greater adoption. Instantiations will become specific to needs of host organisation

Possible to construct a system using templates as COTS/wrappers. Instantiations will be more flexible, open and customizable. Instantiations will be more acceptable leading to greater adoption. Instantiations will become specific to needs of host organisation

Meta-design

Hypotheses

Recognition by senior management

http://flickr.com/photos/dougtone/3009783534/

Great staff adoptionInside Outside

Greater flexibility and resilence

InnovationCustomisation to context

Increased trust

E-learning

Ps Framework

Pre-evaluating innovations(Jones, Jamieson & Clark, 2003)

(Jones, 2008; Jones et al, 2008; Jones et al, 2005; Jones et al, 2007)

ISDT

IS PracticeScarcity and Abudance

IS ResearchAnatomy of Design Theory

(Gregor and Jones, 2007)DT, practice and learning

Innovations(Jones, 2002; Jones, 2006)

Shadow systems(Jones, Behrens, Jamieson, Tansley, 2004)

(Jones & Behrens, 2003)

Practice, understandingof ISDT versus ISDR

http://flickr.com/photos/voxtheory/2192019057/

ISDT

Web App design(Jones & Lynch, 1999)

http://flickr.com/photos/sineout/2491569707/

Action researchImpartiality of researcher Lack of discipline

Consulting? Context-dependency

(Nielsen, 2007)

E-learningNot sufficient learning emphasis

http://flickr.com/photos/dullhunk/202872717/http://flickr.com/photos/dullhunk/202872717/

an information systems design theory for e-learning

Education

elearning http

senior management http

awareness test http

elearning orthodoxy

learning jones

elearning gregor jones

thatimplementing elearning

adoptionof elearning