mis 650: research frameworks1 role of frameworks, role of models, types of model, research criteria...

MIS 650: Research Frameworks 1

Role of Frameworks, Role of Models, Types of Model, Research Criteria

MIS 650Research Frameworks and Models


Basic Definitions

Framework Model Variable/Surrogate/Proxy Concept/Construct


Framework

• A FRAMEWORK is a matrix within which research efforts can be classified

• The dimensions of the framework are limitless, but often include roles, effects, technology, users, etc.

• Frameworks are informal, cannot be “proven” and are used to compare or situate papers and ideas


A Framework is a pair of intellectual spectacles to see with and a set of cubbyholes to display what you want to see.

Yaddayadda yadda Ya dadad yadad

Aw

op b

opal

umbo

p A


Uses of Research Frameworks

Classification of phenomena Comparison of phenomena Generation of research questions Creation of research models Evaluation of field efforts


Model

• A simplification of some aspect of reality

• Simplification occurs through– Lumping (Categorization)– Elimination

• Models contain elements with relations among those elements. These reflect relationships among elements of the base reality


Hierarchy of Theoretical Entities and Relationships

Theory

Concept

Con-struct

Proxy/Surrogate

Variable

Data

A b

s t

r a

c t

i o

n


Concept

• Conceive [ME conceiven < OFr conceveir < L concipere to take in, receive < com together + capere to take]

• An idea or thought, esp. a generalized idea of a thing or class of things; abstract notion.

• Concepts serve both to sum up (generalize) thoughts as well as organize and relate them. Concepts are “sophisticated” forms of experience.


Construct

• Construct [<L constructus < com together + struere to pile up, build rel. to “strew”]

• Something put together systematically

• An idea or perception resulting from a synthesis of sense impressions, etc.

• A concept or theory devised to integrate in an orderly way the diverse data on a phenomenon.


Variable/Surrogate/Proxy

• A variable is a theoretical concept (actually construct) that varies in value; part of a theory.

• A surrogate or proxy for that variable is a measurement taken in the real world of that variable; part of testing or using a theory.

• All proxies present problems of validity, reliability and pragmatic measurement difficulties


Models: Level of Explanation

Depictional: depicts or reproduces aspects of the modeled system

Descriptive: describes in translated termsthe modeled system

Classificational: groups phenomena withinthe modeled system together

Logical: Asserts logical dependencies amongelements of the modeled system

Causal: asserts that some phenomena in themodeled system cause other phenomena

Physical: makes things happen in themodeled system

Atheoretical


Types of Models: Causal / Associational

IV DV

EV

a

b

EV1CV

Direct Cause: IV-DVIndirect Cause: IV-EV-DVCommon Cause: EV-(IV,DV)Effectiveness: a/(a+b)Loss: cEfficiency: CV-IV-DV

c

IV is sufficient to cause change to DV of strength a

d

EV is sufficient to cause change to both IV and DV of strengths r(d,b)


Types of Models: Process

DV

IV2 IV4 IV6

IV1 IV3 IV5 Each IV is necessary at a certain level of strength b to allow change to DV of strength a

ab1

b2

b3

b4

b5

b6


Types of Models: Multidomain Modeling

DOMAIN 1Sources - Industry characteristics-

DOMAIN 2Industry Experience/Action -

Outcomes for Industry

DOMAIN 3Statements / Interpretations


Types of Models: Rationalising

Description of the use of a model: Description of a phenomenon: for whom Prediction of a phenomenon: for when Control of a phenomenon: why, how much Operation of a phenomenon: ?


Types of Models: Contingency

X Y

X Y

a

b

XY

X

In different regions, X and Y have different relationships at different strengths. A region may or may not be describable in terms of a set of variables itself


Types of Models: Classificational

The phenomena within a region or system are “arbitrarily” classified as being similar and dissimilar based on a scheme of controlling variables (A, B) which are in turn justified theoretically (in terms of another theory)

A

B


Types of Models: Time Series

Baseline

0 1 2 3 4 5 6 7 8 9 10

Cri

teri

on V

alue

(s)

Important times (in series)

Treatments across time allow changes in (a) criterion value(s). There is no control group; the treatment effectiveness is compared to non-treatment effectiveness.


Types of Models:Evaluation

Evaluative Environment

Action Domain

- hkhjhjk

- hkjhjh

- ghgj

- gjhgh


Types of Models: Layered

Level 1

Level 2

Level 3


Research Criteria

• Are the results meaningful?*– Validity

• Are the results trustworthy?– Reliability– Significance


Validity

• Stuff

`

These elements have no counterpart in reality

These elements have no counterpart in the model

This relationship is not mirrored in the model

This relationship has no correspondence in reality


Threats to Validity

• History• Testing• Instrumentation• Mortality• Maturation• Ambiguity about causal direction• Generalisability• “Measuring the wrong thing”


Types of Research Errors

Type I:

Type II:

Type III:

“Seeing something that isn’t there”; in general, someone else will disprove you

“Not seeing something that is there”; waste of time and effort; puts a chill on creativity

“Not looking in the right place”; severe methodological problems or sampling or theoretical problems

mis 650: research frameworks1 role of frameworks, role of models, types of model, research criteria...

Documents

research criteria mis

research efforts

research frameworks5

research frameworks4

research frameworks3

research frameworks6

research frameworks8

base reality slide