mixed methods approach prepared by khalifa mohamed/20144474 salem al-naas/20144401 supervised by dr....

Mixed Methods ApproachPrepared by

Khalifa Mohamed/20144474Salem Al-naas/20144401

Supervised by

Dr. Cise CavusogluELT Department Fall 2014/2015

Out Lines• Names • History of MMR• INTRODUCTION• Definition• Key features• Types of research designs• Qualitative vs. Quantitative research• Pragmatism – Philosophy behind MMR• Purposes of Mixed Methods Research• How methods can be mixed • Why do we use Mixed Methods Research?• When should we use MMR? • Typical situations in which MMR is used• Mixed Method Design • Reference

NAMES• Multimethod research (Campbell & Fiske, 1959)• Integrated/combined research (Steckler et al.,1992;

Creswell, 1994)• “Quantitative & Qualitative Methods” (Fielding & Fielding,

1986)• Hybrids ( Ragin, Nagel & White, 2004 )• Methodological Triangulation (Morse, 1991)• Mixed Methods Research (Tashakkori & Teddlie, 2003,

2010; Cresswell & Plano Clark, 2007; Tedlie & Tashakkori, 2009)

History of MMR

• MM was established from dichotomy between QUAN in QUAL tradition (Teddlie, Tashakkori, 2009)

• MM brings peace between paradigms (post)positivism and constructivism, which have different view on truth and with these different methodological approaches to research (Johnson; Onwuegbuzie, 2004: 14).

• Positivism/ post-positivism, numeric data • Constructivism, narrative data • MM is new dimension, new quality in science • MM is not obligated to any form of research, nor only quantitative

nor qualitative, but includes more different research methods, which selection follows from the purpose of the research (Lobe, 2008)

• Pragmatism, combined data, MM is in “adolescence” stage of developmental (Teddlie; Tashakkori, 2009).

INTRODUCTION • Mixed methods research has developed rapidly in recent

years. Championed by writers such as John Creswell, Abbas Tashakkori, Burke Johnson, Anthony Onwuegbuzie, Jennifer Greene, Charles Teddlie, and David Morgan, the mixed methods approach has emerged in the last decade as a research movement with a recognized name and distinct identity. It has evolved to the point where it is ‘‘increasingly articulated, attached to research practice, and recognized as the third major research approach or research paradigm’’ (Johnson, Onwuegbuzie, & Turner, 2007, p. 112).

Definition

• MMR is a research design with philosophical assumptions (pragmatism) as well as methods of inquiry. As a methodology, it involves philosophical assumptions that guide the direction of the collection and analysis of data and the mixture of qualitative and quantitative approaches in many phases in the research process.

• Its central premise is that the use of quantitative and qualitative approaches in combination provides a better understanding of research problems than either approach alone.

Key features of what is MM about

Three types of research designs

• Qualitative research : exploring and understanding the meaning individuals or groups ascribe to a social or human problem.

• Quantitative research : testing objective theories by examining the relationship among variables.

• Mixed methods research : an approach to inquiry that combines or associates both qualitative and quantitative forms.

Qualitative vs. Quantitative research

Qualitative vs. Quantitative research

Collecting both quantitative and qualitative data

• Quantitative data

– Instruments– Checklists– Records

• Qualitative data– Interviews– Observations– Documents– Audio-visual

materials

Quantitative and qualitative data analysis

• Quantitative analysis

– Use statistical analysis,

– For description– For comparing

groups– For relating

variables

• Qualitative analysis

– Use text and images,– For coding– For theme

development– For relating themes

Pragmatism – Philosophy behind MMR

• Arises out of actions, situations, and consequences rather than antecedent conditions.

• There is a concern with applications—what works—and solutions to problems.

• Instead of focusing on methods, researchers emphasize the research problem and use all approaches available to understand the problem.

Mixing or linking the data

Converge Data Result

Connect Data

Embed the data

Qual Quan

Qual Quan Result

Quan Data Qual Data

Reasons for “mixing”( WHY?)• The insufficient argument – either quantitative or

qualitative may be insufficient by itself.• Multiple angles argument – quantitative and

qualitative approaches provide different “pictures”.• The more-evidence-the-better argument – combined

quantitative and qualitative provides more evidence.• Community of practice argument – mixed methods

may be the preferred approach within a scholarly community.

• Eager-to-learn argument – it is the latest methodology• “Its intuitive” argument – it mirrors “real life”.

Why do we use Mixed Methods Research? • While quantitative and qualitative studies certainly

have a place on their own, mixed methods research can, in certain situations, provide a better view of reality than quantitative or qualitative methods alone. According to Greene, (1989), there are five primary purposes for mixing methods in research.

• Using additional methods can inform the data you have. As an additional consideration, mixing methods can also help your research to transcend the current debate in the research field about the utility of the allegedly competing paradigms.

Purposes of Mixed Methods Research

Triangulation The use of multiple methods concurrently and with equal weight to test the validity of a finding

complementarity The use of multiple methods concurrently and preferably with equal weight to clarify the results of a finding

Expansion The use of multiple methods sequentially or concurrently and with equal or unequal priority/weight to enhance the richness of a finding

Development The use of additional methods sequentially preferably with equal weight to shape future research processes

Initiation The use of multiple methods concurrently and preferably with equal weight to stimulate new questions

How methods can be mixedTypes of mixing Comments

Two types of research question. One fitting a quantitative approach and the other qualitative.

The manner in which the research questions are developed.

Preplanned (quantitative) versus participatory/emergent (qualitative).

Two types of sampling procedure. Probability versus purposive.

Two types of data collection procedures. Surveys (quantitative) versus focus groups (qualitative).

Two types of data analysis. Numerical versus textual (or visual).

Two types of data analysis. Statistical versus thematic.

Two types of conclusions. Objective versus subjective interpretations.

Triangulation• Triangulation is a core purpose of mixed methods.

It is premised on the idea that any single method will yield biased results and that if you can combine and build on the unbiased portions of various methods, you can arrive at information that gets closer to reality. You compare the results of two essentially separate studies, each using a different method whose biases are offset by the other. It is considered “unobtrusive” because it keeps the methods separate, rather than combining them.

It can be classified into four types:

• Data triangulation – using a variety of data sources in a study, which can help offset possible unrepresentative data.

• Methodological Triangulation – using a variety of data collection methods (surveys, interviews, case studies), which can give the researcher richer data.

• Investigator Triangulation – involving multiple researchers in a study, which can help to offset researcher biases in research design.

• Theory Triangulation – applying multiple theoretical perspectives to data, which can yield analyses and approaches that reveal alternative explanations .

When should we use Mixed Method Research?

• Ideally, we would use mixed methods research whenever possible, since it often better captures the richness of the real world than either qualitative or quantitative methods alone. There are of course questions of feasibility.

• Because both methods are being used, there can be greater cost and time requirements. The research may require multiple administrators to complete. Success can also be dependent upon the extent of existing research on the subject.

Advantages Disadvantages

Utilizes the strength of both approaches Requires knowledge in both methods

Provides a more comprehensive view Requires more extensive data collection and resources

Does not limit the data being collected Might lead to collection of an overwhelming amount of data

Typical situations in which mixed methods is used…

• To compare results from quantitative and qualitative research.

• To use qualitative research to help explain quantitative findings.

• To explore using qualitative research and then to generalize findings to a large population using quantitative research.

• To develop an instrument because none are available or useful.

• To augment an experiment with qualitative data.

Mixed methods designs

• Sequential Explanatory Design• Sequential Exploratory Design• Sequential Transformative Design• Concurrent Triangulation Design• Concurrent Embedded Design• Concurrent Transformative Design

Sequential explanatory design

Quantitative Data

Analysis

Qualitative Data Analysis

Qualtitative Data Collection

Interpretation

Qualitative Findings

Quantitative Data

Collection

Quantitative Results

Sequential explanatory design: Characteristics

• Viewing the study as a two-phase project• Collecting quantitative data first followed by

collecting qualitative data second • Typically, a greater emphasis is placed on the

quantitative data in the study• Example: You first conduct a survey and then

follow up with a few individuals who answered positively to the questions through interviews

Sequential explanatory design: When do you use it?

• When you want to explain the quantitative results in more depth with qualitative data (e.g., statistical differences among groups, individuals who scored at extreme levels).

• When you want to identify appropriate participants to study in more depth qualitatively

Sequential explanatory design: Sample script

The purpose of this two-phase, explanatory mixed methods study will be to obtain statistical, quantitative results from a sample and then follow-up with a few individuals to probe or explore those results in more depth. In the first phase, quantitative research questions or hypotheses will address the relationship or comparison of __________ (independent) and ________ (dependent) variables with ___________ (participants) at ___________(the research site). In the second phase, qualitative interviews or observations will be used to problem significant _______(quantitative results) by exploring aspects of the ________ (central phenomenon) with_______ (a few participants) at ____________ (research site).

Sequential exploratory design

Quantitative Data

Analysis

Qualitative Data Analysis

Qualititative Data Collection

Interpretation

Qualitative Findings

Quantitative Data

Collection

Quantitative Results

Sequential exploratory design: Characteristics

• Viewing the study as a two-phase project• Qualitative data collection precedes

quantitative data collection• Typically, greater emphasis is placed on the

qualitative data in the study• Example: You collect qualitative diary entries,

analyze the data for themes, and then develop an instrument based on the themes to measure attitudes on a quantitative survey administered to a large sample

Sequential exploratory design: When do you use it?

• To develop an instrument when one is not available (first explore, then develop instrument)

• To develop a classification or typology for testing

• To identify the most important variables to study quantitatively when these variable are not known

Sequential exploratory design: Sample script

The purpose of this two-phase, exploratory mixed methods study will be to explore participant views with the intent of using this information to develop and test an instrument with a sample from a population. The first phase will be a qualitative exploration of a _______(central phenomenon) by collecting ___________(data) from ____________ (participants) at _______ (research site). Themes from this qualitative data will then be developed into an instrument (or survey) so that the __________ (theory and research questions/hypotheses) can be tested that ________ (relate, compare) ____________ (independent variable) with __________ (dependent variable) for _________(sample of a population) at _________ (research site).

Sequential transformative design

QUAL QUANSocial science theory, qualitative theory, advocacy worldview

QUAN QUAL

Social science theory, qualitative theory, advocacy worldview

Sequential transformative design: Characteristics

• Has two distinct data collection phases• A theoretical perspective is used to guide

the study• Purpose is to use methods that will best

serve the theoretical perspective of the researcher

Concurrent triangulation design

QUANData and Results

QUALData and Results

Interpretation

Concurrent triangulation design: Characteristics

• Collecting both quantitative and qualitative data.• Collecting these data at the same time in the

research procedure.• Analyzing the quantitative and qualitative data

separately.• Comparing or combining the results of the

quantitative and qualitative analysis.• Example: collect survey data (quantitative) and

collect individual interviews (qualitative) and then compare the results.

Concurrent triangulation design: When is it used?

• When you want to combine the advantages of quantitative (trends, large numbers, generalization) with qualitative (detail, small numbers, in-depth).

• When you want to validate your quantitative findings with qualitative data.

• When you want to expand your quantitative findings with some open-ended qualitative data (e.g., survey with closed- and open-ended data).

Concurrent embedded design

Sample script for a concurrent design(Triangulation or nested)

The purpose of this concurrent mixed methods study is to better understand a research problem by converging both quantitative (numeric) and qualitative (text or image) data. In this approach, ___________ (quantitative instruments) will be used to measure the relationship between the ________ (independent variables) and __________ (dependent variables). At the same time in the study, the __________ (central phenomenon) will be explored using _____________ (qualitative interviews, documents, observations, visual materials) with _________ (participants) at ____________ (the research site).

Concurrent transformative design

QUAN + QUAL

Social science theory, qualitative theory, advocacy worldview

QUAN

QUAL

Social science theory, qualitative theory, advocacy worldview

Concurrent transformative design: Characteristics

• Guided by a theoretical perspective.• Concurrent collection of both quantitative and

qualitative data.• The design may have one method embedded in the

other so that diverse participants are given a choice in the change process of an organization.

References

• Creswell, J. W. (2009). Mapping the field of mixed methods research. Journal of Mixed

Methods Research, 3(2), 95-108.• Creswell, J. W. (2009). Research design: Qualitative,

quantitative, and mixed methodsapproaches (3rd ed.). Thousand Oaks, CA: Sage.

• Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed- method evaluation designs. Educational Evaluation and Policy Analysis, 11, 255-274.

• Teddlie, C., & Tashakkori, A. (2009). Foundations of mixed methods research. Thousand Oaks, CA: Sage.

Thank you