PSY202

PSY202 Advanced Qualitative Research and Mixed-Methods ResearchLecture 11: Proposal Templates; Sampling and Analyses in Mixed-Methods Research

Lecture OverviewReadings: Creswell & Clark Ch. 3 and 6Creswell, J.W., Shope, R., Plano Clark, V.L. & Green, D.O. (2006). How interpretive qualitative research extends mixed methods research. Research in Schools, 13, 1-11.Onweugbuzie, A.J. & Collins, K.M.T. (2007). A typology of mixed methods sampling designs in social science research. The Qualitative Report, 12, 281-316.Onweugbuzie, A.J. & Leech, N.L. (2004). Enhancing the interpretation of significant findings: The role of mixed-methods research. The Qualitative Report, 9, 770-792.

Framing your mixed-methods study how you write and present a mixed-methods study sets the stage for your proposal.Title, phrasing, presentation and write-up of mixed-methods research proposals different from that of single-method approaches.Sampling and analyses for your studies.

Titles, Research Questions, Hypotheses / Qualitative Interview QuestionsBroad Specific Be careful not to confuse all of these this problem is widespread at the thesis level as well (especially confusing research questions with hypotheses)Example Quantitative and Qualitative TitlesSelf-esteem, academic performance, parental supportHigh school studentsMalaysian public schoolRelationship, interaction (moderating effect)A study of the relationship between Malaysian high school students self-esteem and academic performance: The moderating role of parental support. Example Quantitative and Qualitative TitlesRefugee experiences Vietnamese refugeesRefugee camp in MalaysiaPhenomenologyA phenomenological study of the lived experiences of Vietnamese refugees in a Malaysian refugee camp.Good Mixed Methods TitlesMixed-Method TitlesShort and succinctIncludes major topic, participants and site Include the term mixed methodsNeutral (neither too quantitative or too qualitative)

CliniciansPrivate hospital, MalaysiaExperiences of stress / burnoutMixed-methods / multimethod / qualitative and quantitativeA mixed-methods study of the experiences of stress and burnout in clinicians from a Malaysian private hospitalDescribing a Design in a Written ReportIt is important that in your introduction/overview (see Assignment 2 marking scheme) that you clearly highlight your mixed-methods design.

Include in the introduction/overview:The type of mixed methods design.Defining characteristics of this design.The rationale for using the design.Important! Justify, justify, justify!

References on the design from the mixed methods literature.See references posted up on eLearning.

Mixed Methods Purpose StatementMixed-methods Purpose StatementsThe overall intent of the studyType of design and its definitionSpecific qualitative and quantitative purpose statementsThe reason for collecting both forms of data.

The overview explains the design of the mixed-methods study, justifies it well, and explains why it is the optimal approach to answering research compared with single-method approaches.8Example Purpose Statement ScriptThis mixed methods study will address [overall content aim]. A [mixed-methods design] mixed methods design will be used, and it is a type of design in which the collection and analysis of [qualitative/quantitative] data is conducted before the collection and analysis of the [quantitative/qualitative] data before they are then merged.

If sequential exploratory: In this study, [qualitative data] will be used to first [purpose of qualitative study]. This will involve [participants, site, method] The second quantitative study will be used to [purpose of quantitative study]. This will involve [participants, site, method].The intentThe designThe qualitative purpose statement, detailsThe quantitative purpose statement, details9Framing the Overview: A TemplateDesignA Need Exists in the Research toExplanatory not only obtain quantitative results, but to explain such results in more detail to accommodate for the subjective differences in the topic area of interest and thus add to a more holistic, nuanced understanding of the phenomena of interest.Exploratory explore a topic because variables are unknown and to (later) assess the extent to which such exploratory results generalize to a wider population / to statistically validate the implied relationships/associations between concepts from the qualitative study. Quantitative Study: Example Quantitative Purpose StatementQuantitative Purpose StatementsVariablesParticipants Research siteQuantitative methodWords that connect variablesDirectional language

The central research question for this quantitative study is to

Examine the relationship between student self-esteem and academic performance in a Malaysian school.

Investigate whether parental support impacts the effects of student self-esteem on their academic performance in a Malaysian school.

If phrased as a question, it might sound like: What is the relationship between student self-esteem and their academic performance?

Qualitative Study: Example Qualitative Purpose StatementQualitative Purpose StatementsCentral phenomenonParticipantsResearch siteQualitative designAction verbsNondirectional stance

The central research question for this qualitative study is to

Explore/understand the lived experiences of Vietnamese refugees living in a refugee camp in Malaysia.

If phrased as a question, it might sound like: How do Vietnamesee refugees experience and make sense of, their lives as refugees in a Malaysian refugee camp?

Try it Now: Write Your Overview Using the Template and Suggestions ProvidedThis mixed methods study will address [overall content aim]. A [sequential exploratory] mixed methods design will be used, and it is a type of design in which the collection and analysis of qualitative precedes the collection and analysis of quantitative data before they are then merged. In this study, [qualitative data] will be used to first [purpose of qualitative study]. This will involve [participants, site, method]. The second quantitative study will be used to [purpose of quantitative study]. This will involve [participants, site, method].Quantitative Study: HypothesesState clearly and explicitly the relationship between your variables.Be specific explain how one variable is related to the other.Use statistical terms such as:Difference between one group and anotherPositively / negatively correlatedPositive / negative relationshipMediateModerate

Too general: There is a relationship between self-esteem and academic achievement.Better: There is a positive relationship between self-esteem and academic achievement (as measured through students CGPA)Quantitative HypothesesRelate variables in a specific, detailed manner.Make predictions when warranted by the literature.Include references to nature of relationships in statistical terms. Qualitative Study: Interview Questions Refer to notes on structuring effective interview/focus-group questions.Questions to ask, questions to avoid.

Questions should be as open-ended as possible, aimed at allowing respondents to give broad descriptions of an experience.

Too specific/quantitative: How does living as a refugee affect your relationship with your family?

Better: Tell me about your experiences as a refugee here in Malaysia; Tell me about your familys experiences here in Malaysia.

Qualitative Research QuestionsInterview and focus-group questionsOpen-endedBegin with what and howFocus on a single concept (i.e. singular focus)Important: For Sequential Exploratory DesignsRemember for sequential exploratory designs (qual-quant), you may not have hypotheses before you conduct and analyze your qualitative data.

If this is the case, then broadly suggest that:

The hypotheses for the quantitative study will be based on /derived from the analysis of the qualitative data. Categories/themes from the analysis will be used to construct hypotheses in the quantitative study.You can provide some (justified and reasonable) expectations of what categories/themes may emerge from your qualitative study. These categories/themes may subsequently be measurable variables in the quantitative study.

Mixing and MergingThe challenge with this assignment is to be able to propose both quantitative and qualitative studies that draw on the strengths of both approaches, but at the same time, merging them in a complementary program of research.

Explanatory In what way does the qualitative data help in explaining the quantitative results?

Exploratory In what way does the quantitative data help in generalizing the qualitative results?

Mixed Methods Research Questions and Justifications Can Be Written In Different WaysBreak

Sampling Procedures: QuantitativeAim is to enhance the representativeness (either statistical or analytical) of the research question from the sample.

Simple Random, Stratified Random, Cluster, Systematic Random (every kth participant).

Recruitment may involve attaining gatekeeper permissions.

20Sampling Procedures: QualitativeAim is to enhance the representativeness (analytical) of the research question from the sample.

Purposeful, convenience, intensity (esp. for phenomenology), extreme cases.

Qualitative Data CollectionIdentify the site(s).Identify the participants.Select a small sample.Identify the purposeful sampling strategy and why it was chosen.Discuss recruitment strategies.

A Recommendation for Sample Size RecommendationsResearch DesignMinimum Sample SuggestionReferenceCorrelational64 participants for one-tailed hypotheses; 82 for two-tailed hypothesesOnweugbuzie et al., 2004Experimental21 participants per group for one-tailed hypothesesOnweugbuzie, et al., 2004Case Study3-5 participantsCreswell, 2002Phenomenology 10 interviews, 6 interviews Creswell, 1998; Morse, 1994Grounded Theory20-30Creswell, 2007Interview12 participants; 20 for approaching saturation. Guest, Bunce & Johnson, 2006; Alexandersson, 1994Focus-Group6-12 participants; 3-6 focus groupsVarious sourcesSampling Considerations: Sequential Explanatory (Quant-Qual) DesignsDecision ConsiderationsRecommendationsIndividuals in SamplesInclude individuals from the Quant study in the Qual Study (Qual participants can be a subset of the earlier quant study)Which Quant results to follow up?Significant/non-significant results; outliers and deviant cases.QuantQualWriting Up the Sampling Strategies in a Mixed-Methods StudyIf you are planning to conduct a sequential explanatory (Quant-qual) mixed-methods study

What do you expect to uncover from the quant study?Because you have hypotheses, you can more freely expect the pattern of results to go a certain way.Who will your sample be? Are you expecting to generalize statistically or analytically from your sample?Who will participate in your follow-up qualitative study? How will you recruit them?Sampling Considerations: Sequential Exploratory (Qual-Quant) DesignsDecision ConsiderationsRecommendationsIndividuals in SamplesLarge sample of different individuals. Quant participants may not necessarily be from the qual study.Which Qual results to follow up?Use themes, codes, and quotes to help design instrument or taxonomy.QuantQual25Writing Up the Sampling Strategies in a Mixed-Methods Study: Sequential ExplanatoryIf you are planning to conduct a sequential exploratory (Qual-quant) mixed-methods study

What do you intend to do with the results from your qualitative study?Can the categories and themes you uncover from the quantitative study be approximated to an established psychological construct?Who will participate in your follow-up quantitative study? How will you recruit them?A follow-up quant study may not necessarily use a random sample.

Collecting Information in Quantitative and Qualitative Studies: Instruments and ProceduresWriting Up Quantitative Data AnalysisGiven the [nature of data, way in which data was measured], the data will be measured by a series of [statistical test]. This is because [justification]. The data will first be [data screening/cleaning approaches].

To test the hypotheses, a series of [statistical test(s)] will be conducted. The reason is because [justification].Writing Up Qualitative Data AnalysisData from the [qualitative method] will be analyzed using [data analysis method]. This method involves [explanation]. Data analysis will be conducted during and after the data collection phases. This is because [justification]. To guard against researcher bias, certain approaches will be taken to ensure the validity and reliability of the qualitative data. These include [steps].Validating the Data and Results30Discussion Get into your tutorial groups, and use this time to ask any final questions you may have about your mixed-methods proposals. Please group yourselves together with your respective tutors.

Next Week: No lecture. However, I will be in class as usual for a final review/discussion with anyone needing further help with their mixed-methods assignment.

Next Next week: Three minute research proposal competition.Sign up now if you wish to take part 1st place 5 bonus marks2nd place 3 bonus marks3rd place 2 bonus marksParticipation 1 bonus mark