research design methodology part 1. objectives qualitative quantitative experimental designs ...
TRANSCRIPT
Research DesignMethodology Part 1
Objectives
Qualitative
Quantitative
Experimental designs Experimental Quasi-experimental Non-experimental
Research Design
Plan for selecting subjects, research sites, and data collection procedures to answer research questions
Credibility Extent to which results approximate reality, are accurate &
trustworthy Reduced error
Research Design
Quantitative
Experimental
Quasi-Experimenta
l
Non-Experimenta
l
Descriptive Comparative Correlational
Qualitative Mixed Methods
Qualitative Design
Research where results are given in words
In depth understanding
Data collection Observations Interviews (open ended questions) Documents
Identify patterns
Study behavior in the natural environment
Multiple realities, subjective
Example….
Quantitative Design
Research where results are given in numbers
Specifically designed instruments & statistics
Objectivity is critical
Use data from a sample to generalize to larger population
Look for: cause & effect relationships describe, predict variables
Articles??
Experimental Design
Researcher manipulates what the subject(s) will experience give treatments and observe/measure to see if
they cause changes in behavior
Manipulate independent variables & measure dependent variables
True experimental design has randomly assigned treatment groups Only difference in groups is due to chance
Experimental Designs
Notations: Post test only
R T O1
Pre-test/post test R O1 T O2
R O3 O4
Experimental groupR
Control groupR
Pre-testO1
Pre-testO3
TreatmentT
Post-testO2
Post-testO4
R= RandomN= Non-randomO= Test/measurementT = Treatment
Both groups measured at the
same time
Both groups measured at the
same time
Experimental Designs
Strengths: Random selection into groups…reduces error Best approach for determining cause-and-effect relationships
among variables High degree of control of extraneous variables Power of manipulation of variables
Weakness/limitation: Experiments typically occur in laboratories Difficult to replicate the “real world”
Quasi-Experimental Designs
Nonequivalent , non-random groups Pretest-Posttest Design
NA O1 T O2
NB O3 O4
Uses intact already established groups of subjects IWU/ISU basketball Classes
Selection can be a major problem if one group scores higher than the other because of a factor
Activity
A researcher wants to test the effectiveness of 3 methods of teaching a dance to a group of 5th graders. A local PE teacher allows use of 3 of her classes. The researcher administers a pretest to all students, each class receives a different method of teaching for two weeks, and then all students get a posttest.
What type of design is it? Experimental or quasi-experimental?
Write out a design notation
Non-Experimental Designs
Researchers measure subjects in order to describe them as they naturally exist without experimental intervention
Don’t control/manipulate the environment
Non-Experimental Designs
Types of non-experimental Design
Descriptive
Comparative
Correlational
Relationships…when one variable varies systematically to another variable
Non-Experimental Designs
DescriptiveSummarize the current or past status of
something
Describe attitudes, behaviors, characteristics
Example What are the leadership styles of Athletic
Directors/Principals/Nonprofit CEOs Attitudes of students towards campus rec/athletics
Non-Experimental Designs
Descriptive – 2 types
Longitudinal (over time) Same cohort/group Weaknesses: Subject attrition, time
Cross sectional (across groups) Different groups of subjects over time
20-25; 30-35; 40-45; 46+ Weaknesses: Selection differences, time
Longitudinal Alumni survey* Survey same alumni every 5 years
Cross Sectional Alumni survey* Survey alumni who have been out 5, 10, 15 & 20 years one time.
Non-Experimental Designs
Comparative
Differences between 2+ groups
Value of the DV in 1 group is different than the value of the DV in the other group.
Public schools vs. private schools D1 vs. D3
Other examples…
Non-Experimental Designs
Is there a difference…….
in donations to athletic departments between public & private institutions?
in attitudes towards fitness between recreational volleyball players, baseball players, & softball players?
in fitness levels between youth who participate in structured and unstructured recess?
Non-Experimental Designs
Comparative
Difference or similarity conclusions can be made.
Causal conclusions can not be made.
Non-Experimental Designs
Correlational Relationships (correlational analysis)
Gender & management style
Predictions (regression analysis) Grad admissions criteria
Predictor variable – Undergrad GPA Criterion variable – Grad GPA, GRE score
March Madness success Predictor variables??
Non-Experimental Designs
Correlational
Correlation & Causation: never infer causation from correlation
High relationship does not mean one variable causes another
May be unmeasured variables affecting the relationship
Examples…
Non-Experimental Designs
CorrelationalMeasuring the relationship between variablesCorrelation can be measured statistically
Pearson’s correlation coefficient (r) Correlation coefficient (r) can range from –1 to 0 to 1
Further from 0 = stronger relationship -1/1 is a perfect negative/positive relationship 0 means no relationship
Mixed Methods Designs
Utilize both qualitative & quantitative methods to triangulate research results
Sequential mixed methods Begins with 1 methodology then uses the other to
elaborate or expand findings Delphi Study
Concurrent mixed methods Use both methodologies at the same time &
merge findings
Triangulation: reach the same conclusion using multiple methods