introduction theory verification hypotheses data presentation of
DESCRIPTION
Common Sense vs. Science Procedures CS: Quick acceptance of explanations S: Slow and deliberate theory building and testing Hypotheses CS: “Selective” testing and post hoc explanations S: Systematic testing, a priori hypotheses, and empirical basis Phenomena CS: May include untestable phenomena S: Only concerned with observable and testable phenomena Modification CS: Modification through selective recollection S: Replication and systematic testing - self-correcting 2TRANSCRIPT
![Page 1: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/1.jpg)
Introduction
Theory
Hypotheses
Data
Verification
Theory buildingHypothesis generation
Measurement issuesResearch designSampling issues
Statistical analysisInterpretation
Presentation of results
GeneralizationCumulationModification
![Page 2: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/2.jpg)
Common Sense vs. ScienceProcedures
CS: Quick acceptance of explanationsS: Slow and deliberate theory building and testing
HypothesesCS: “Selective” testing and post hoc explanationsS: Systematic testing, a priori hypotheses, and empirical basis
PhenomenaCS: May include untestable phenomenaS: Only concerned with observable and testable phenomena
ModificationCS: Modification through selective recollectionS: Replication and systematic testing - self-correcting
![Page 3: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/3.jpg)
Sources of discovery(McCall & Bobko)
(1) Serendipity - chance discovery(2) Sagacity - ability to recognize what
unexpected results mean(3) N=1 - qualitative studies(4) Socializing - interacting with others can
create insight(5) Metaphors - applying metaphors to the
unknown(6) Error variance - pay attention to the
abnormal
![Page 4: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/4.jpg)
TYPE I AND TYPE II ERRORS
Ho True Ho FalseTRUE STATE OF WORLD
DECISION Reject Ho
Fail toReject Ho
Type I Errorp =
Type II Errorp =
Correct decisionp = 1 -
Correct decisionp = 1 - power
![Page 5: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/5.jpg)
Important Concepts in Research
Forms of ControlInternal ValidityExternal Validity
![Page 6: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/6.jpg)
ControlManipulation
Elimination or inclusion
Statistical
Randomization
![Page 7: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/7.jpg)
Types of Validity (C&C, 1979)
Statistical conclusion
Construct
Internal
External
![Page 8: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/8.jpg)
Authorship DecisionsWhat is authorship?
A professional contribution that is creative and intellectual in natureIncludes
Developing research designs/ideasWriting portions of a manuscriptIntegrating theoryIntegrating conceptual modelsMaking decisions about data analysisInterpreting results
![Page 9: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/9.jpg)
Authorship Decisions
What authorship is notBased on time and effortDoes not include
Advice on what data analysis to doResearch idea onlyLiterature searchesData collectionDesign of equipment
![Page 10: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/10.jpg)
Authorship DecisionsSome guidelines include:
Discuss up frontRenegotiate as things changeConsider where students fall on the line of competence, greater competence typically yields greater contributionShould not be affected by paid participation (controversial)Get advice if you are unsure what constitutes authorship
![Page 11: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/11.jpg)
How do you do research that is:
• Significant?• Likely to be published in good
journals?• Likely to be read by peers?• Likely to be cited by peers?
![Page 12: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/12.jpg)
Persistence
1. Doing good research is persistence, persistence, persistence. –rethink, rethink—re-examine the issue over and over again more fine-grained each time. You need to think deeply about what you want to do.
![Page 13: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/13.jpg)
Discussion and Collaboration
Research benefits by discussing ideas with others. It helps to focus your thoughts and you benefit by the thoughts of others when you air your ideas.
Multi-authored articles are OK. Try to have teams with complementary skills—some limitations.Go to conventions and network.
![Page 14: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/14.jpg)
Doing
You will not learn research from a research course; you learn research by doing research. The more research you do the better future research will be—you develop a template for doing research"Good" research only raises more questions. You realize how little you know about the phenomena and what you need to know.
![Page 15: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/15.jpg)
TheoryResearch without a strong theoretical basis less likely to make a contribution and be published.Research frequently ignores the mediating process when documenting relationships—We miss the underlying reason why the event took place or depend on theory to explain the event. Process measures always help.The hardest part of the research is deciding on the problem and hypotheses (theoretical part).
![Page 16: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/16.jpg)
MethodsTriangulation – combine an experimental (manipulation) study with a surveyMulti-source data (multi people, methods)Pilot what you do on a small sample firstUse reliable and valid measurementSeparate the independent from the dependent variables using different measurement strategies. Try to measure behavior not attitudes as the primary dependent variable.
![Page 17: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/17.jpg)
Build on past research
Articles in JAP, OBHDP, Personnel Psychology 84% were coupled, building on existing research by:
Use different subject populationUse different operationalization of variablesUse different levels of variablesExamine variables together previously examined separatelyAdding mediators or moderators
![Page 18: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/18.jpg)
Reasons For RejectionInadequate Justification For Doing Study
Unclear research questionUnclear theoretical basis for questionDoes not articulate the importance of the research
“Why is this question important?”Does not articulate the contribution
“What is new and different about the study that adds to the literature?”Sometimes the study really does not have a contribution
![Page 19: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/19.jpg)
Methods Are Inadequate to Answer Question
Confounded variables Appropriate control variables are lacking Make statements of causality while
methods (correlation) only allow one to make statements of association.
Reasons For Rejection
![Page 20: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/20.jpg)
Measurement IssuesIncorrect operationalization of the variables.
Common with archival dataConstruct validity - Absence of justification that variables being measured actually assess the construct. Construct validityPoor reliability of scales
Reasons For Rejection
![Page 21: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/21.jpg)
Key Terms
Independent Variable—Variable that is manipulated in a experiment, the cause—the antecedent or predictor variable when measured.
Dependent Variable—The variable that is used to measure the effects of the independent variable in an experiment, the effect. The consequence or criterion variable when measured.
![Page 22: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/22.jpg)
Mediation vs. ModerationResearchers often confuse mediation and moderationTwo completely different processes and analytical approachesMediation implies the effect of an independent variable on a DV occurs through another variableModeration implies the effect of an independent variable on a DV depends on the level of another variable
![Page 23: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/23.jpg)
In terms of research terminology:
The existence of an interaction indicates the effect (relationship) of the IV with the DV is different at different values of the moderator variable.
Moderator
![Page 24: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/24.jpg)
Moderation
IV
Moderator
DV
![Page 25: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/25.jpg)
Example of Moderator
Males
Low
High
Y
X HighLow
Females
When X = amount of coffee consumed and Y = minutes spent on treadmill
![Page 26: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/26.jpg)
Example of Moderator
Low
High
Y
X HighLow
Z Easy
Z Medium
Z Difficult
X = hours studied, Y = test performance,Z = test difficulty
![Page 27: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/27.jpg)
Example of Moderation
Experts
Low
High
Y
X HighLow
Novices
Where X = blood alcohol levelY = video game score
![Page 28: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/28.jpg)
Mediator Variables
The mechanism or process through which a variable has its effect on other variables
Obtaining PhD
Lack of Personal
Time
Marital Conflict
![Page 29: Introduction Theory Verification Hypotheses Data Presentation of](https://reader036.vdocuments.us/reader036/viewer/2022062413/5a4d1b7b7f8b9ab0599b937a/html5/thumbnails/29.jpg)
Assignment 1
Find an empirical article in your field of interest that tests the relationship between an independent variable dependent variable and tests the impact of a moderator variable on this relationship.
1) Describe the independent variable(s) and the dependent variable(s).
2) State the hypothesis that describes the relationship between the independent and the dependent variable.
3) State the hypothesis that describes how the moderating variable is expected to change the relationship between the independent and dependent variable.
4) Illustrate the hypothesized moderated relationship in a figure.
5) Did the results find evidence for a moderated relationship?