coding procedures (data extraction) purpose 1.identify characteristics that may provide an objective...

17
Coding Procedures (Data Extraction) Purpose 1. Identify characteristics that may provide an objective explanation of intervention effects. 2. Provide the reader with a transparent standard of the extracted data 6.0

Upload: steven-williamson

Post on 02-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

Coding Procedures (Data Extraction)

Purpose

1. Identify characteristics that may provide an objective explanation of intervention effects.

2. Provide the reader with a transparent standard of the extracted data

6.0

Page 2: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

A. Publication Source

1. Journal 2. Dissertation 3.Thesis

4. Unpublished Paper 5. Book 6. Other: ________

B. Subject Characteristics (page(s): ____________)Group Pretest Posttest Attrition Age Grade(s) (n) (n) (n) (n) (n) (n) Tx: ______ _____ ______ ______ ______ _____ Cp: ______ _____ ______ ______ ______ _____

Co: ______ _____ ______ ______ ______ _____

Page 3: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

C. Socioeconomic Status (page(s):___________

1. Low 2. Middle 3. Upper

4. Low-Middle 5. Middle Upper 6. Labeled Mixed

7. Unclear 8. ___________ 9. NR

Comments:__________________________________

Page 4: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

D. Sample Source (page(s)_________)

1. Public School

2. Secular Private School

3. Religious Private School

4. Other:_________________

5. NR

Comments

Page 5: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

E. Study Setting (page(s) ______)

1. Urban 2. Suburban 3. Rural

Geographic Setting: ______________________

Comments:

Page 6: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

F. Author’s Labeling of Participants’ Achievement Levels (page _____)

1. Average Achieving 2. High Achieving 3. Underachieving

4. At-Risk 5. Unclear

6. Other:___________________ 7. NR

G. Race/Ethnicity (page ______)

1. African American 2. American Indian 3. Asian

1. 4. Hispanic/Latino 5. White

6. Other: ____________________ 7. NR

Page 7: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

H. Intervention Characteristics

1. Type of intervention (page __________________)

2. Total length of intervention program: __________ or NR (page _____)

3. Length of time PER intervention session:________ or NR (page _____)

4. Number of sessions: ________ per ________ or NR (page _____)

5. Describe the intervention(s) intended for delivery to the study groups including how and when it was administered.______________________________________________

Page 8: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

6. Fidelity of implementation data reported? (page(s)______) 0=No 1=Yes

If yes, describe the intervention(s) intended for delivery to the study groups including how and when it was administered:

________________________________________________________________________________________________________________________________________________________________________________________________

7. Intervention implemented as described? (page(s) _____)

1=No 2=Yes 3= Somewhat 9=NR

Page 9: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

I. Outcome Measure(s)

Type of Measure Instrument

Variable(s) Who Administered the Measurement Instrument?

1. Norm Referenced Test (page____)

___________________________

a. Parent b. Teacherc. Researcher d. Othere. NR

2. Criterion Referenced Test (page____)

__________________________

a. Parent b. Teacherc. Researcher d. Othere. NR

4. Rating/Survey (page____)

__________________

a. Parent b. Teacherc. Researcher d. Othere. NR

5. Class Grade (page____)

___________________________

a. Parent b. Teacherc. Researcher d. Othere. NR

Page 10: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

J. Design Characteristics

Recruitment Pool (page_____)1. Referral 2. Criterion 3. Norm Reference Test4. Existing Group 5. Cohort 6. Volunteer7. Other ___________________ 9. NR

Research Design Type (pg____)Randomized Design

1. Group (Cluster, Place-based) Randomized Design2. Quasi-Experiment: Interrupted Time Series Design*3. Quasi-Experiment: Regression Discontinuity*4. Quasi-Experiment: Nonequivalent Comparison Group

Design*5. Pre-Experimental: Single Group Pre/Posttest Design*6. Single Subject Design*7. Other Designs:

_____________________________________

Page 11: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

K. Assignment ProceduresSubject Assignment (page(s) _____)

1. Individual Random

2. Group Random

3. Individual Match Random

4. Quasi-random

Page 12: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

Method of Random Allocation (page(s) _____)

Method of Random Allocation Who Implemented the Random Allocation?

1. Random Numbers (page____) a. Parent b. Teacherc. Researcher d. Othere. NR

2. Coin Flip (page____) a. Parent b. Teacherc. Researcher d. Othere. NR

3. Other:_______(page____) a. Parent b. Teacherc. Researcher d. Othere. NR

Page 13: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

Was concealment of allocation used as part of the randomization procedures? 1=no 2= yes 3=NR

a. If yes, were the allocation procedures concealed from any of the following people?

1. Researcher (pg _____)

2. Participant (pg _____)

3. Intervener (pg _____)

4. Assessor (pg _____)

Page 14: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

L. Quasi-Experimental Assignment Procedures (If applicable, otherwise skip to section M)

1. Was any of the following research design techniques used to equate groups prior to the intervention?

a. Matching on pretest proxy (pg _____)b. Matching on a pretest (pg _____)c. Matching on other variables (pg _____) d. No Matching (pg _____)

2. Was statistical equating used prior to the intervention? 1=no 2=yes 3=NR

Comments:________________________________________

Page 15: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

M. Effect Size Characteristics

Comparisons: Group 1: _________vs. Group 2:_________

Outcomes __________ __________ ___________ Groups __1__ _2_ __1__ __2__ __1_ __2__

Mean __________ _____ _____ ____ _____

SD _____ _____ _____ _____ ____ _____N at Posttest _____ _____ _____ _____ ____ _____

F value _____ _____ _____ _____ _____ ____Chi-square _____ __ ___ _____ _____ _____ ____

p value _____ _____ _____ _____ _____ _____ t value _____ _____ _____ _____ _____ _____

Page 16: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

Method of Analysis (pg _____)

a. Intention to Treat:

b. Treated Participants Only

Page 17: Coding Procedures (Data Extraction) Purpose 1.Identify characteristics that may provide an objective explanation of intervention effects. 2.Provide the

7.0: Excerpt from Master Coding Guide for

Study Coding

Code the Fantuzzo Study (7.1)