04/19/23 Slide 1

• The relationship between two quantitative variables is pictured with a scatterplot.

The dependent variable is plotted on the vertical axis.

The independent variable is plotted on the horizontal axis.

Each dot represents the combination of scores on both variables for one or more cases. If two or more cases have the same scores, they will be shown by the same dot.

If a case is an outlier on either variable (± 3 standard deviations from the mean), it will be green instead of blue.

04/19/23 Slide 2

• To facilitate our understanding of the distribution of variables in the scatterplot, we add a boxplot for each variable in the chart margin. The boxplots support the evaluation of skewness and the presence of outliers.

The boxplot at the right of the chart shows the distribution of the dependent variable.

The boxplot at the top of the chart shows the distribution of the independent variable.

04/19/23 Slide 3

• We add a red trend line or linear fit line that summarizes the overall pattern of the cases in the chart.

04/19/23 Slide 4

• We add the cyan colored loess smoother fit line to evaluate the linearity of the fit. A loess smoother averages subsets of points and thus tracks more closely where the points are concentrated. Differences between the linear fit line and the loess line are a visual tool for determining whether the relationship is linear.

04/19/23 Slide 5

• The relationship between two quantitative variables can be linear or non-linear, though it is not always easy to distinguish.

The loess line in this chart fluctuates above and below the linear fit line, but the overall pattern could be characterized as linear.

This chart shows a clear pattern of non-linearity. The curve in the loess line depicts a clear non-linear pattern.

04/19/23 Slide 6

• To quantify the relationship between two quantitative variables, we use a correlation coefficient, Pearson’s r or Spearman’s rho.

• The correlation coefficient tells us:• If there is a relationship between the variables• The strength of the relationship• The direction of the relationship

• Correlation coefficients vary from -1.0 to +1.0.• A correlation coefficient of 0.0 indicates that there is no

relationship.• A correlation coefficient of -1.0 or + 1.0 indicates a perfect

relationship, i.e. the scores on one variable can be accurately determined by the scores on the other variable.

04/19/23 Slide 7

• If a correlation coefficient is negative, it implies an inverse relationship, i.e. the scores on the two variables move in opposite directions, higher scores on one variable are associated with lower scores on the other variable.

• If a correlation coefficient is positive, it implies a direct relationship, i.e. the scores on the two variables move in the same direction, higher scores on one variable are associated with higher scores on the other variable.

• When we talk about the size of a correlation, we refer to the value irrespective of the sign – a correlation of -.728 is just as large or strong as a correlation of +.728

• The Pearson R correlation coefficient treats the data as interval.

• Spearman’s Rho treats the data as ordinal, using the rank order of the scores for each variable rather than the values.

04/19/23 Slide 8

• Suppose I had the data to the right showing the relationship between GPA and income.

• SPSS would calculate Pearson’s r for this data to be .911 and Spearman’s rho to be .900.

GPA Income

3.2 45000

3.3 42000

3.5 48000

3.7 50000

3.8 55000

GPA Rank

Income Rank

1 2

2 1

3 3

4 4

5 5

• The ranks for the values for each of the variables are shown in the table to the right.

• Using the ranks as data, SPSS would calculate both Pearson’s r and Spearman’s rho to be .900.

04/19/23 Slide 9

• Suppose the fifth subject had an income of 100,000 instead of 55,000.

• SPSS would calculate Pearson’s r for this data to be .733 and Spearman’s rho to be .900.

GPA Income

3.2 45000

3.3 42000

3.5 48000

3.7 50000

3.8 100000

GPA Rank

Income Rank

1 2

2 1

3 3

4 4

5 5

• The ranks for the values did not change. The fifth subject had the highest income, so Spearman’s rho has the same value.

• The Pearson’s r decreased from .911 to .733.

• Outliers, and the skewing of the distribution by outliers, have a greater effect on Pearson’s r than they do on Spearman’s rho.

04/19/23 Slide 10

• In the scatterplot, outliers (the case I changed from 55,000 to 100,000) will draw the loess line toward them away from the linear fit line, making the pattern of points appear less linear. or more non-linear.

55,000

100,000

The lines demonstrate the point, but the cyan line is really a quadratic fit rather than a loess line because I can’t do much smoothing with only 5 data points.

04/19/23 Slide 11

• Outliers, and the skewing of the distribution by outliers, have a greater effect on Pearson’s r than they do on Spearman’s rho.

• As the outliers become more extreme, and the distribution becomes more skewed, Spearman’s rho becomes larger than Pearson’s r, and the overall trend in the data is non-linear.

• To accurately model the relationship, we have three choices:1. use a more complex non-linear model to analyze the

relationship2. re-express the data to reduce skewing and the impact of

outliers, and analyze the relationship with a linear model3. Exclude outliers to reduce skewing, and analyze the

relationship with a linear model• The second alternative is preferred, though it may not always

be possible.

04/19/23 Slide 12

• If the three following conditions are present, re-expressing the data may reduce the skewness and increase the size of Pearson’s r to justify treating the relationship as linear:1. If the model appears non-linear because of the

difference between the loess line and the linear fit line, 2. If Spearman’s rho is larger than Pearson’s r (by ±.05 or

more), 3. If one or both of the variables violates the skewness

criteria for a normal distribution.

• We will employ the transformations we have used previously: if the distribution is negatively skewed, we re-express the data as squares; if the distribution is positively skewed, we re-express the data as logarithms.

04/19/23 Slide 13

• There are two sets of guidelines used to translate the correlation coefficient into a narrative phrase, guidelines attributed to Tukey and guidelines attributed to Cohen.

• Tukey’s guidelines interpret a correlation:• between 0.0 up to ±0.20 as very weak; • equal to or greater than ±0.20 up to ±0.40 as weak; • equal to or greater than ±0.40 up to ±0.60 as moderate; • equal to or greater than ±0.60 up to ±0.80 as strong; and • equal to or greater than ±0.80 as very strong.

• Cohen’s guidelines interpret a correlation:• less than ±0.10 = trivial; • equal to or greater than ±0.10 up to ±0.30 = weak or small; • equal to or greater than ±0.30 up to ±0.50 = moderate; • equal to or greater than ±0.50 or greater = strong or large

Examples

Slide 14

Slide 15

Example of Effective Transformations: Rho Greater Than R - Both Variables Positively SkewedEffective Logarithmic Re-expression

Slide 16

Example of Effective Transformations:Rho Greater Than R – One Variable Positively SkewedModerately Effective Logarithmic Re-expression

Slide 17

Example of Effective Transformations:Rho Greater Than R – One Positive/One Negative SkewModerately Effective Logarithmic Re-expression

Slide 18

Example of No Transformation Needed:Rho Slightly Higher than R – Borderline SkewnessApproximately Linear, Re-expression Not Needed.

Slide 19

Example of No Transformation Needed:Rho Slightly Higher than R – Minimal SkewnessApproximately Linear, Re-expression Not Needed.

Slide 20

Example of No Transformation Needed:Rho Slightly Higher than R – Borderline SkewnessApproximately Linear, Re-expression Not Needed.

Slide 21

Example of Ineffective Re-expressions:R Greater Than Rho – One Variable Negatively SkewedSquare Re-expression Very Limited Impact on Non-linearity

Slide 22

Example of Ineffective Re-expressions:R Greater Than Rho – Both Variables Positively SkewedLogarithmic Re-expression Increases Non-linearity

Slide 23

Example of Ineffective Re-expressions:R Greater Than Rho – One Positive/One Negative SkewedRe-expressions Increases Non-linearity

Slide 24

Example of Ineffective Re-expressions:R Greater Than Rho – One Variable Positively SkewedRe-expressions Decreases Linearity Showing Non-linearity

04/19/23 Slide 25

• We might legitimately choose not to use any transformation, or to ignore the non-linearity of the relationship, but we should look at the plots and statistics for the distribution of the variables in the analysis so we are making an informed choice.

• The consequence of ignoring the issue of linearity is usually that we fail to state the actual importance of a relationship, though there are occasions when we might be citing a relationship as important when it’s strength is the result of extreme outliers.