correlation analysis - bvag.com.vn · workshop on analysis of clinical studies –can tho...
TRANSCRIPT
![Page 1: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/1.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Correlation analysis
Tuan V. Nguyen
Professor and NHMRC Senior Research Fellow
Garvan Institute of Medical Research
University of New South Wales
Sydney, Australia
![Page 2: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/2.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
What we are going to learn …
• Examples (BMD and age, BMD and weight)
• Formulating question
• Covariance and correlation
• R analysis
• Interpretation
• Linear regression
![Page 3: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/3.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Femoral neck bone density and age
women = subset(vd, sex==2)
plot(fnbmd ~ age, pch=16)
abline(lm(fnbmd ~ age))
20 30 40 50 60 70 80
0.4
0.5
0.6
0.7
0.8
0.9
1.0
1.1
age
fnb
md
![Page 4: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/4.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Weight and femoral neck bone density
plot(fnbmd ~ weight, pch=16)
abline(lm(fnbmd ~ weight))
30 40 50 60 70 80
0.4
0.5
0.6
0.7
0.8
0.9
1.0
1.1
weight
fnb
md
![Page 5: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/5.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
When to consider correlation?
t-test or ANOVA
When the independent variable is categorical
0
5
10
15
20
25
30
Control Treat A0
10
20
30
40
50
60
70
80
90
100
Control Treat A Treat B Treat C
Male
Female
![Page 6: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/6.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
When to consider correlation?
• Relationship between 2 continuous variables
• Degree of co-variation
• Predition ?
![Page 7: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/7.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Meet Sir Francis Galton (16/2/1822 – 17/1/1911)
Galton’s conclusions:
• Nature dominates: “families of reputation
were much more likely than ordinary
families to produce offspring of ability”
• Recommended “judicious marriages
during several generations” to “produce
a highly gifted race of men”
• His “genetic utopia”: “Bright, healthy
individuals were treated and paid well,
and encouraged to have plenty of
children. Social undesirables were
treated with reasonable kindness so
long as they worked hard and stayed
celibate.”
Didn’t have data on “intelligence” so
instead studied HEIGHT
• Although a self-proclaimed genius, who wrote that
he could read @2½, write/do arithmetic @4, and
was comfortable with Latin texts @8, he couldn’t
figure out how to model these data(!)
• He went to JD Dickson, a mathematician at
Cambridge, who formalized the relationship by
developing what we now know as linear
regression
Research interest:
“Those qualifications
of intellect and
disposition which …
lead to reputation”
![Page 8: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/8.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
How do we describe the linear relationship?
• Let X and Y be two random variables from a sample of
n obervations.
• Measure of variability of x and y: variance
n
i
i
n
xxx
1
2
1var
n
i
i
n
yyy
1
2
1var
• We need a measure of covariation (covariance)
between X and Y.
• Covariance is the average of product of X and Y
n
iii
yyxxn
yx11
1,cov
![Page 9: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/9.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Variance and covariance: geometry
• The independence or dependence between x and
y can be represented geometrically:
y
x
h
h2 = x2 + y2
x
yh
h2 = x2 + y2 – 2xycos(H)
H
Covariance
![Page 10: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/10.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Meaning of variance and covariance
• Variance is always positive
• If covariance = 0, X and Y are independent
• Covariance is sum of cross-products: can be positive or negative
• Negative covariance = deviations in the two distributions in are opposite directions
• Positive covariance = deviations in the two distributions in are in the same direction
• Covariance = a measure of strength of association
![Page 11: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/11.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Some correlations
-3 -2 -1 0 1 2 3
-3-1
12
3
x
y
-3 -2 -1 0 1 2 3
-4-2
02
x
y
r = 0.99 r = 0.90
-3 -2 -1 0 1 2 3
-3-1
12
3
x
y
r = 0.50
-3 -2 -1 0 1 2 3
-3-1
12
34
x
y
r = 0.25
-3 -2 -1 0 1 2 3
-3-1
01
23
x
y
-3 -2 -1 0 1 2 3
-3-1
01
23
x
y
r = 0.10 r = 0.01
![Page 12: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/12.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Our aim of analysis
• To estimate the coefficient of correlation (r)
• To test whether r = 0 ?
![Page 13: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/13.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Estimate of correlation coefficient r
• Covariance is unit-depenent.
• Coefficient of correlation (r) between X and Y is a
standardized covariance
• r is defined by:
yxSDSD
yx
yx
yxr
,cov
varvar
,cov
![Page 14: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/14.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Test of hypothesis of correlation
• Hypothesis: Ho: r = 0 versus Ho: r not equal to 0.
• Fisher’s z-transformation: transform r z
r
rz
1
1ln
2
1
3
1
nzSE
• Calculate standard error of z
z
tSE z
• T-test:
![Page 15: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/15.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Example: bone density, age, and weight
• Cross-sectional study
• Bone mineral density (BMD) was measured at the
femoral neck
• Age, weight
• Questions
– Was there a correlation between age and BMD, weight
and BMD?
– Was the correlation statistically significant?
![Page 16: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/16.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Femoral neck bone density and age
women = subset(vd, sex==2)
plot(fnbmd ~ age, pch=16)
abline(lm(fnbmd ~ age))
20 30 40 50 60 70 80
0.4
0.5
0.6
0.7
0.8
0.9
1.0
1.1
age
fnb
md
![Page 17: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/17.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
R analysis
> cor.test(fnbmd, age)
Pearson's product-moment correlation
data: fnbmd and age
t = -14.4162, df = 556, p-value < 2.2e-16
alternative hypothesis: true correlation is not equal to 0
95 percent confidence interval:
-0.5795310 -0.4584638
sample estimates:
cor
-0.5216183
![Page 18: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/18.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Age and BMD: an interpretation
• The coefficient of correlation between age and
BMD was -0.52
• Older individuals had lower BMD than younger
individuals
• The correlation was statistically significant (P <
0.0001)
![Page 19: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/19.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Weight and femoral neck bone density
plot(fnbmd ~ weight, pch=16)
abline(lm(fnbmd ~ weight))
30 40 50 60 70 80
0.4
0.5
0.6
0.7
0.8
0.9
1.0
1.1
weight
fnb
md
![Page 20: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/20.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
R analysis
> cor.test(fnbmd, weight)
Pearson's product-moment correlation
data: fnbmd and weight
t = 8.1795, df = 556, p-value = 1.998e-15
alternative hypothesis: true correlation is not equal to 0
95 percent confidence interval:
0.2515705 0.3998585
sample estimates:
cor
0.3277315
![Page 21: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/21.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Weight and BMD: an interpretation
• The coefficient of correlation between weight and
BMD was 0.33
• The correlation was statistically significant (P <
0.0001)
![Page 22: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/22.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
r and R2
• r is the correlation coefficient
• R2 is the coefficient of determination:
The amount of variation of one variable can be “explained” by another variable
• r(weight, BMD) = 0.33 means that R2 = (0.33)2 = 0.11.
This means that weight could explain 11% of the
variation in BMD
![Page 23: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/23.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Multi-variable correlations
• Inter-correlations among variables can be computed
• Bivariate correlation
![Page 24: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/24.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
library(psych)
temp = cbind(age, weight, height, bmi, lsbmd, fnbmd, xlap)
pairs.panels(temp)
age
30 60
0.08 -0.22
15 25
0.27 -0.36
0.4 0.8
-0.52
20
50
80
-0.17
30
60
weight
0.58 0.76 0.33 0.33 -0.01
height
-0.08 0.34 0.41
140
170
0.17
15
25 bmi
0.14 0.07 -0.16
lsbmd
0.70
0.4
1.0
-0.15
0.4
0.8
fnbmd
-0.06
20 50 80 140 170 0.4 1.0 0.0 1.0
0.0
1.0
xlap
![Page 25: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/25.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
> corr.test(temp)
Call:corr.test(x = temp)
Correlation matrix
age weight height bmi lsbmd fnbmd xlap
age 1.00 0.08 -0.22 0.27 -0.36 -0.52 -0.17
weight 0.08 1.00 0.58 0.76 0.33 0.33 -0.01
height -0.22 0.58 1.00 -0.08 0.34 0.41 0.17
bmi 0.27 0.76 -0.08 1.00 0.14 0.07 -0.16
lsbmd -0.36 0.33 0.34 0.14 1.00 0.70 -0.15
fnbmd -0.52 0.33 0.41 0.07 0.70 1.00 -0.06
xlap -0.17 -0.01 0.17 -0.16 -0.15 -0.06 1.00
Probability value
age weight height bmi lsbmd fnbmd xlap
age 0.00 0.07 0.00 0.00 0.00 0.00 0.01
weight 0.07 0.00 0.00 0.00 0.00 0.00 0.88
height 0.00 0.00 0.00 0.07 0.00 0.00 0.01
bmi 0.00 0.00 0.07 0.00 0.00 0.10 0.01
lsbmd 0.00 0.00 0.00 0.00 0.00 0.00 0.02
fnbmd 0.00 0.00 0.00 0.10 0.00 0.00 0.38
xlap 0.01 0.88 0.01 0.01 0.02 0.38 0.00
![Page 26: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/26.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Be careful !
• Study on 44 university students
• Measure body mass index (BMI)
• Sexual attractiveness (SA) score
id <- seq(1:44)
bmi <- c(11.00, 12.00, 12.50, 14.00, 14.00, 14.00, 14.00,
14.00, 14.00, 14.80, 15.00, 15.00, 15.50, 16.00,
16.50, 17.00, 17.00, 18.00, 18.00, 19.00, 19.00,
20.00, 20.00, 20.00, 20.50, 22.00, 23.00, 23.00,
24.00, 24.50, 25.00, 25.00, 26.00, 26.00, 26.50,
28.00, 29.00, 31.00, 32.00, 33.00, 34.00, 35.50,
36.00, 36.00)
sa <- c(2.0, 2.8, 1.8, 1.8, 2.0, 2.8, 3.2, 3.1, 4.0, 1.5,
3.2, 3.7, 5.5, 5.2, 5.1, 5.7, 5.6, 4.8, 5.4, 6.3,
6.5, 4.9, 5.0, 5.3, 5.0, 4.2, 4.1, 4.7, 3.5, 3.7,
3.5, 4.0, 3.7, 3.6, 3.4, 3.3, 2.9, 2.1, 2.0, 2.1,
2.1, 2.0, 1.8, 1.7)
![Page 27: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/27.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Negative correlation
> cor.test(bmi, sa)
Pearson's product-moment correlation
data: bmi and sa
t = -2.0845, df = 42, p-value = 0.04323
alternative hypothesis: true correlation is not equal to 0
95 percent confidence interval:
-0.55282250 -0.01024671
sample estimates:
cor
-0.3061956
![Page 28: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/28.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
But …
• plot(sa, bmi)
10 15 20 25 30 35
23
45
6
bmi
sa
![Page 29: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/29.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Scatter plots of data with various correlation coefficients
Y
X
Y
X
Y
X
Y
X
Y
X
r = -1 r = -.6 r = 0
r = +.3r = +1
Y
Xr = 0
![Page 30: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/30.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Y
X
Y
X
Y
Y
X
X
Linear relationships Curvilinear relationships
Linear correlation
![Page 31: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/31.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Y
X
Y
X
Y
Y
X
X
Strong relationships Weak relationships
Linear correlation
![Page 32: Correlation analysis - bvag.com.vn · Workshop on Analysis of Clinical Studies –Can Tho University of Medicine and Pharmacy –April 2012 Age and BMD: an interpretation •The coefficient](https://reader035.vdocuments.us/reader035/viewer/2022071001/5fbd4299fd42350e9672343b/html5/thumbnails/32.jpg)
Workshop on Analysis of Clinical Studies – Can Tho University of Medicine and Pharmacy – April 2012
Summary
• A measure of strength of association between 2
continuous variables
• Normally distributed data
• Only applicable to a LINEAR relationship
• Correlation is not necessarily a measure of cause-
and-effect relationship