statistics in clinical researchnull and alternative hypothesis type i and type ii errors p-value...

56
Statistics in Clinical Research By Dr. Tamer M.S. Hifnawy Associate Professor of Public health Faculty of Medicine, BSU.

Upload: others

Post on 13-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Statistics in Clinical Research

By

Dr. Tamer M.S. HifnawyAssociate Professor of Public health

Faculty of Medicine, BSU.

Page 2: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Types of VariablesCommonly used Statistical testNormal distribution curveMeasures of Central Tendency and Measures of DispersionNull and alternative hypothesisType I and type II errorsP-value & statistical significance

Page 3: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Statistics are numerical statements.

Biomedical Statistics are numerical statements about medical matters.

• Number with certain disease.• Number or proportion cured.• Proportion of deaths.• Number of hospital beds.

What is Statistics?

Page 4: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Biomedical Statistics

Discipline concerned with treatment of numerical data derived from a group of individuals.

• Administrative purposes.

• Research.

Used for:

Page 5: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Why Statistics?

I smoke cigarettes for 30 years and I suffered no disease.Therefore smoking cigarettes is safe!

• I smoked cigarettes for 2 years, I had bronchitis which turned to chronic condition. Now I discovered lung malignancy.

• Therefore smoking cigarettes is damaging to your health!

Page 6: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Why Statistics?Who are we going to believe?

• Dr. “X” Observed 1000 smokers.

Get Statistics, but how?

• Health problems was found among 800 of them.• Only 200 had no health problems.• Therefore smoking cigarettes is damaging to your

health!

Page 7: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Why Statistics?

Who are we going to believe?

• Dr. “Y” Observed 2000 smokers.

• Health problems was found also among 800 of them.

• More smokers (1200) are healthy.• Therefore smoking cigarettes does not affect your

health!

Wait!

Page 8: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Variables definition

Characteristics that vary from one subject to the other

Needs to be measured for every subject

Relate to person, environment, cause etc.

Page 9: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Statistics

Data CollectionData PresentationData AnalysisInterpretation of results

Page 10: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

At the beginning, there must be a clear understanding of the word data or Variables

Data : “Numerical information suitable for processing or organized for analysis”

It is a well-defined situation and objectively described.

Page 11: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Statistical methods will be mainly concerned with data collection, presentation and analysis.

The interpretation by the specialist in collaboration with the statistician would result in the information.

Page 12: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Research Steps: (backbone)The three main steps are:STEP I: Proper data collection:

Problem definition and objective setting.Study designSample typeSample sizeSources of dataTools for data collection

Page 13: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

STEP II: Proper data presentation:

Tables: When details of data are neededGraphs: When only impressions are needed.Parameters: Precise mathematical summary, useful for comparison.

Page 14: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

STEP III: Proper use of statistical data analysis:

Comparisons: Tests of significance are the main statistical tools used.Associations: Correlation and regression are the tools used.

Page 15: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

VARIABLE TYPESQuantitative When data expressing the different variable levels are measured as numbers.

Qualitative Variable is assessed as description

Page 16: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

VARIABLE TYPES

Quantitative Qualitative

NominalSex

OrdinalDis. Severity

ContinuousAge

DiscretePulse

Page 17: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Normal Distribution Curve

34%34%

13.5%13.5%

95%

Page 18: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

It has a peak and two symmetrical sides.

The peak coincides with all measures of central tendency.

The curve extends to infinity on both sides.

Normal Distribution Curve

Page 19: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Normal Distribution CurveConfidence limits: two values that limit the 95% closer values to the mean. Between these two values we are confident that any value could be presented by the mean. Any value that is more than or less than the confidence limit is considered significantly different from the mean value.95% CI

Page 20: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Summarizing DataMeasures of Central TendencyAlso called measures of the middle or measures of “center”

Three most common:Mean: Arithmetic average of observationsMedian: The middle observationMode: The most frequent observation

Page 21: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Sample Mean

Simple arithmetic average or sum of the scores divided by the number of items

Example: Xi=10, 12, 11, 15, 19

Sample mean=(10+12+11+15+19)/5=13.4

Page 22: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Median

Divides the bottom 50% of the data from the top 50%

Appropriate for use with skewed distributions

Approximately equal to mean when distribution is symmetric

Page 23: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Distribution ShapesSymmetric (normal): Mean = Median

Right (positive) Skewed: Mean < Median

Left (negative) Skewed: Mean > Median

Page 24: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Mean: 106.7

Median: 105.0

50 60 70 80 90 110 130 150 170 190

Page 25: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Descriptive Statistics

Central Tendency(Location)

Dispersion

a Mid range Range

b Mode Minimum Maximum

c Median 25th percentile 75th percentile

d Arithmetic Mean

Standard deviation

Page 26: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Summarizing DataMeasures of Variation

Also called ‘measures of spread’Most commonly used:

Sample rangeSample varianceSample standard deviationSample interquartile range

Page 27: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

62o C12o C

Average = 37o C

Statistically Speaking “He is comfortable!”

Arithmetic Mean

Standard deviation

CENTER

DISPERSION

Page 28: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Hypothesis testing

It is a procedure for deciding whether a hypothesis about a quantitative feature of a population is true or false.

Page 29: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Practical ExampleIt is known that in a particular country, the mean birth weight of male babies is 3.3 ± 0.5 Kg.

Suppose that a random sample of 100 male babies born to a particular ethnic subgroup was found to have a mean birth weight of 3.2 ±0.4 kg.

Page 30: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Null hypothesis and alternative hypothesis

There is no difference between the means of two compared groups (this shown difference would be expected to occur by chance)

Null hypothesis

Alternative hypothesis

There is a difference between the means of the two groups

Page 31: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Statistical testing: If the difference between the means of the samples is among those that would occur by chance, this means that the results are not statistically significant.

When the null hypothesis is rejected and alternative hypothesis is accepted, the investigator describes the results as statistically significant.

Page 32: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Hypothesis Is Never Proven To Be True OR False, BUT It Is Only

Accepted OR Rejected On The Basis OF Statistical Tests.

Page 33: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Commonly used statistical tests

Page 34: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

To examine the relationship (association or difference) between qualitative variables.

Ex.Lung cancer Control

Smokers A BNon-smokers C D

1- Chi-square test (X2):

Page 35: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

2- Paired t test:

2- Paired t test: used to compare the means of one variable in the same group (pre and post an event).

Wilcoxon’s matched pairs test

Page 36: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

3- Student t test

to evaluate the difference in means between two groups.

Mann-Whitney test (U-test)

Page 37: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

4- ANOVA (F test):

to test for the difference of means of the same variable between more than two groups.

Kruskall-Wallis test

Page 38: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

5- LSD Post Hoc Test

to test for the difference of the means of the same variable between each two groups individually.

Following a significant F test

Page 39: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

6- Pearson’s coefficient (r):

It is a measure of the degree of linear relationship between two variablesIt is described for two main things:

Page 40: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Its strength

-1.0

Perfect

+1.0

Perfect

Sperman rank correlation coefficient

Its direction

+ve-veneutral

Page 41: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

7- Regression line (Prediction):

It is important as it shows the average expected values of the two variables,based on the observed values.

Page 42: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

If sample size is very small “as small as 10”Abnormally distributed data

Via histogramPerforming a normality test “Kolmogorov –Smirnov test”

Scale of measurement (scores, titer)

Non-Parametric Statistics

Page 43: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Poor Man

500,000 $ 1000 $

1,000,000 $

Page 44: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Clinical significance vs. Statistical significance

Statistical significance examines the likelihood that the difference found between groups could have occurred by chance alone.

In most clinical trials, a result is statistically significant if the difference between groups could have occurred by chance alone in less 5%.

This is expressed as a P value <0.05.

Page 45: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Clinical significance has little to do withstatistics and is a matter of clinicaljudgment.It answers the question “Is the differencebetween groups large enough to be worthachieving?”Studies can be statistically significant yetclinically insignificant and vice versa

Page 46: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Alpha error (Type I error):

P value (traditionally levels of 0.05 are used for statistical significance)It indicates the probability of rejecting the statistical hypothesis tested when in fact, that hypothesis is true.

ART

Page 47: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Beta error (Type II error):

the probability that the test will accept the hypothesis tested when in fact, it is false. It measures the power of the test. =(1-B error)

Power of the test: probability of rejecting the null hypothesis when it is false.

BAF

Page 48: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

EXAMPLE

It may be concluded on the basis of the results that a new treatment is better when in fact it is

not better than the standard treatment

Type I error

Randomized control trial of drugs

Page 49: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

On the other hand, a new treatment, that is actually effective may be

concluded to be ineffective

Type II error

Page 50: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Type I error (P-value)Level of significance

of the test

Page 51: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

P < 0.05 ??

P<0.001

P>0.05P<0.01P<0.05

P<0.0001

Page 52: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Type II error Power of the test

Page 53: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Remember:

Be sure of the distribution of your data before doing any statistical analysis to choose the right statistical test.

P -value Statistical significance

Page 54: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Types of VariablesCommonly used Statistical testNormal distribution curveMeasures of Central Tendency and Measures of DispersionNull and alternative hypothesisType I and type II errorsP-value & statistical significance

Page 55: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

Special Thanks To My Professor,

Dr. Mohamed HassanProfessor of Public Health and Community Medicine

Faculty of Medicine - Cairo University

Page 56: Statistics in Clinical ResearchNull and alternative hypothesis Type I and type II errors P-value & statistical significance Statistics are numerical statements. Biomedical Statistics

THANK YOU

Tamer Hifnawy MD. Dr PH.Associate Professor of Public Health & Community MedicineEmail: [email protected]

[email protected]: +20124130107