critical appraisal of qualitative research jenny tancock, clinical librarian, fgh...

Critical Appraisal of Qualitative Research

Jenny Tancock, Clinical Librarian, FGHjenny.tancock@mbht.nhs.uk01229 491297

Alison Harry, R+D Co-ordinator, RLIalison.harry@mbht.nhs.uk01524 516485

Learning Objectives

By the end of this workshop you will: Understand why critical appraisal is useful Understand the principles of critically appraising a

qualitative study Have used some tools available to aid critical

appraisal Be confident in recognising qualitative research

methods

1. decide how trustworthy a piece of research is (validity)

2. determine what it is telling us (results)

3. weigh up how useful the research will be

(relevance)

Critical appraisal helps the reader of qualitative research…

“Understanding the complex world of lived experience from the point of view of those who live it.” Jones R. Why do qualitative research? BMJ 1995; 311:2

it is concerned with seeing the world through the eyes of the person being studied

What is qualitative research?

Why use qualitative research ?

views of individuals/groups :

increase knowledge in a poorly understood area

challenge assumptions and practices

act as a precursor to quantitative research

generate new ideas

Qualitative or quantitative?

How many parents would consult their general practitioner when their child has a mild temperature?

Why do parents worry so much about their children’s temperature?

What proportion of smokers have tried to give up? What stops people giving up smoking?Trisha Greenhalgh

‘How to read a paper’

Qualitative research methodologies

phenomenology

ethnography

grounded theory

e.g.

1. research question

2. sampling process

3. data collection

4. data analysis

Components of qualitative research:

• are the aims of the research clear?

• is a qualitative methodology appropriate?qualitative research addresses the ‘what’ ‘how’ ‘why’ questions - what is happening? - how does it happen?

- why does it happen?

1. Research Question

The sample consists of individuals who have experiences relevant to the area being researched. Knowing how they were selected is important in establishing transferability.

• methods of sampling: purposivetheoretical

• the sample size can be determined by:data analysissaturationsize of ‘expert’ grouppragmatism

2. Sampling Process

3. Data Collection

Methods are determined by the nature of the research question posed

observation - looking at non verbal/verbal behaviour by notes, audio/videointerviews - unstructured or semi-structuredtext - diaries, case notes, lettersfocus groups - semi-structured or unstructured

Are the methods used suitable for the question?Is it clear how the data were collected?Is it clear where the data were collected?Has the researcher considered ethical issues?

Reflexivitytypes of interviewquestions asked

venuearea being

studied

meaning given to data

researcher

Ethics

• consent

• confidentiality

• professional responsibility

• reporting

Need to consider:

Aim is to give understanding to participants’ experiences

• interpretations are made by the researcher/s from participants’ descriptions or from observations e.g. thematic analysis - researcher/s reads the transcribed data, re-reads it and codes it into themes/categories

Is the method of analysis clear?Does it use all of the data?Would another researcher make a similar interpretation?Are alternative interpretations explored?Respondent validation?

4. Data Analysis

“…it was too constricting, I felt pressurized intotaking the medication for a longer time than I thoughtnecessary”

“… I felt I ought to see it through because it might help me, but I’m not sure I really believed it would”

“…it seemed like a good idea at the time, to stop feeling off colour all the time, but I also felt guilty if I ever missed a dose and then I thought what the hell”

Triangulation

Methods

• interviews

• observations

• text

• questionnaire

Sample group

• patients

• professionals

• carers

Is there a clear statement of the aims of the study ?

Is a qualitative research design appropriate ?

How and why have participants been selected ? Is the process described and justified?

How were the data collected? Are the setting and methods described adequately and any modifications discussed?

Questions to apply to qualitative studies:

Consider your appraisal of the paper: how useful is the paper to you?

The value of research

http://www.phru.nhs.uk/Pages/PHD/resources.htm

Critical Appraisal Skills Programmemaking sense of evidence

Critical appraisal of Critical appraisal of qualitativequalitative researchresearch