marcus ormerod the university of salford - kt-equalkt-equal.org.uk/uploads/research...

65
Marcus Ormerod The University of Salford

Upload: hacong

Post on 16-Mar-2018

223 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Marcus Ormerod

The University of Salford

Page 2: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Usually concerned with a deep understanding of “real world” issues

Hypothesis generating

Insider researcher approach compatible

Techniques can be developed as research unfolds

Emerged from Social Science research

Still gaining credibility in some disciplines

Criticised for its subjective nature

Page 3: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Case Study

Action Research

Archival analysis

Ethnographic research

Feminist/Emancipatory research

Grounded theory

Surveys (can also be quantitative)◦ Interviews

◦ Questionnaires

◦ Observations

Page 4: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Cases can be anything you want to focus on

Cases are studied in their context and comparison can be made between them

Gives chance for in-depth study

Can use a variety of techniques to collect data

The timing of cases needs to fit with your study period

Page 5: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 6: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 7: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Play to strengths, be open about weaknesses

Work as a team

Give everyone a chance

Respect others views

Work towards a common goal

Communication should be inclusive

Create comfortable working environments

Page 8: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

The researcher is involved in the situation and trying to resolve a problem, or implement a change

More suitable to practitioners in the workplace

Resolves practical problems

Needs the organisation to commit to the project

Page 9: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 10: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Reviews existing documents and records

Assumes you can get access to the records

Assumes the documents are accurate reflection of what happened

Page 11: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Seeks to understand the life and customs of people in a particular culture

Involves participant observation

Needs careful ethical consideration

A very flexible approach is needed

Difficult for the novice researcher

Page 12: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Usually applied with research involving groups that are marginalised by a society

Researching with, rather than on, a group

Tendency towards qualitative data collection

Page 13: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Researcher immerses themselves in area to be studied in order to determine the research questions that emerge

Usually not theory driven

Requires careful coding and analysis of qualitative data

Page 14: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 15: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

So what‟s with this ageing society thing?

Page 16: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

„The interview is a kind of conversation – a conversation with a purpose‟ (Robson 2003)

„The interview is initiated by the interviewer for the specific purpose of obtaining research relevant information and focussed by him on content specified by research objectives of systematic description, prediction or explanation‟ (Cohen and Manion 1989:307)

„Interviewing is a powerful way of helping people to make explicit things that have hitherto been implicit –to articulate their tacit knowledge, feelings and understandings‟

(Arksey & Knight 1993:32)

Page 17: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Fully structured – predetermined set of questions are asked; responses are recorded on a standardised schedule; in effect similar to a questionnaire

Semi-structured – set of questions worked out in advance, but these may change during the interview

Unstructured – completely informal; there is a general issue to be discussed but the conversation develops as it goes along; also called “non directive”

Page 18: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

There is a need to attain highly personalised data

There are opportunities for probing

A good response rate is important

Participants have difficulty with language

Participants would struggle with alternative techniques such as a questionnaire

Page 19: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Can test hypotheses, or identify variables and their relationships with each other

Alternative method to postal survey low response rate

Flexible and adaptable way of finding things out

Interviewer can pick up on non verbal communication

Interviewer can follow-up interesting responses and probe

Potential for rich and highly illuminating data –participants personal knowledge, values, preferences and attitudes

Complimentary other research techniques (triangulation)

(Cohen and Manion 1997, Gray 2004, Robson 2003)

Page 20: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Time consuming – (less than 30 minutes unlikely to get good data; more than one hour participant has had enough)

Further time consuming – preparation, during the interview and post interview

Some groups of people do not want to be interviewed

Data can be affected by the characteristics of the respondents

Participants may feel anonymity is compromised by interview process

Participants may not accurately report their beliefs, attitudes, etc.

Page 21: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 22: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Please consider the following questions….

1. Do you like the design of the paper?

2. Why?

3. Is it easy to open?

4. Did the taste / flavour of the sweet meet your expectations?

5. Did the texture of the sweet meet your expectations?

6. Anything else you would like to add ….

Page 23: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Have their roots in focus groups for market research

Increasing popularity over the last 10 years

Typically small group of 8-10 people

Used to explore issues / preferences

Follows the principles of one-to-one interviews

Unlikely to be very structured

Typically would not use a questionnaire in the group

context

Page 24: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 25: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Useful as an exploratory study

Less time consuming than one-to-one interviews

Used to gain consensus and agreement

Allows for a variety of ideas to emerge

Group members can contribute to the stimulation of new ideas

Page 26: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Heavily reliant on recording of conversation

Very difficult to record exactly who said what

Needs a well organised facilitator

Needs a good facilitator to manage group dynamics and over-enthusiastic participants

Page 27: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Listen more than you speak

Ask questions in a straightforward, clear and non-threatening way

Send the participant a copy of the questions in advance

Avoid cues which lead the participant to respond in a particular way

Record the interview in a number of formats

Transcribe the interview and ask the participant to sign it off

Maintain anonymity of the participant

Ensure ethical guidelines are followed

Consider personal safety

Page 28: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 29: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Interviews with 200 people to find out their likes and dislikes (preferences) for design features of the external environment and the reasons for their preferences, so we asked about footways, crossing the road, seating, toilets, public art, street greenery, signage for example

Page 30: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Consent Form for Research Project: Inclusive Design for Getting Outdoors (I‟DGO)

I confirm that I have read and understand the information sheet for the above study and have had the opportunity to ask questions.I understand that my participation is voluntary and that I am free to withdraw at any time, without giving reason.I understand that my name will not be used in publications.

I agree to take part in the interview for the above study.I agree to the interview being tape-recorded.

Name of Participant DateAddress and telephone number of participant

Name of Researcher Date

Page 31: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 32: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 33: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

E8 Seating

05

10152025303540

traditional

wooden,

back and arm

rests

modern

wooden,

back rest

stone bench metal, back

rest

Page 34: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Participants keen to give you their life experiences

Researcher from Croatia so participants wanted to talk about World War 2

Comprehensive and structured questionnaire format for the interview

The questionnaire was far too long and participants became both bored and tired

Participants gave long answers to the first sections of the questionnaire

We asked the most important questions last

We are still analysing some of the data (2 years later!)

We formed good relationships with some of the participants

Page 35: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 36: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 37: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Observation of people

◦ Overt

◦ Covert

Observation of objects

◦ Physical measures of erosion, or accretion

◦ Placement of objects within the space

Page 38: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

There are 2 polar extremes (Saunders et al 2000) –

Participant Observation – qualitative (text) approach,

„the meanings people give to their actions‟ (Gray 2004)

The complete participant

The marginal participant

The participant as observer

The observer as participant

Structured Observation – quantitative (numbers) approach,

„the frequency of actions‟ (Gray 2004)

Page 39: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 40: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

„Interview and questionnaire responses are notorious for discrepancies between what people say they have done, or will do, and what they did‟ (Oskamp 1977, Hanson 1980 cited in Robson 2003)

Useful at the initial exploratory stage of research to help inform hypothesis development (typically the observation would be unstructured)

Useful as a supportive or supplementary technique to complement other data collection methods

Can provide a rich picture „an appropriate technique for getting at “real life” in the “real world”‟ (Robson 2003)

Page 41: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 42: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Robson defines Participant Observation as

„The observer seeks to become some kind of member of

the observed group. This involves not only a physical

presence and a sharing of life experiences, but also entry

into their social and symbolic world through learning their

social conventions and habits, their use of language and

non verbal communication etc‟ (Robson 2003)

Quite immersive !

Page 43: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

The observer conceals that they are an observer, acting as naturally as possible, and seeking to become a full member of the group

An example cited in Robson (2003) is Festinger et al (1956) who infiltrated a sect who predicted the destruction of the world on a particular date

“Research from a covert or manipulative perspective is generally not acceptable” (Kirby and McKenna 1989)

Page 44: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

The role as a participant is marginal (small) but the role is still covert but more acceptable, so examples would be as a passenger on a train observing the behaviour of fellow passengers

Zeisel (1984:119) however suggests that just because you know what role you are taking, do not assume this is obvious to those being observed. He gives the example of a marginal observer taking the role of spectator watching a football game in the local park, but the footballers may think he is the local park attendant about to stop them playing on the grass

Page 45: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

The role of the observer is made clear to the group

The role is made clear. The observer then tries to establish close relationships with the group, so by participating in activities etc the observer has a dual role as both observer and participant.

Because the role is made clear, gaining the trust of the group is very important

Page 46: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

The observer is known to the group as an observer but takes no part in the activity (Gold 1958 cited in

Robson 2003)

Page 47: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

We are not counting, we are collecting data on the meanings people give to their actions

Based on field notes the observer would typically record: Key quotations and phrases

Observation of verbal behaviours

Observation of non verbal behaviours

Time of events and activities

Observers views and feelings at the time of observation

(Berg 1995 cited in Gray 2004, Gray 2004)

Limit the time in the field (Berg 1995 suggests 1 hour in the field = minimum 4 hours write-up, write up full notes immediately)

Page 48: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Structured observation tends to be detached “pure” observation as a way of quantifying behaviour

The key feature is the development of a coding scheme – which can be a category system or checklist and its use by trained observers

Category system = small number of items fairly general in nature

Checklist = long series of items which can be recorded

Coding schemes discussed further in Walker 1985 (cited in Robson 2003)

Page 49: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Gives reliable data because working off a checklist

Researcher can be objective (because working off a checklist)

Can be used across different observational sites (so good replication)

Data generated is easier to analyse than data from participant observation methods

Page 50: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Questionnaires - snapshot

Postal

Delivery and collection

face-to-face

telephone

electronic

Interviews - snapshot

face-to-face (individual or group)

telephone

electronic

Panel surveys - longitudinal

Page 51: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 52: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Probability samples simple random

systemic

stratified

cluster

multi-stage

Non-probability samples quota

dimensional

convenience

purposive

snowball

Page 53: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Data collection

◦ Quantitative: Emphasis on numeric data

◦ Qualitative: Emphasis on non-numeric data in the

form of words and phrases

Use of statistics

◦ Descriptive statistics: Data is presented in variety

of ways, characteristics identified

◦ Inferential Statistics: To draw conclusions about

the population

Page 54: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Code quantitative data for entry into statistical package

Identify markers for themes and trends in qualitative data

Page 55: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Patterns, themes, trends, categories

Explanation-building

Rich pictures

Environmental-behaviour analysis

Triangulation with other methods

Page 56: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Counting - categorising data and measuring frequency

Patterning - noting recurring patterns or themes

Clustering - grouping items with similar characteristics

Factoring - grouping variables into hypothetical factors

Relating variables - relationships

Building causal networks

Page 57: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Clarify the nature of the initial relationships

◦ is it causal?

Account for unexpected findings

Check for robustness of the initial findings relationships

◦ is the pattern likely to apply only to this sample, does it work for subgroups, does it persist with different indicators?

Eliminate alternative explanations of the findings

Page 58: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Khan 2008

Page 59: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Reliability subject error

subject bias

observer error

observer bias

Construct validity face validity

predictive criterion validity

Page 60: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Having Fun!!!!

Page 61: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 62: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached
Page 63: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

SURFACE Inclusive Design Research CentreThe University of SalfordSOBE 4th Floor Maxwell BuildingSalford, England, M5 4WTTel +44 (0)161 295 5405Fax +44 (0)161 295 5011Website www.surface.salford.ac.uk

That‟s all for now folks!

Thanks

Page 64: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Arksey, H & Knight P (1999) Interviewing for social scientists, London, Sage.

Berg, BL (1985) Qualitative research methods for the social sciences, Needham Heights, MA, Allyn & Bacon

Cohen, L & Manion, L (1989) Research methods in education, London, Routledge

Crotty ,M (1998) The foundation of social science research: meaning and perspectives in the research process, London, Sage

Festinger, I, Riecken, HW & Schachter, S (1956) When prophecy fails, New York, Harper and Row

Gray DE (2004) Doing research in the real world, London, Sage

Khan, C. 2008. Doing Qualitative Research Using Your Computer: A Practical Guide. London: Sage

Kirby, S & McKenna, K (1989) Experience, research, social change: methods from the margins, Toronto, Garamond

Page 65: Marcus Ormerod The University of Salford - KT-EQUALkt-equal.org.uk/uploads/research methods/marcus.pdf · “Research from a covert or ... Structured observation tends to be detached

Malinowski, B (1922) Argonauts of the western pacific, London, Routledge and Kegan Paul

Malinowski, B (1935ª) Coral gardens and their magic volume 1, London, Routledge and Kegan Paul

Malinowski, B (1935b) Coral gardens and their magic volume 2, London, Routledge and Kegan Paul

Robson, C (2003) Real world research, Oxford, Blackwells

Saunders, M, Lewis, P & Thornhill, A (2000) Research methods for business students, London, Prentice Hall

Walker, R (1985) Doing research: a handbook for teachers, London, Methuen

Zeisel, J (1984) Inquiry by design: tools for environment behaviour research, Cambridge, Cambridge University Press