q methodology and earth system governance
TRANSCRIPT
![Page 1: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/1.jpg)
Institute for Environmental Studies (IVM)
Q Methodology and Earth System
Governance
Sofia Frantzi
SENSE PhD Summer School
Amsterdam, 24-31 August 2008
![Page 2: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/2.jpg)
Outline
• Background
• Doctoral research
• Q methodology
• Examples of Q
• Current research – ESG
• Application of Q in ESG
![Page 3: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/3.jpg)
Background
• BSc – Agriculture
– Specialisation Agricultural Economics
• MSc – Integrated Environmental Studies
• Work in private sector
– NGO/Research Centre – Environmental
Management
• PhD – International Environmental
Politics
![Page 4: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/4.jpg)
Doctoral research
• Effectiveness of International
Environmental Regimes
– The Mediterranean Action Plan /
Barcelona Convention
![Page 5: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/5.jpg)
Regime theory
• Debate concerning environmental regime
effectiveness
• On one hand – institutional approaches
focusing on institutional performance
• On the other – recent attempt to include
environmental result as a measurement of
effectiveness
![Page 6: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/6.jpg)
‘Epistemic Communities’
• Peter M. Haas (1989, 1990)
• Highlights the role of knowledge-based
‘epistemic communities’ consisting of
specialists responsible for articulating policies
and identifying the national interest
• Focuses on the groups of people who initiate
cooperation rather than on which states are the
leading actors who start the process
![Page 7: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/7.jpg)
Approach and methodology
• Interdisciplinary approach examining both institutional and environmental effectiveness
• Combination of methods
– Quantitative: Statistical analysis of environmental data
– Qualitative: In-depth interviews and analysis of official documents
– Q methodology, a qualitative-quantitative technique to reveal discourses
![Page 8: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/8.jpg)
Q methodology
• Originated in psychology (Stephenson, 1953)
• Combines qualitative and quantitative research characteristics
– Qualitative
• extracts subjective data from the respondents about values and beliefs
• does not require large population samples in contrast with other survey techniques
– Quantitative
• data collection and analysis involve statistical and mathematical techniques
![Page 9: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/9.jpg)
Q methodology steps
1. Identification of the theme or area of study and the population sample
2. Creation of a series of opinion statements on the topic
3. Reduction of the statements to a manageable number
4. Scoring of the statements by the participants according to agreement
5. Statistical analysis
6. Interpretation of the factors extracted by the statistical process so as to present social discourses
![Page 10: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/10.jpg)
Q methodology step 1
• Identification of the theme or area of
study and the population sample
– General theme
– Specific case study
– Stakeholder groups
![Page 11: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/11.jpg)
Q methodology step 2
• Creation of a series of opinion statements on the topic
– Have to be statements actually phrased by the stakeholders
• Structured or semi-structured interviews
• Literature such as newspapers, magazines, ethnographic studies, stakeholder conference proceedings
– Usually number of statements is around or more than 300
![Page 12: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/12.jpg)
Q methodology step 3
• Reduction of the statements to a
manageable number
– 36 statements are sufficient
– 4 x 4 matrix (Dryzek & Berejikian
1993)
Discourse Element Type of Claim
Ontology Agency Motivation Relationships
Definitive
Designative
Evaluative
Advocative
![Page 13: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/13.jpg)
Q methodology step 4
• Scoring of the statements by the
participants according to agreement
– Usually 9 or 11 point scale
– Some encourage a forced quasi-normal
distribution
– Each individual’s scoring is one Q sort
![Page 14: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/14.jpg)
Q methodology step 5
• Statistical analysis
– Correlation of Q sorts with each other
– Factor analysis of the inter-correlation
matrix
– Factor rotation
– Factors extracted are ‘ideal Q sorts’
around which all the closest Q sorts are
gathered
![Page 15: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/15.jpg)
Q methodology step 6
• Interpretation of the factors extracted by
the statistical process so as to present
social discourses
– The factors – or now discourses –
establish patterns within and across
individuals, unlike standard survey
analysis, which finds patterns across
individual traits, such as gender, age,
class
![Page 16: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/16.jpg)
Q methodology advantages
• Does not require large population samples in order to produce statistically significant results
– Only 12 participants responding to as few as 36 statements are enough to provide statistically valid results (Barry & Proops, 1999)
• Limits research bias by using statements which are generated purely by the participants and not imposed by the researcher
![Page 17: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/17.jpg)
Q methodology disadvantages
• Despite the easy statistical procedure, the
initial stages of the research design
(carrying out interviews, generating and
carefully selecting the statements) are
very intensive and time consuming
• The different discourses on the theme
revealed through a specific case study,
might not be identical to discourses on
the same theme while examining a
different case
![Page 18: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/18.jpg)
Examples of Q
• Barry & Proops 1999
• Dryzek & Berejikian 1993
• Frantzi et al. 2007
• Takshe et al. in preparation
![Page 19: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/19.jpg)
Example of Q on effectiveness
• 25 participants
• 44 statements
• 4 discourses
– International political cooperation
– Legal implementation & environmental
performance
– Practical versus political effectiveness
– Governance through participation
![Page 20: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/20.jpg)
Current research – ESG
• ModelGIGS project
• IVM – MNP collaboration
• 2,5 years research endeavour
• The project aims at:
– Examining the possibility of integrating governance and institutions into more formalised evaluation and forecasting methodologies, such as modelling, computer simulation and scenario development
![Page 21: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/21.jpg)
Context: Explorative Study
• Study on existing multi-method approaches to examine governance and institutions
– Qualitative and Quantitative approaches to measuring effectiveness, including Potsdam/Oslo measurement and database projects
– Rational choice, game theory
– Computer simulation and qualitative modelling approaches
![Page 22: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/22.jpg)
Research Questions
• How can effectiveness of international
environmental and other related regimes
be measured?
• What types of institutional design are
likely to increase the effectiveness of
international regimes?
• How can these criteria of effectiveness
and institutional design be incorporated
into computer-based modelling?
![Page 23: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/23.jpg)
Approach
• Our research approach is based on ideas
within political science and International
Relations that focus on:
– Problem structure
&
– Institutional design
(e.g. Young; Breitmeier, Zurn, Young; Miles et al.; Wettestad)
![Page 24: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/24.jpg)
Understanding Institutional Effectiveness
• Two steps
– 1st step: Identification of the key features
of the issue and the issue-area (problem
structure: problem characteristics,
politics, actors)
– 2nd step: Definition of the nature of the
institutional arrangements needed to
mitigate the problem, or find ways to
adapt to its impacts (institutional design:
design options)
![Page 25: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/25.jpg)
The challenge
“How do we translate qualitative
theoretical knowledge on institutions and
governance into quantifiable indicators or
variables?”
![Page 26: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/26.jpg)
Project rationale – theory
1. General literature review of problem structure and institutional design
&
2. Research on discourses on institutional effectiveness in a given policy area
3. Proposed institutional design and relevant modelling variables
![Page 27: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/27.jpg)
Project rationale – application
4. Ex post evaluation of policy
effectiveness
&
5. Model-based ex ante evaluation of
policy effectiveness
![Page 28: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/28.jpg)
Drivers
Institutions
• Land use
• Bioenergy
• Trade
etc.
• FAO
• World Food
Programme
• World Bank
etc.
Food Security
Practices Organisations
• Climate
change
etc.
Policy area – Food Security
Food systems
![Page 29: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/29.jpg)
Application of Q in ESG
• Within the framework of the ModelGIGS
project we want to investigate discourses on
institutional effectiveness in a given policy area
– i.e. food security
• Stakeholders from various informal and formal
institutions dealing with food security will be
involved
• The resulting discourses combined with
literature will feed into suggestion of modelling
variables for our scenario development
![Page 30: Q Methodology and Earth System Governance](https://reader036.vdocuments.us/reader036/viewer/2022071603/613d7827736caf36b75db293/html5/thumbnails/30.jpg)
Thank you…