identifying the variation in ways to deal
TRANSCRIPT
Identifying the variation of experiences when dealing with problems in complex systems.
John Mendoza Garcia1, 2, Monica E. Cardella1 William C. Oakes1
1Purdue University, IN2Pontificia Universidad Javeriana, Bogotá, Colombia,
South America
05/03/2023 Tool to Assess Interest in PP 2
Agenda
• Introduction• Summary of literature• Research Approach• Impact
05/03/2023 Tool to Assess Interest in PP 3
Introduction
• Introduction• Summary of
literature• Research
Approach• Impact
High order thinking skills
Technical knowledge
• Creativity• Critical
thinking• Design thinking• Problem
solving• Systems
thinking
Who is calling?
Eng. Professional
societies
Eng. Academics
Management Scientist
Thought leaders in Eng
Ed.Industry ABET
Policy makers
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 5
Why?
Technological systems
EnvironmentHuman systems
designing and implementing solutions – Sustainable products– Processes– Organizations– Public policies.– Etc.
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 6
We have been teaching Systems Thinking for several years…
• Why perception says… engineers lack its development? • Why research findings show failure in its learning?
But…
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 7
Curriculum design
Effective curriculum design
Achievement of learning goals
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 8
Curriculum design
Effective curriculum design
Achievement of learning goals
How can we know if my curriculum is working??
Guilty?
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 9
Curriculum design
05/03/2023 TravelGrant 9
Content
Assessment Pedagogy
We need to know effectiveness of teaching of Systems Thinking • Introduction
• Summary of literature
• Research Approach
• Impact
Assessment Triangle (Pellegrino, 2002)
05/03/2023 TravelGrant 10
Observation Interpretation
Cognition
• Introduction• Summary of
literature• Research
Approach• Impact
Research questionIteration 1
–How people develop systems thinking?
• Introduction• Summary of
literature• Research
Approach• Impact
What do we know about the development of systems thinking and its assessment?
- Studies from expert’s point of view- Lineal path based on Bloom: Hooper and Stave (2008)
- Studies from learner’s point of view (qualitative)- Frank, 2000
- 30 Laws for Capacity for Engineering systems thinking- Richmond, 2001
- A subset of 7 critical thinking skills- Davidz, 2006
- experiential learning, individual characteristics and supportive environments key to develop systems thinking
• Introduction• Summary of
literature• Research
Approach• Impact
Variation theory of learning
learning is about an increase of the amount of critical aspects and features the learner can discern and be focused on simultaneously [from a dimension or conception]. (Marton, 2014, p. 60
Learning can be seen as moving from one way of seeing and dealing with the problem to another more powerful (Marton, 2014)
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 14
This study’s research question
“what are the variations in the ways people experience dealing with problems in complex systems?”
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 15
• Introduction• Summary of
literature• Research
Approach• Impact
Engineering complex systems
Complexity
Environmental
Technological
Humans
05/03/2023 Tool to Assess Interest in PP 16
• Introduction• Summary of
literature• Research
Approach• Impact
Development of systems thinking from learner’s point of view
Davidz, H,. (2006)
Graphic from Richmond. (1990)
05/03/2023 Tool to Assess Interest in PP 17
Systems thinking inventoryand its test
Identify intuitive systemsthinking
Measuring change ofmental models
Assessment ofsystems thinking
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 18
Variation theory of learning
Transfer of learning Conceptual change
Cognitive/constructivist learning theories
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 19
• Introduction• Summary of
literature• Research
Approach• Impact
Phenomenography
• Understanding the variation in how “we “see” the world and how it “shows itself” to us (Marton, 2014, p. 122)
• Main assumption– limited number of qualitatively different ways
05/03/2023 Tool to Assess Interest in PP 20
• Introduction• Summary of
literature• Research
Approach• Impact
Phenomenography
Figure 1- Points of departure between phenomenography and other research approaches. Trigwell (2000)
05/03/2023 Tool to Assess Interest in PP 21
Data Collection
How many participants?– I will recruit 20 participants for this study• 10 students• 10 professionals
20 – 30 (Bowden, 2005)10-15 (Trigwell, 2000)10 (Harding, 2013)20 (Sandberg (2000), citing
Alexandersson (1994) who cited more than 1000 research and 50 doctoral theses)
17 Sandberg (2000)
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 22
Data Collection
• Undergraduate students–Random survey to capture variation
• Graduate/Professionals– Purposeful sampling –maximize variation
• Criteria for variation– Framework: Enablers of systems thinking
(Davidz,2006)
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 23
Data Collection
• Think aloud• 5 tasks tested – 2 chosen.
– Scene it! – Wolves and Rabbits (L. B. Sweeney & Sterman, 2007)– The manufacturing case: (L. Sweeney & Sterman, 2001)– The coffee challenge (Purzer, Ş. & Wertz, 2013). – Disaster relief scenario (Adams et al., 2010)
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 24
Data Analysis
Marton’s approach- Look for different ways to address the problem- Have them in one place- Rip them off their context and the participant- Define different categories- Define a hierarchy
- Simple to powerful
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 25
Data Analysis
Marton’s approach- Look for different ways to address the problem- Have them in one place- Rip them off their context and the participant- Define different categories- Define a hierarchy
- Simple to powerful
• Introduction• Summary of
literature• Research
Approach• Impact
05/03/2023 Tool to Assess Interest in PP 26
Data Analysis
• Introduction• Summary of
literature• Research
Approach• Impact
Expected outcome
Ways to address the task, from less to more powerful
05/03/2023 Tool to Assess Interest in PP 27
• Introduction• Summary of
literature• Research
Approach• Impact
• Maybe one of firsts theories cognitive theories about systems thinking development from engineering education
• Several disciplines and fields in academy and in industry– Assessment!– Curriculum design
Impact
05/03/2023 Tool to Assess Interest in PP 28
• Introduction• Summary of
literature• Research
Approach• Impact
• Current programs could support claims• Application of variation theory of learning
Impact
05/03/2023 Tool to Assess Interest in PP 29
Thank you …