ugent mis research seminar december 2014
TRANSCRIPT
![Page 1: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/1.jpg)
1/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Jan ClaesTeaching assistant : PhD 2009 – 2015
Supervisors UGent : Geert Poels & Frederik GaillySupervisors TU/e : Paul Grefen & Irene Vanderfeesten
Investigating the process of process modeling and its relation to model quality
![Page 2: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/2.jpg)
2/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Comprehensive overview PhD
![Page 3: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/3.jpg)
3/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
![Page 4: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/4.jpg)
4/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
P1
Chapter 1• BPM conference paper P1• Explorative research• Hypothesis building• Observational modeling sessions• Structured process modeling relates to
model quality• Correlation, t-test, linear regression
![Page 5: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/5.jpg)
5/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
Chapter 2• BPM workshop paper P1• ISEB journal paper A1• PPMChart visualization• Observational modeling sessions• Visualization theories
DESIGN SCIENCE
Process visualization
P1 A1
![Page 6: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/6.jpg)
6/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
Chapter 3• CAiSE workshop paper P1• ISF journal paper A1• Explanatory theory development• Structured Process Modeling Theory (SPMT)• Cognitive theories• Observational modeling sessions• Correlation, t-test, PLS-SEM, EGA
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
P1 A1
![Page 7: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/7.jpg)
7/29www.janclaes.info
DESIGN SCIENCEProcess model quality
improving modeling method
Overview
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
A1Chapter 4• Main contribution• Prescriptive theory, modeling method• Structured Process Modeling Method (SPMM)• > measure cognitive style• > determine modeling style
![Page 8: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/8.jpg)
8/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
Chapter 5• Tool support• Visualizing structure of model to help
modeler during model creation• Phased modeling
DESIGN SCIENCETool support
?
![Page 9: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/9.jpg)
9/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
How to test the developed theory (SPMT)?
![Page 10: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/10.jpg)
10/29www.janclaes.info
Research model
A B A determines BA B The more A, the more B+ A B The more A, the less B– A B A translates into B
learning style
degree of serialization
adopted serialization style
need for structure
field-dependency
– +
intrinsic cognitive load for modeling phases
intrinsic cognitive load for aggregation phases
cognitive overload
intrinsic cognitive load for strategy building phases
+ + +
serialization style fitstructuredness of serialization
– – – –
1 2 3
process model quality overall construction effort
+–
![Page 11: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/11.jpg)
11/29www.janclaes.info
Cognitive style
Need for structure
Learning styleField dependencySensory
Visual
Inductive
Active
Sequential
Intuitive
Auditory
Deductive
Reflective
Global
I ♥ ︎chaos I #$@&! chaos
DON’T SEE THE FOREST THROUGH THE TREES
![Page 12: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/12.jpg)
12/29www.janclaes.info
Observational modeling sessionJools experimental platformSimple modeling notation
activity – edge – start event – end event – xor gateway – and gateway
Experimental flow Cognitive tests Pre-survey Tool tutorial Modeling sessions Post-survey Interviews
![Page 13: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/13.jpg)
13/29www.janclaes.info
Cognitive testsFour cognitive tests
Operation Span Test Counting Span Test Reading Span Test Hidden Figures Test
Fully-automated in toolTaken at homeAvoiding cheating
Intrinsic motivation Limited cheat detection (score, time, tool focus)
![Page 14: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/14.jpg)
14/29www.janclaes.info
Pre-survey and post-surveyCognitive style
Need for structure scale Learning style scale
Cognitive load Intrinsic, extraneous, germane cognitive load scale
Prior knowledge domain, language, modeling
Cognitive fit language, modeling language, tool
Demographics
![Page 15: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/15.jpg)
15/29www.janclaes.info
Tool tutorial
![Page 16: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/16.jpg)
16/29www.janclaes.info
Modeling session
![Page 17: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/17.jpg)
17/29www.janclaes.info
InterviewsFeedback cognitive profileFeedback used modeling styleFeedback cognitive loadFeedback SPMTGeneral feedback
![Page 18: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/18.jpg)
18/29www.janclaes.info
Modeling style
Flow oriented modeling
![Page 19: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/19.jpg)
19/29www.janclaes.info
Modeling style
pausesnumber of big gaps
distancelines between
consecutive operations
progressnumber of operations
per 3 minutes
overlapnumber of overlapping
operations
alterationsnumber of non-green dots
![Page 20: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/20.jpg)
20/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Processing empirical data: statistical madness
![Page 21: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/21.jpg)
21/29www.janclaes.info
Modeling effectiveness and efficiencySemantic quality
Completeness & correctness (of content) Number of semantic errors
![Page 22: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/22.jpg)
22/29www.janclaes.info
Modeling effectiveness and efficiencySyntactic quality
Correctness (of syntax) Number of syntactic cognitive errors
![Page 23: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/23.jpg)
23/29www.janclaes.info
Modeling effectiveness and efficiencyTime
Time between start reading case and last operationEffort
Number of operations
![Page 24: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/24.jpg)
24/29www.janclaes.info
Research model
A B A determines BA B The more A, the more B+ A B The more A, the less B– A B A translates into B
learning style
degree of serialization
adopted serialization style
need for structure
field-dependency
– +
intrinsic cognitive load for modeling phases
intrinsic cognitive load for aggregation phases
cognitive overload
intrinsic cognitive load for strategy building phases
+ + +
serialization style fitstructuredness of serialization
– – – –
1 2 3
process model quality overall construction effort
+–
![Page 25: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/25.jpg)
25/29www.janclaes.info
CorrelationCognitive style
Mod
elin
g st
yle
Modeling resultCognitive load
![Page 26: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/26.jpg)
26/29www.janclaes.info
T-test
Learning style Need for structure Field dependency
Load
Synt
axTi
me
Effor
t
![Page 27: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/27.jpg)
27/29www.janclaes.info
PLS-SEM
![Page 28: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/28.jpg)
28/29www.janclaes.info
PLS-SEM
![Page 29: UGent MIS research seminar December 2014](https://reader035.vdocuments.us/reader035/viewer/2022070510/58ab7afc1a28ab3e738b4575/html5/thumbnails/29.jpg)
29/29www.janclaes.info
Thanks for you attention!
> Do you have feedback on my research plans? <> Do you have questions? <
http://www.janclaes.infoTwitter: @janclaesbelgium