an introduction to process miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · an...
TRANSCRIPT
![Page 1: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/1.jpg)
An introduction to Process Mining
Diogo R. Ferreira
DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018
![Page 2: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/2.jpg)
Introduction
• Example of a business process
• sequence of activities
• branching and parallel behavior
• process model vs. process instances
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 2
a. Fill out request
b. Approve request
c. Archive request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request
Requisitionapproved?
Yes
No
+ +
![Page 3: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/3.jpg)
Introduction
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 3
a. Fill out request
b. Approve request
c. Archive request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request
Requisitionapproved?
Yes
No
+ +
a b ca b d e f g ha b d e g f ha b d g e f h
![Page 4: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/4.jpg)
Introduction
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 4
a. Fill out request
b. Approve request
c. Archive request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request
Requisitionapproved?
Yes
No
+ +
a b ca b d e f g ha b d e g f ha b d g e f h
![Page 5: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/5.jpg)
Introduction
• Possible questions• what is the most frequent path?
• how many requests (%) get approved?
• how much time does the process (or each activity) take?
• does every instance comply with the model?
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 5
a. Fill out request
b. Approve request
c. Archive request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request
Requisitionapproved?
Yes
No
+ +
![Page 6: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/6.jpg)
Introduction
• Task allocation
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 6
ha a
bb b d g
fe f
ce
dgha
cb
u3 u4 u5 u6 u7 u8u2u1
tasks
users
a. Fil l out request
b. Approve request
c. Archive request
a. Fil l out request
b. Approve request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request+ +
a. Fil l out request
b. Approve request
c. Archive request
a. Fil l out request
b. Approve request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request+ +
![Page 7: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/7.jpg)
Introduction
• More possible questions• what is the distribution of work, i.e. who does what?
• how do users interact and collaborate with each other?
• what is the performance of each user in each activity?
• are certain resources being overloaded?
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 7
ha a
bb b d g
fe f
ce
dgha
cb
u3 u4 u5 u6 u7 u8u2u1
tasks
users
a. Fil l out request
b. Approve request
c. Archive request
a. Fil l out request
b. Approve request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request+ +
a. Fil l out request
b. Approve request
c. Archive request
a. Fil l out request
b. Approve request
d. Order product
e. Receive product
f. Updatestock
g. Handle payment
h. Close request+ +
![Page 8: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/8.jpg)
Event logs
• Example of an event log
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 8
![Page 9: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/9.jpg)
Event logs
• Process mining perspectives• control-flow perspective (task column)
• organizational perspective (user column)
• performance perspective (timestamp column)
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 9
![Page 10: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/10.jpg)
• Task transitions within each case id
Control-flow perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 10
![Page 11: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/11.jpg)
• Transition matrix
Control-flow perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 11
a b c d e f g h
a 3
b 1 2
c
d 1 1
e 2
f 1 1
g 1 1
h
![Page 12: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/12.jpg)
• Transition graph
Control-flow perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 12
![Page 13: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/13.jpg)
• Transition graph for a larger event log
• percentage of approvals: 5683 / (1866 + 5683) ≈ 75%
Control-flow perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 13
![Page 14: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/14.jpg)
• Improving the visualization• edge thickness
• activity counts
• node coloring
Control-flow perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 14
![Page 15: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/15.jpg)
• Handover of work
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 15
![Page 16: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/16.jpg)
• Transition matrix
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 16
u1 u2 u3 u4 u5 u6 u7 u8
u1 1
u2 1 1
u3 1 1
u4 1
u5 1
u6 1 2
u7 2
u8 1 1
![Page 17: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/17.jpg)
• Transition graph
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 17
![Page 18: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/18.jpg)
• Transition graph for a larger event log
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 18
![Page 19: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/19.jpg)
• Working together
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 19
![Page 20: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/20.jpg)
• Number of cases where each pair of users have worked together
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 20
u1 u2 u3 u4 u5 u6 u7 u8
u1 3 2 1 1 2 2 2
u2 3 2 1 1 2 2 2
u3 2 2 1 2 2 2
u4 1 1
u5 1 1 1 1 1 1
u6 2 2 2 1 2 2
u7 2 2 2 1 2 2
u8 2 2 2 1 2 2
![Page 21: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/21.jpg)
• Number of cases where each pair of users have worked together
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 21
![Page 22: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/22.jpg)
• Number of cases where each pair of users have worked together
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 22
![Page 23: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/23.jpg)
• Distribution of work
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 23
![Page 24: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/24.jpg)
• Distribution of work
Organizational perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 24
![Page 25: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/25.jpg)
• Timestamp difference between events
Performance perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 25
![Page 26: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/26.jpg)
• Timestamp difference between events
Performance perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 26
![Page 27: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/27.jpg)
• Timeline of events
Performance perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 27
![Page 28: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/28.jpg)
• Relative time
Performance perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 28
![Page 29: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/29.jpg)
• Activity duration
Performance perspective
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 29
![Page 30: An introduction to Process Miningweb.ist.utl.pt/diogo.ferreira/talks/ferreira18delix.pdf · An introduction to Process Mining Diogo R. Ferreira diogo.ferreira@tecnico.ulisboa.pt DELix](https://reader033.vdocuments.us/reader033/viewer/2022042209/5eaca653ea064e1086240d7b/html5/thumbnails/30.jpg)
Conclusion
• Where to go from here• process mining books
• A Primer on Process Mining: Practical Skills with Python and Graphviz, D. R. Ferreira (Springer, 2017)
• Process Mining: Data Science in Action, W. van der Aalst (Springer, 2016)
• process mining courses• Process Mining: Data Science in Action
https://www.coursera.org/learn/process-mining
• Introduction to Process Mining with ProMhttps://www.futurelearn.com/courses/process-mining
• process mining website• http://www.processmining.org
• process mining tools: ProM, Disco, etc.
© 2018 Diogo R. Ferreira DELix – Lisbon Winter School on Data Science and Engineering | February 15-17, 2018 30