Tying Process Model Quality to the Modeling Process: The Impact of Structuring, Movement, and Speed

Jan Claes, Irene Vanderfeesten, Hajo A. Reijers, Jakob Pinggera, Matthias Weidlich, Stefan Zugal, Dirk Fahland, Barbara Weber, Jan Mendling, Geert Poels
BPM 2012 International Conference, LNCS 7481, p. 33-48, 2012 (proceedings acceptance rate: 19%) pdf
The final publication is available via https://dx.doi.org/10.1007/978-3-642-32885-5_3

firstpage

Abstract. In an investigation into the process of process modeling, we examined how modeling behavior relates to the quality of the process model that emerges from that. Specifically, we considered whether (i) a modeler's structured modeling style, (ii) the frequency of moving existing objects over the modeling canvas, and (iii) the overall modeling speed is in any way related to the ease with which the resulting process model can be understood. In this paper, we describe the exploratory study to build these three conjectures, clarify the experimental set-up and infrastructure that was used to collect data, and explain the used metrics for the various concepts to test the conjectures empirically. We discuss various implications for research and practice of our three conjectures that were confirmed by the experiment.

Additional material.

  • The PPMCharts:
Figure 1: Visualization of the operation in the creation of one model by one modeler.
Figure 2: Process model as result of the modeling process in Figure 1.
Figure 3(a): More examples of the visualization of the operations in the process of process modeling.
Figure 3(b): More examples of the visualization of the operations in the process of process modeling.
Figure 3(c): More examples of the visualization of the operations in the process of process modeling.
Figure 3(d): More examples of the visualization of the operations in the process of process modeling.
  • The boxplots:
Figure 6(a): Boxplots for the metrics for conjecture 1 (MaxSimulBlock).
Figure 6(b): Boxplots for the metrics for conjecture 1 (PercNumBlockAsWhole).
Figure 7(a): Boxplots for the metrics for conjecture 2 (AvgMoveOnMovedElements).
Figure 7(b): Boxplots for the metrics for conjecture 2 (PercNumElementsWithMoves).
Figure 8(a): Boxplots for the metrics for conjecture 3 (TotCreateTime).
Figure 8(b): Boxplots for the metrics for conjecture 3 (TotTime).
  • The presentation:



Video by: UTTV