TEC-MAP: A Taxonomy of Evaluation Criteria for Multi-modelling Approaches

Over the last fifteen years, various frameworks for data-aware process modelling have been proposed, several of which provide a set of evaluation criteria but which differ in their focus, the terminology used, the level of detail used to describe their criteria and how these are evaluated. In addition, there are well-established evaluation frameworks of a more general nature that can be applied to data-centric process modelling too. A comprehensive and unbiased evaluation framework for (multi-)modelling approaches that also caters for more general aspects such as understandability, ease of use, model quality, etc., does not yet exist and is therefore the research gap addressed in this paper. This paper addresses this gap by using existing evaluation frameworks and developing a taxonomy that is used to categorise all the criteria from existing evaluation frameworks. The results are then discussed and related to the challenges and concerns identified by practitioners.