Criteria as a Prelude for Guiding Taxonomy Evaluation

Taxonomies are design science artifacts used by researchers and practitioners to describe and classify existing or future objects of a domain. As such, they constitute a necessary foundation for theory building. Yet despite the great interest in taxonomies, there is virtually no guidance on how to rigorously evaluate them. Based on a literature review and a sample of 446 articles, this study explores the criteria currently employed in taxonomy evaluations. Surprisingly, we find that only a minority of taxonomy building projects actually evaluate their taxonomies and that there is no consistency across the multiplicity of criteria used. Our study provides a structured overview of the taxonomy evaluation criteria used by IS researchers and proposes a set of potential guidelines to support future evaluations. The purposeful and rigorous taxonomy evaluation our study advances contributes to DSR by bridging the gap between generic evaluation criteria and concrete taxonomy evaluation criteria.