• Advestis

A New Method to Compare the Interpretability of Rule-Based Algorithms

Dernière mise à jour : 26 nov. 2021

V. Margot and G. Luta. MDPI AI 2021.

Abstract: Interpretability is becoming increasingly important for predictive model analysis. Unfor-

tunately, as remarked by many authors, there is still no consensus regarding this notion. The goal

of this paper is to propose the definition of a score that allows for quickly comparing interpretable

algorithms. This definition consists of three terms, each one being quantitatively measured with a

simple formula: predictivity, stability and simplicity. While predictivity has been extensively studied

to measure the accuracy of predictive algorithms, stability is based on the Dice-Sorensen index for

comparing two rule sets generated by an algorithm using two independent samples. The simplicity

is based on the sum of the lengths of the rules derived from the predictive model. The proposed

score is a weighted sum of the three terms mentioned above. We use this score to compare the

interpretability of a set of rule-based algorithms and tree-based algorithms for the regression case

and for the classification case.

Download Paper