Iterative rule extension for logic analysis of data: An MILP-based heuristic to derive interpretable binary classification from large datasets

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Data-driven decision making is rapidly gaining popularity, fuelled by the ever-increasing amounts of available data and encouraged by the development of models that can identify beyond linear inputoutput relationships. Simultaneously the need for interpretable prediction- and classification methods is increasing, as this improves both our trust in these models and the amount of information we can abstract from data. An important aspect of this interpretability is to obtain insight in the sensitivityspecificity trade-off constituted by multiple plausible input-output relationships. These are often shown in a receiver operating characteristic (ROC) curve. These developments combined lead to the need for a method that can abstract complex yet interpretable input-output relationships from large data, i.e. data containing large numbers of samples and sample features. Boolean phrases in disjunctive normal form (DNF) are highly suitable for explaining nonlinear input-output relationships in a comprehensible way. Mixed integer linear programming (MILP) can be used to abstract these Boolean phrases from binary data, though its computational complexity prohibits the analysis of large datasets. This work presents IRELAND, an algorithm that allows for abstracting Boolean phrases in DNF from data with up to 10,000 samples and sample characteristics. The results show that for large datasets IRELAND outperforms the current state-of-the-art and can find solutions for datasets
where current models run out of memory or need excessive runtimes. Additionally, by construction IRELAND allows for an efficient computation of the sensitivity-specificity trade-off curve, allowing for further understanding of the underlying input-output relationship.
Original languageEnglish
JournalINFORMS Journal on Computing
DOIs
Publication statusE-pub ahead of print - Jan 2024

Fingerprint

Dive into the research topics of 'Iterative rule extension for logic analysis of data: An MILP-based heuristic to derive interpretable binary classification from large datasets'. Together they form a unique fingerprint.

Cite this