[Submitted on 13 Nov 2026]
View a PDF of the paper titled Clustering-Based Artificial Tree Ensembles for Random Forest Approximation, by Lea L. Kronziel and 3 other authors
Abstract:Random Forests (RFs) offer strong prediction performance but are difficult to interpret. Most representative trees (MRTs) and artificial representative trees (ARTs) provide surrogate explanations, but a single tree may miss patterns within a forest. We investigate benefits and limitations of clustering-based representative tree ensembles for RF surrogate modeling and assess the contribution of similarity-based clustering relative to random tree partitions. Using linear and nonlinear simulations and regression benchmarks, we evaluate fidelity, prediction accuracy, complexity, and prediction stability against equally sized ensembles of top-ranked MRTs and randomly selected trees. Increasing ensemble size generally improves fidelity, accuracy, and prediction stability. ART ensembles show higher fidelity in simulations and often greater prediction stability for small ensembles. Compared with random tree partitions, similarity-based clustering generally improves ART fidelity in simulations and often on benchmarks. On benchmark datasets, MRT-based ensembles generally achieve higher fidelity and prediction accuracy, whereas ART ensembles have fewer terminal nodes. ART ensembles provide compact surrogates when reduced complexity matters and their fidelity and prediction accuracy meet application requirements. These findings clarify both the trade-offs of representative tree ensembles as RF surrogates and the contribution of similarity-based clustering beyond random clustering.
Submission history
From: Lea Louisa Mairhöfer [view email]
[v1]
Fri, 13 Nov 2026 10:45:50 UTC (7,063 KB)
![[2611.18803] Clustering-Based Artificial Tree Ensembles for Random Forest Approximation [2611.18803] Clustering-Based Artificial Tree Ensembles for Random Forest Approximation](https://techwavedispatch.com/wp-content/uploads/2026/11/261118803-Clustering-Based-Artificial-Tree-Ensembles-for-Random-Forest-Approximation-1024x597.png)