Fuzzy Gaussian Decision Tree

Krzystof Pałczyński; Magda Czyżewska; Tomasz Talaśka

doi:10.1016/j.cam.2022.115038

Fuzzy Gaussian Decision Tree

Abstract

The Decision Tree algorithm is one of the first machine learning algorithms developed. It is used both as a standalone model and as an ensemble of many cooperating trees like Random Forest, AdaBoost, Gradient Boosted Trees, or XGBoost. In this work, a new version of the Decision Tree was developed for classifying real-world signals using Gaussian distribution functions and a fuzzy decision process. The research was carried out on Power Quality Classification Dataset hosted on the platform kaggle.com for accessing the algorithm’s classification. The proposed algorithm modification produces a sparse tree of multidimensional Gaussian kernels performing fuzzy, proximity-based division of solution space instead of a typical Decision Tree performing definite space restrictions. The machine learning model can cluster samples based on the common pattern and evaluate the input’s similarity in a fuzzified fashion. The studies were conducted for the prediction of 6 classes of current. The proposed modification achieved the best accuracy and F1 score compared to the default Decision Tree and other machine learning algorithms.