Loading...
An adaptive trimming approach to Bayesian additive regression trees
Cao, Taoyun Wu, Jinran Wang, You-Gan
Cao, Taoyun
Wu, Jinran
Wang, You-Gan
Author
Abstract
A machine learning technique merging Bayesian method called Bayesian Additive Regression Trees (BART) provides a nonparametric Bayesian approach that further needs improved forecasting accuracy in the presence of outliers, especially when dealing with potential nonlinear relationships and complex interactions among the response and explanatory variables, which poses a major challenge in forecasting. This study proposes an adaptive trimmed regression method using BART, dubbed BART(Atr) to improve forecasting accuracy by identifying suspected outliers effectively and removing these outliers in the analysis. Through extensive simulations across various scenarios, the effectiveness of BART(Atr) is evaluated against three alternative methods: default BART, robust linear modeling with Huber’s loss function, and data-driven robust regression with Huber’s loss function. The simulation results consistently show BART(Atr) outperforming the other three methods. To demonstrate its practical application, BART(Atr) is applied to the well-known Boston Housing Price dataset, a standard regression analysis example. Furthermore, random attack templates are introduced on the dataset to assess BART(Atr)’s performance under such conditions.
Keywords
robust regression, outliers, adaptive trimmed regression, Bayesian additive regression trees, forecasting
Date
2024
Type
Journal article
Journal
Book
Volume
Issue
Page Range
6805-6823
Article Number
ACU Department
Institute for Positive Psychology and Education
Faculty of Education and Arts
Institute for Learning Sciences and Teacher Education (ILSTE)
Faculty of Education and Arts
Institute for Learning Sciences and Teacher Education (ILSTE)
Relation URI
Event URL
Open Access Status
Open access
License
CC BY 4.0
File Access
Open
Notes
© The Author(s) 2024
The work is supported by the Australian Research Council project (Grant No. DP160104292) and “Chunhui Program” Collaborative Scientific Research Project (202202004).
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
The work is supported by the Australian Research Council project (Grant No. DP160104292) and “Chunhui Program” Collaborative Scientific Research Project (202202004).
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.