A working likelihood approach to support vector regression with a data-driven insensitivity parameter
Journal article
Wu, Jinran and Wang, You-Gan. (2023). A working likelihood approach to support vector regression with a data-driven insensitivity parameter. International Journal of Machine Learning and Cybernetics. 14(3), pp. 929-945. https://doi.org/10.1007/s13042-022-01672-x
Authors | Wu, Jinran and Wang, You-Gan |
---|---|
Abstract | The insensitivity parameter in support vector regression determines the set of support vectors that greatly impacts the prediction. A data-driven approach is proposed to determine an approximate value for this insensitivity parameter by minimizing a generalized loss function originating from the likelihood principle. This data-driven support vector regression also statistically standardizes samples using the scale of noises different from conventional response scaling method. Statistical standardization together with probabilistic regularization based on a working likelihood function produces data-dependent values for the hyperparameters including the insensitivity parameter. The exact asymptotical solutions are provided when the noises are normally distributed. Nonlinear and linear numerical simulations with three types of noises (ϵ-Laplacian distribution, normal distribution, and uniform distribution), and in addition, five real benchmark data sets, are used to test the capacity of the proposed method. Based on all the simulations and the five case studies, the proposed support vector regression using a working likelihood, data-driven insensitivity parameter is superior and has lower computational costs. |
Year | 2023 |
Journal | International Journal of Machine Learning and Cybernetics |
Journal citation | 14 (3), pp. 929-945 |
Publisher | Springer |
ISSN | 1868-8071 |
Digital Object Identifier (DOI) | https://doi.org/10.1007/s13042-022-01672-x |
Scopus EID | 2-s2.0-85139614300 |
Open access | Published as ‘gold’ (paid) open access |
Page range | 929-945 |
Publisher's version | License File Access Level Open |
Output status | Published |
Publication dates | |
Online | 10 Oct 2022 |
Publication process dates | |
Accepted | 19 Sep 2022 |
Deposited | 17 Jul 2023 |
https://acuresearchbank.acu.edu.au/item/8z49x/a-working-likelihood-approach-to-support-vector-regression-with-a-data-driven-insensitivity-parameter
Download files
Publisher's version
OA_Wu_2023_A_working_likelihood_approach_to_support.pdf | |
License: CC BY 4.0 | |
File access level: Open |
72
total views35
total downloads1
views this month1
downloads this month