Training of feedforward neural networks for data classification using hybrid particle swarm optimization, mantegna levy flight and neighborhood search
Journal article
Tarkhaneh, Omid and Shen, Haifeng. (2019). Training of feedforward neural networks for data classification using hybrid particle swarm optimization, mantegna levy flight and neighborhood search. Heliyon. 5(4), pp. 1 - 32. https://doi.org/10.1016/j.heliyon.2019.e01275
Authors | Tarkhaneh, Omid and Shen, Haifeng |
---|---|
Abstract | Artificial Neural networks (ANNs) are often applied to data classification problems. However, training ANNs remains a challenging task due to the large and high dimensional nature of search space particularly in the process of fine-tuning the best set of control parameters in terms of weight and bias. Evolutionary algorithms are proved to be a reliable optimization method for training the parameters. While a number of conventional training algorithms have been proposed and applied to various applications, most of them share the common disadvantages of local optima stagnation and slow convergence. In this paper, we propose a new evolutionary training algorithm referred to as LPSONS, which combines the velocity operators in Particle Swarm Optimization (PSO) with Mantegna Lévy distribution to produce more diverse solutions by dividing the population and generation between different sections of the algorithm. It further combines Neighborhood Search with Mantegna Lévy distribution to mitigate premature convergence and avoid local minima. The proposed algorithm can find optimal results and at the same time avoid stagnation in local optimum solutions as well as prevent premature convergence in training Feedforward Multi-Layer Perceptron (MLP) ANNs. Experiments with fourteen standard datasets from UCI machine learning repository confirm that the LPSONS algorithm significantly outperforms a gradient-based approach as well as some well-known evolutionary algorithms that are also based on enhancing PSO. |
Keywords | computer science |
Year | 2019 |
Journal | Heliyon |
Journal citation | 5 (4), pp. 1 - 32 |
Publisher | Elsevier Inc. |
ISSN | 2405-8440 |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.heliyon.2019.e01275 |
Scopus EID | 2-s2.0-85063669934 |
Open access | Open access |
Page range | 1 - 32 |
Research Group | Peter Faber Business School |
Publisher's version | License |
Place of publication | United Kingdom |
https://acuresearchbank.acu.edu.au/item/87043/training-of-feedforward-neural-networks-for-data-classification-using-hybrid-particle-swarm-optimization-mantegna-levy-flight-and-neighborhood-search
Download files
Publisher's version
OA_Tarkhaneh_2019_Training_of_feedforward_neural_networks_for.pdf | |
License: CC BY-NC-ND 4.0 |
111
total views128
total downloads1
views this month1
downloads this month