Heng-Li Yang
ABSTRACT
In recent years, more and more studies have applied hybrid models in order to improve the performance of traditional neural networks. By combining particle swarm optimization and neural network, this research proposes a new hybrid neural prediction algorithm named as PSONN. The algorithm was applied to Pima Indians Diabetes Database and compared with eight other algorithms including Logistic regression, Ridge regression, Lasso regression, Linear Discriminant Analysis, Quadratic Discriminant Analysis, Random Forest, Gradient Boosting Machine, and Adam (a neural network algorithm). The findings indicated that the proposed algorithm had higher accuracy and stability, but it took more time to execute. It is suggested that, future research could apply parallelization technology for reducing execution time.
- Kleinbaum, David G., Klein, Mitchel. 2010. Logistic Regression. Springer-Verlag New York. https://doi.org/10.1007/978-1-4419-1742-3Google Scholar
- Edwin Hoerl and Robert W. Kennard. 1970. Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics 12, 1, 55-67. https://doi.org/10.1080/00401706.1970.10488634Google Scholar
- Robert Tibshirani. 1996. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58, 1, 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.xGoogle ScholarCross Ref
- Alan Julian Izenman. 2013. Modern Multivariate Statistical Techniques. 237-280. Springer, New York, NY. https://doi.org/10.1007/978-0-387-78189-1_8Google Scholar
- Alaa Tharwat. 2016. Linear vs. quadratic discriminant analysis classifier: a tutorial. International Journal of Applied Pattern Recognition 3, 2, 145-180. https://doi.org/10.1504/IJAPR.2016.079050Google ScholarCross Ref
- Tin Kam Ho. 1995. Random decision forests. In Proceedings of 3rd international conference on document analysis and recognition. Montreal, Quebec, Canada. 278-282. https://doi.org/10.1109/ICDAR.1995.598994Google Scholar
- Alexey Natekin and Alois Knoll. 2013. Gradient boosting machines, a tutorial. Frontiers in neurorobotics 7, 21. https://doi.org/10.3389/fnbot.2013.00021Google Scholar
- Kur Hornik, Maxwell Stinchcombe and Halber White. 1989. Multilayer feedforward networks are universal approximators. Neural networks 2, 5, 359-366. https://doi.org/10.1016/0893-6080(89)90020-8Google Scholar
- Diederik P. Kingma, Jimmy Ba. 2017. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.Google Scholar
- El-Ghazali Talbi. 2013. Hybrid metaheuristics. Springer, Heidelberg, Berlin. http://dx.doi.org/10.1007/978-3-642-30671-6Google Scholar
- Andréa da Silva Pereira, Álvaro Daniel Teles Pinheiro, Maria Valderez Ponte Rocha, Luciana Rocha B. Gonçalves and Samuel Jorge Marques Cartaxo. 2020. Hybrid neural network modeling and particle swarm optimization for improved ethanol production from cashew apple juice. Bioprocess and Biosystems Engineering, 1-14. https://doi.org/10.1007/s00449-020-02445-yGoogle Scholar
- R. Dineshkumar, Gunaseelan Dhanarajan, Sukanta Kumar Dash and Ramkrishna Sen. 2015. An advanced hybrid medium optimization strategy for the enhanced productivity of lutein in Chlorella minutissima. Algal Research 7, 24-32. https://doi.org/10.1016/j.algal.2014.11.010Google ScholarCross Ref
- R. Eberhart and J. Kennedy. 1995. A new optimizer using particle swarm theory. In MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science. Nagoya, Japan, 39-43. https://doi.org/10.1109/MHS.1995.494215Google Scholar
- Jack W. Smith, J.E. Everhart, W.C. Dickson, W.C. Knowler, and R.S. Johannes. 1988. Using the ADAP Learning Algorithm to Forecast the Onset of Diabetes Mellitus. In Proceedings of the Annual Symposium on Computer Application in Medical Care. 261-265.Google Scholar
Recommendations
A Modified Particle Swarm Neural Network Based on Local Chaotic Optimization Strategy
ISCID '12: Proceedings of the 2012 Fifth International Symposium on Computational Intelligence and Design - Volume 02BP neural network is an important type of neural network that has good approximation property and generalization ability. However, it often converges to local optima in implementation. the particle swarm optimization (PSO) is a global optimization ...
A New Particle Swarm Optimization Algorithm for Neural Network Optimization
NSS '09: Proceedings of the 2009 Third International Conference on Network and System SecurityThis paper presents a new particle swarm optimization (PSO) algorithm for tuning parameters (weights) of neural networks. The new PSO algorithm is called fuzzy logic-based particle swarm optimization with cross-mutated operation (FPSOCM), where the ...
Augmentation of Elman Recurrent Network Learning with Particle Swarm Optimization
AMS '08: Proceedings of the 2008 Second Asia International Conference on Modelling & Simulation (AMS)Despite a variety of Artificial Neural Network (ANN) categories, Backpropagation Network (BP) and Elman Recurrent Network (ERN) are the widespread modus operandi in real applications. However, there are many drawbacks in BP network, for instance, ...
Comments