Skip to main content
SpringerLink
Log in

Particle swarm optimization performance improvement using deep learning techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Deep learning is widely used to automate processes, improve performance, detect patterns, and solve problems. Thus, applications of deep learning are limitless. Particle swarm optimization is a computational method that optimizes a problem by trying to improve a candidate solution. Although many researchers proposed particle swarm optimization variants, each variant is unique and superior to the existing ones. Among them, inertia weight-based particle swarm optimization has its own identity. By adjusting the inertia weight, the performance of the swarm can be improved. This paper proposes two new particle swarm optimization models using the convolutional neural network and long short-term memory to predict the inertia weight in moving the swarm for improving the swarm performance. The performance of the two new inertia weight models is compared in terms of mean absolute error and standard deviation, with the existing inertia weight based particle swarm optimizations like constant inertia weight, random inertia weight, and linearly decreasing inertia weight particle swarm optimizations. Experiments are conducted with swarm sizes 50, 75, and 100 with dimensions 10, 15, and 25 using the five most commonly used benchmark functions. The results show that the new models have significant performance gain over existing constant, random and linearly decreasing inertia weight particle swarm optimization models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Amidi A, Amidi S. Recurrent Neural Network Cheatsheet/ https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-recurrent-neural-networks#architecture, Last Accessed on Apr 07 2021.

  2. Bansal JC, Singh PK, Saraswat M, Verma A, Jadon SS, Abraham A (2011) Inertia weight strategies in particle swarm optimization, Third World Congr. on Nature and Biologically Inspired Comput, Salamanca, 633–640

  3. Bonyadi MR, Michalewicz Z (2017) Impacts of coefficients on movement patterns in the particle swarm optimization algorithm. IEEE Trans Evol Comput 21(3):378–390

    Google Scholar 

  4. Chowdhury, Subrata, G, Ramya, Kolla, Bhanu, Donepudi, Babitha, Ismail, Mohammed, (2020), “Automated road safety surveillance system using hybrid CNN-LSTM approach,” Int J of Adv Trends in Comput Sci and Eng, Vol. 9, pp. 1767–1773.

  5. Cui Z, Shi Z (2009) Boid particle swarm optimisation. Int J Innov Comput Appl 2(2):77–85

    Article  Google Scholar 

  6. Engelbrecht AP (2007) Computational Intelligence: An Introduction, John Wiley and Sons, 2007, ch. 16, 289–358.

  7. Freitas D, Lopes LG, Morgado-Dias F (2020) Particle Swarm Optimisation: A Historical Review Up to the Current Developments. Entropy 22(3):1–36 Article No 362

    Article  MathSciNet  Google Scholar 

  8. Hammer B (2000) On the approximation capability of recurrent neural networks. Neuro Comput 31(1–4):107–123

    Google Scholar 

  9. Hochreiter S, Schmidhuber J (1997) Long Short-term Memory. Neural Comput 9(8):1735–1780

    Article  Google Scholar 

  10. Imambi S, Prakash KB, Kanagachidambaresan GR (2021) PyTorch. In: Prakash K.B., Kanagachidambaresan G.R. (eds) programming with TensorFlow. EAI/springer innovations in communication and computing. Springer, Cham., pp. 87-104, DOI: https://doi.org/10.1007/978-3-030-57077-4_10.

  11. Jha AK, Ruwali A, Prakash KB, Kanagachidambaresan GR (2021) Tensorflow basics. In: Prakash K.B., Kanagachidambaresan G.R. (eds) programming with TensorFlow. EAI/springer innovations in communication and computing. Springer, Cham., pp. 5-15, https://doi.org/10.1007/978-3-030-57077-4_2

  12. Kanagachidambaresan G.R., Prakash K.B., Mahima V. (2021) Programming tensor flow with single board computers. In: Prakash K.B., Kanagachidambaresan G.R. (eds) programming with TensorFlow. EAI/springer innovations in communication and computing. Springer, Cham., pp. 145-157, https://doi.org/10.1007/978-3-030-57077-4_12

  13. Kennedy J, Eberhart R (1995) Particle Swarm Optimization, in Proc. of IEEE Int Conf on Neural Networks, pp. 1942–1948.

  14. Kumar A, Singh BK, Patro BDK (2016) Particle swarm optimization: a study of variants and their applications. Int J Comput Appl 135(5):24–30

    Google Scholar 

  15. Kushwaha N, Pant M (2019) Modified particle swarm optimization for multimodal functions and its application. Multimed Tools Appl 78:23917–23947

    Article  Google Scholar 

  16. Lin YH, Hu YC (2018) Electrical energy management based on a hybrid artificial neural network-particle swarm optimization-integrated two-stage non-intrusive load monitoring process in smart homes. Processes 6(12):236

    Article  Google Scholar 

  17. Liu T, Yin S (2017) An improved particle swarm optimization algorithm used for BP neural network and multimedia course-ware evaluation. Multimed. Tools Appl 76, 11961–11974.

  18. Marini F, Walczak B (2015) Particle swarm optimization (PSO). A tutorial. Chemom Intell Lab Syst 149(Part B):153–165

    Article  Google Scholar 

  19. Oldewage ET, Engelbrecht AP, Cleghorn CW (2017) The merits of velocity clamping particle swarm optimization in high dimensional spaces. IEEE Symposium Series on Computational Intell. (SSCI), Honolulu, HI, pp. 1–8

  20. Pan F, Chen D, Lu L (2020) Improved PSO based clustering fusion algorithm for multimedia image data projection. Multimed Tools Appl 79:9509–9522

    Article  Google Scholar 

  21. Parsopoulos KE, Vrahatis MN (2002) Initialising the particle swarm optimizer using the nonlinear simplex method, Advances in Intell Syst, Fuzzy Syst, Evol Comput WSEAS Press, pp. 216–221

  22. Piotrowski AP, Napiorkowski JJ, Piotrowska AE (2020) Population size in particle swarm optimization. Swarm and Evol Comput 58, Article No. 100718, pages 18, https://doi.org/10.1016/j.swevo.2020.100718.

  23. Poli R (2008) Analysis of the Publications on the Applications of Particle Swarm Optimisation. J of Artif Evolution and Appl 2008, Article No. 685175., 10 pages, https://doi.org/10.1155/2008/685175

  24. Prakash KB (2020) Accurate hand gesture recognition using CNN and RNN approaches. Int J of Adv Trends in Comput Sci and Eng 9:3216–3222

    Article  Google Scholar 

  25. Prakash KB (2020) Predicting CryptoCurrency prices using machine learning and deep learning techniques. Int J of Adv Trends in Comput Sci and Eng 9:6603–6608

    Article  Google Scholar 

  26. Reynolds CW (1987) Flocks, herds and schools: A distributed behavioural model, in Proc. of the 14th ACM Annu. Conf. on Compu Graph and Interact Techn (SIGGRAPH '87), pp. 25–34. 10.1145/37401.37406.

  27. Ruwali A, Kumar AJS, Prakash KB, Sivavaraprasad G, Ratnam DV (2021) Implementation of hybrid deep learning model (LSTM-CNN) for ionospheric TEC forecasting using GPS data. IEEE Geosci Remote Sens Lett 18(6):1004–1008

    Article  Google Scholar 

  28. Serani A, Leotardi C, Iemma U, Campana E, Fasano G, Diez M (2016) Parameter selection in synchronous and asynchronous deterministic particle swarm optimization for ship hydrodynamics problems. Appl Soft Comput 49:313–334

    Article  Google Scholar 

  29. Shahzad F, Baig AR, Masood S, Kamran M, Naveed N (2009) Opposition-based particle swarm optimization with velocity clamping (OVCPSO). In: Yu W, Sanchez EN (eds) Advances in Intell and Soft Comput 116, 339–348.

  30. Shi Y, Eberhart R (2009) A modified particle swarm optimizer. IEEE World Congr on Computational Intell, 66–69

  31. Tejasri K, Srinivas M, Prakash KB, Pavan Kumar T (2020) Heart disease diagnosis using ANN, RNN and CNN. Int J of Adv Sci and Tech 29:2232–2239

    Google Scholar 

  32. Vamsidhar E, Kanagachidambaresan GR, Prakash KB (2021) Application of machine learning and deep learning. In: Prakash K.B., Kanagachidambaresan G.R. (eds) programming with TensorFlow. EAI/springer innovations in communication and computing. Springer, Cham. 63-74, https://doi.org/10.1007/978-3-030-57077-4_8

  33. van den Bergh F (2006) An Analysis of Particle Swarm Optimizers, PhD thesis, Department of Computer Science., University of Pretoria, Pretoria, South Africa.

  34. Yellapragada, Bharadwaj, Rajaram P, Sriram VP, Sengan S, Kolla B (2020) Effective Handwritten Digit Recognition using Deep Convolution Neural Network. Int J of Adv Trends in Comput Sci and Eng 9:1335–1339

    Article  Google Scholar 

  35. Zhang Y, Wang S, Ji G (2015) A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications. Mathematical Problems in Engineering 2015, Article No. 931256, 38 pages, https://doi.org/10.1155/2015/931256.

  36. Zhu H, Zhuang Z, Zhou J, Zhang F, Wang X, Wu Y (2017) Segmentation of liver cyst in ultrasound image based on adaptive threshold algorithm and particle swarm optimization. Multimed Tools Appl 76:8951–8968

    Article  Google Scholar 

Download references

Funding

The author declares that they do not have any funding or grant for the manuscript.

Author information

Authors and Affiliations

  1. Department of Computer Science & Engineering, Anurag Engineering College, Ananthagiri (V&M), Telangana, India

    Y.V.R. Naga Pawan

  2. Department of Computer Science & Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh, India

    Kolla Bhanu Prakash

  3. Department of Computer Science & Applications, SVCET Engineering College, Chittoor, Andhra Pradesh, India

    Subrata Chowdhury

  4. Department of Computer Science & Information Management, Providence University, 200, Sec. 7, Taiwan Boulevard, Shalu Dist, Taichung City, 43301, Taiwan, Republic of China

    Yu-Chen Hu

Authors
  1. Y.V.R. Naga Pawan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kolla Bhanu Prakash
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Subrata Chowdhury
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yu-Chen Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yu-Chen Hu.

Ethics declarations

Conflict of interest

The authors declare that they do not have any conflict of interests that influence the work reported in this paper.

Ethical approval

No animals were involved in this study. All applicable international, national, and/or institutional guidelines for the care and use of animals were followed.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pawan, Y.N., Prakash, K.B., Chowdhury, S. et al. Particle swarm optimization performance improvement using deep learning techniques. Multimed Tools Appl 81, 27949–27968 (2022). https://doi.org/10.1007/s11042-022-12966-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12966-1

Keywords

Search

Navigation