Abstract
Differential evolution (DE) algorithm is a very effective algorithm used for solving wide range of optimization problems. However, the performance of DE is dependent on the control parameters and to choose the right parameter value and tuning of these parameters is a challenging task. Therefore, a novel variant of differential evolution algorithm based on particle swarm optimization (DEPSO) is proposed to improve the overall performance of Differential evolution algorithm. In our proposed approach, we are using DE mutation strategy during the initial phase of evolution and therefore enlarge its search space possibly to the extent that helps in finding more encouraging results and thus avoid premature convergence. During the subsequent phase of evolution process, this value of sigmoid function reduces with the increase of number of iterations. In this scenario, there is a greater probability of operating PSO mutation strategy and thus this sigmoid function helps in improving the precision and convergence speed. The Performance of our proposed algorithm is tested with 10 benchmark test functions on 50 and 25 dimensions set, also tested with 11 test functions on 30- and 100-dimension test functions. We have also tested our proposed algorithm with 8 test functions on high dimension set as 500- and 1000-dimensions. The performance comparison shows that our proposed variant is giving significant improvement in convergence speed and thus avoiding premature convergence. Average performance of DEPSO is better than classical DE, PSO and other algorithms in comparison.
Similar content being viewed by others
References
Storn R, Price K (1995) Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces. Int Comput Sci Inst Technol Rep TR-95–012
Storn R, Price K (1997) Differential evolution: a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Ayala HVH, Santos FMD, Mariani VC, Coelho LDS (2019) Image thresholding segmentation based on a novel beta differential evolution approach. Expert Syst Appl 42(4):2136–2142
Cervantes-Sanchez F, Cruz-Aceves I, Hernandez-Aguirre A, Solorio-Meza S, Cordova-Fraga T, Aviña-Cervantes JG (2018) Coronary artery segmentation in X-ray angiograms using gabor filters and differential evolution. Appl Radiat Isot 138:18–24
Hou Y, Zhao L, Lu H (2018) Fuzzy neural network optimization and network traffic forecasting based on improved differential evolution. Future Gen Comput Syst 81:425–432
Wang T, Liu C, Wang L, Ma B, Gu X (2018) Evolution modeling with multi-scale smoothing for action recognition. J Vis Commun Image Represent 55:778–788
Civicioglu P, Besdok E (2019) Bernstain-search differential evolution algorithm for numerical function optimization. Expert Syst Appl 138:112831
Zhang Q, Zou D, Duan N, Shen X (2019) An adaptive differential evolutionary algorithm incorporating multiple mutation strategies for the economic load dispatch problem. Appl Soft Comput 78:641–669
Qin A, Huang V, Suganthan P (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evolu Comput 13(2):398–417
Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462
Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
Wang S, Li Y, Yang H, Liu H (2018) Self-adaptive differential evolution algorithm with improved mutation strategy. Soft Comput 22(10):3433–3447
Alswaitti M, Albughdadi M, Isa NAM (2019) Variance-based differential evolution algorithm with an optional crossover for data clustering. Appl Soft Comput 80:1–17
Ramadas M, Abraham A, Kumar S (2019) FSDE-Forced Strategy Differential Evolution used for data clustering. Journal of King Saud University - Computer and Information Sciences 31:52–61
Kennedy J and Eberhart R (1995) Particle swarm optimization in IEEE international conference on neural networks
Prajapati A, Chhabra JK (2018) A particle swarm optimization-based heuristic for software module. Arab J Sci Eng 43:7083–7094
Junxiang L, Jianqiao C (2019) Solving time-variant reliability-based design optimization by PSO-t-IRS: a methodology incorporating a particle swarm optimization algorithm and an enhanced instantaneous response surface. Reliab Eng Syst Saf 191:106580
Matos J, Faria RP, Nogueira IB, Loureiro JM, Ribeiro AM (2019) Optimization strategies for chiral separation by true moving bed chromatography using particles swarm optimization (PSO) and new parallel PSO variant. Comput Chem Eng 123:344–356
Xie XF, Zhang WJ, Yang ZL (2002) A dissipative particle swarm optimization. Congr Evolu Comput 2:1456–1461
Clerc M, Kennedy J (2002) The particle swarm - explosion, stability, and convergence in a multidimensional complex space. IEEE Trans on Evolu Comput 6(1):58–73
Lin G, Zhang J, Liu Z (2016) Hybrid particle swarm optimization with differential evolution for numerical and engineering optimization. Int J Autom Comput 15(1):103–114
Wang H, Zuo LL, Liu J, Yi WJ, Niu B (2018) Ensemble particle swarm optimization and differential evolution with alternative mutation method. Nat Comput 11655:1–1
Wanga S, Li Y, Yang H (2019) Self-adaptive mutation differential evolution algorithm based on particle swarm optimization. Appl Soft Comput J 81:105496
Pérez-González A, Begovich-Mendoza O, Ruiz-León J (2018) Modeling of a greenhouse prototype using PSO and differential evolution algorithms based on a real-time LabViewTM application. Appl Soft Comput 62:86–100
Ahmadianfar I, Khajeha Z, Asghari-Pari S-A, Chu X (2019) Developing optimal policies for reservoir systems using a multi-strategy optimization algorithm. Appl Soft Comput 80:888–903
Dash J, Dam B, Swain R (2019) Design and implementation of sharp edge FIR filters using hybrid differential evolution particle swarm optimization. AEU - International Journal of Electronics and Communications 114:344–356
Qin A, Suganthan P (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: Proceedings of IEEE congress on evolutionary computation, IEEE. Edinburgh, Scotland, UK
Ali M, Pant M, Abraham A (2013) Unconventional initialization methods for differential evolution. Appl Math Comput 219(9):4474–4494
Poikolainen I, Neri F, Caraffini F (2015) Cluster-based population initialization for differential evolution frameworks. Inf Sci 297:216–235
Sun G, Xu G, Gao R, Liu J (2019) A fluctuant population strategy for differential evolution. Evol Intell
Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657
Shao C, Cai Y, Fu S, Li J, Luo W (2018) An enhanced utilization mechanism of population information for differential evolution. Evol Intell
Annepu V, Rajesh A (2019) Implementation of self adaptive mutation factor and cross-over probability based differential evolution algorithm for node localization in wireless sensor networks. Evol Intell 12:469–478
Zhang X, Zhang X (2020) A set-based differential evolution algorithm for QoS-oriented and cost-effective ridesharing. Appl Soft Comput 96:106618
Xin B, Chen J, Zhang J, Fang H, Peng ZH (2012) Hybridizing differential evolution and particle swarm optimization to design powerful optimizers: a review and taxonomy. IEEE Trans Syst Man Cybern Syst 42(5):744–767
Sun J, Zhang Q, Tsang EPK (2005) DE/EDA: a new evolutionary algorithm for global optimization. Inf Sci 169(3–4):249–262
Wang L, Ye Xu, Lingpo Li (2011) Parameter identification of chaotic systems by hybrid Nelder-Mead simplex search and differential evolution algorithm. Expert Systems with Applications 38(4):3238–3245
Guo H, Li Y, Li J, Sun H, Wang D, Chen X (2014) Differential evolution improved with self-adaptive control parameters based on simulated annealing. Swarm Evol Comput 19:52–67
Keshk M, Singh H, Abbass H (2018) Automatic estimation of differential evolution parameters using hidden markov models. Evol Intell 10:77–93
Tian G, Ren Y, Zhou M (2016) Dual-objective scheduling of rescue vehicles to distinguish forest fires via differential evolution and particle swarm optimization combined algorithm. IEEE Trans Intell Trans Syst 18(11):3009–3021
Karaboga D (2010) Artificial bee colony algorithm”. Scholarpedia. Swarm Evol Comput 5(3):6915
Nasimul N, Danushka B, Hitoshi I (2006) An adaptive differential evolution algorithm. In IEEE Transaction on. Evolutionary Computation
Trelea I (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325
Liu Y, Yao X, Zhao Q, Higuchi T (2001) Scaling up fast evolutionary programming with cooperative coevolution. >In: Proceedings of the 2001 congress on evolutionary computation (IEEE Cat South Korea, No.01TH8546), Seoul
Author information
Authors and Affiliations
Corresponding authors
Appendix
Appendix
Formula | Ranges | Optimal |
---|---|---|
\(f_{1} \left( x \right) = \mathop \sum \limits_{i = 1}^{n} x_{i}^{2}\) | [− 100, 100] | 0 |
\(f_{2} (x) = \sum\limits_{i = 1}^{n - 1} {\left[ {100(x_{i + 1} - x_{i}^{2} )^{2} + (x_{i} - 1)^{2} } \right]}\) | [− 10, 10] | 0 |
\(f_{3} (x) = - 20\exp \left( { - 0.2\sqrt {\frac{1}{n}\sum\limits_{i = 1}^{n} {x_{i}^{2} } } } \right) - \exp \left( {\frac{1}{n}\sum\limits_{i = 1}^{n} {\cos 2\pi x_{i} } } \right) + 20 + e\) | [− 32.32] | 0 |
\(f_{4} \left( x \right) = \frac{1}{4000}\mathop \sum \limits_{i = 1}^{n} x_{i}^{2} - \mathop \prod \limits_{i = 1}^{n} \cos \left( {\frac{x}{\sqrt i }} \right) + 1\) | [− 600, 600] | 0 |
\(f_{5} = \mathop \sum \limits_{i = 1}^{n} ix^{4} + random\left( {0,1} \right)\) | [− 1.28, 1.28] | 0 |
\(f_{6} \left( x \right) = {\text{max}}\left\{ {\left| {x_{i} } \right|,1 \le x_{i} \le D} \right\}\) | [− 100, 100] | − 4.18 |
\(f_{7} \left( x \right) = \mathop \sum \limits_{i = 1}^{n} [x_{i}^{2} - 10\cos \left( {2\pi x_{i} } \right) + 10]\) | [− 5.12, 5.12] | 0 |
\(f_{8} \left( x \right) = \mathop \sum \limits_{i = 1}^{n} x_{i}^{2}\) + \(\begin{array}{*{20}c} { + (\mathop \sum \limits_{i = 1}^{n} 0.5ix_{i} )^{2} } \\ { + (\mathop \sum \limits_{i = 1}^{n} 0.5ix_{i} )^{4} } \\ \end{array}\) | [− 5, 10] | 0 |
\(f_{9} \left( x \right) = \mathop \sum \limits_{i = 1}^{n} \sin \left( {x_{i} } \right)sin^{20} \left( {\frac{{ix_{i}^{2} }}{\pi }} \right)\) | [0, π] | 9.66015 |
\(f_{10} \left( x \right) = \mathop \sum \limits_{i = 1}^{n/4} \left[ {\begin{array}{*{20}c} {(x_{4i - 3} } \\ { + 10x_{4i - 2} )^{2} } \\ { + 5(x_{4i - 1} )^{2} } \\ { + (x_{4i - 2} - 2x_{4i - 1} )^{4} } \\ { + 10(x_{4i - 3} - x_{4i} )^{4} } \\ \end{array} } \right]\) | [− 4.5] | 0 |
Rights and permissions
About this article
Cite this article
Dixit, A., Mani, A. & Bansal, R. An adaptive mutation strategy for differential evolution algorithm based on particle swarm optimization. Evol. Intel. 15, 1571–1585 (2022). https://doi.org/10.1007/s12065-021-00568-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12065-021-00568-z