Abstract
Agriculture is one of the most important sources of income for people in many countries. However, plant disease issues influence many farmers, as diseases in plants often naturally occur. If proper care is not taken, diseases can have hazardous effects on plants and influence the product quality, quantity or productivity. Therefore, the detection and prevention of plant diseases are serious concerns and should be considered to increase productivity. An effective identification technology can be beneficial for monitoring plant diseases. Generally, the leaves of plants show the first signs of plant disease, and most diseases can be detected from the symptoms that appear on the leaves. Therefore, this paper introduces a novel method for the detection of plant leaf diseases. The method is divided into two parts: image segmentation and image classification. First, a hue, saturation and intensity-based and LAB-based hybrid segmentation algorithm is proposed and used for the disease symptom segmentation of plant disease images. Then, the segmented images are input into a convolutional neural network for image classification. The validation accuracy obtained using this approach was approximately 15.51% higher than that for the conventional method. Additionally, the detection results showed that the average detection rate was 75.59% under complex background conditions, and most of the diseases were effectively detected. Thus, the approach of combined segmentation and classification is effective for plant disease identification, and our empirical research validates the advantages of the proposed method.
Similar content being viewed by others
References
Amara J, Bouaziz B, Algergawy A (2017) A deep learning-based approach for banana leaf diseases classification. In: Lecture notes in informatics (LNI). Gesellschaft für Informatik, Bonn
Bashish AD, Braik M, Bani-Ahmad S (2011) Detection and classification of leaf diseases using K-means-based segmentation and neural-networks-based classification. Inf Technol J 10:267–275
Alrahamneh Z, Braik M, Reyalat M, Ahmad SB, Al Hiary H (2011) Fast and accurate detection and classification of plant diseases. Int J Comput Appl 17:31–38
Alvaro F, Sook Y, Sang CK, Dong SP (2020) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022
Bai X, Cao Z, Zhao L, Zhang J, Lv C, Li C, Xie J (2018) Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method. Agric For Meteorol 259:260–270
Barbedo JGA (2016) A novel algorithm for semi-automatic segmentation of plant leaf disease symptoms using digital image processing. Trop Plant Pathol 41:210–224
Barbedo JGA (2018a) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91
Barbedo JGA (2018b) Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Comput Electron Agric 153:46–53
Barbedo JGA (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107
Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:293–297
Cugu I, Sener E, Erciyes C, Balci B, Akin E, Onal I, Oguz-Akyuz A, Treelogy (2017) A novel tree classifier utilizing deep and hand-crafted representations. arXiv:1701.08291v1
Deepa S (2017) Steganalysis on images using svm with selected hybrid features of gini index feature selection algorithm. Int J Adv Res Comput Sci 8:1503–1509
Dhaygude SB, Kumbhar NP (2013) Agricultural plant leaf disease detection using image processing. Int J Adv Res Electr Electron Instrum Eng 2:599–602
Duan Y, Liu F, Jiao L, Zhao P, Zhang L (2017) SAR Image segmentation based on convolutional-wavelet neural network and markov random field. Pattern Recognit 64:255–267
Dalal N, Trigs B (2005) Histogram of oriented gradients for human detection. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, San Diego, CA, USA, pp 20–25
Ebrahimi MA, Khoshtaghaza MH, Minaei S, Jamshidi B (2017) Vision-based pest detection based on SVM classification method. Comput Electron Agric 137:52–58
Elaziz MA, Oliva D, Ewees AA, Xiong S (2019) Multi-level thresholding-based grey scale image segmentation using multi-objective multi-verse optimizer. Expert Syst Appl 125:112–129
Faithpraise F, Birch P, Young R, Obu J, Faithpraise B, Chatwin C (2013) Automatic plant pest detection & recognition using k-means clustering algorithm & correspondence filters. Int J Adv Biotechnol Res 4:1052–1062
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318
Fujita E, Kawasaki Y, Uga H, Kagiwada S, Iyatomi H (2016) Basic investigation on a robust and practical plant diagnostic system. In: Proceedings of the 2016 15th IEEE international conference on machine learning and applications (ICMLA), Anaheim, CA, USA, pp 18–20
Garcia A, Escolano S, Oprea S, Villena M, Garcia R (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:1704.06857
Garcia L, Cervantes F, López J, Rodriguez L (2018) Segmentation of images by color features: a survey. Neurocomputing 292:1–27
García J, Pope C, Altimiras F (2017) A distributed K-means segmentation algorithm applied to lobesia botrana recognition. Complexity 2017:1–14
Gaura J, Sojka E, Krumnikl M (2011) Image segmentation based on k-means clustering and energy-transfer proximity, advances in visual computing. Springer, Cham, pp 567–577
Ghaiwat SN, Arora P (2014) Detection and classification of plant leaf diseases using image processing techniques: a review. Int J Recent Adv Eng Technol 2:2347–2812
Glauner PO (2015) Deep convolutional neural networks for smile recognition. IEEE ACM Trans. Audio Speech Lang Process 22:1533–1545
Guettari N, Capelle-Laizé AS, Carré P (2016) Blind image steganalysis based on evidential K-nearest neighbors. In: IEEE international conference on image processing (ICIP), IEEE, pp 2742–2746
Huang HW, Li QT, Zhang DM (2018) Deep learning-based image recognition for crack and leakage defects of metro shield tunnel. Tunnel Undergr Space Technol 77:166–176
Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S et al (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, Honolulu, HI, USA, pp 22–25
Huang R, Sang N, Luo D, Tang Q (2011) Image segmentation via coherent clustering. Pattern Recognit Lett 32:891–902
He K, Zhang X, Ren S, Sun J (2016a) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer, vision, pattern recognition, Las Vegas, NV, USA, 27–30, pp 770–778
He K, Zhang X, Ren S, Sun J (2016b) Identity mapping in deep residual networks. arXiv:1603.05027
Ito S, Yoshioka M, Omatu S, Kita K, Kugo K (2006) An image segmentation method using histograms and the human characteristics of HSI color space for a scene image. Artif Life Robot 10:6–10
Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Diez-Navajas A, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209
Kamilaris A, Prenafeta-Boldú FX (2018) Deep learning in agriculture: a survey. Comput Electron Agric 147:70–90
Kawasaki Y, Uga H, Kagiwada S, Iyatomi H (2015) Basic study of automated diagnosis of viral plant diseases using convolutional neural networks. In: Bebis G, Boyle R, Parvin B, Koracin D, Pavlidis I, Feris R, McGraw T, Elendt M, Kopper R, Ragan E, Ye Z, Weber G (eds) Advances in visual computing. Proceedings of the 11th international symposium, ISVC 2015, Las Vegas, NV, USA, 14–16 December 2015. Lecture notes in computer science. Springer, Cham, pp 638–645
Kodovsky J, Fridrich J, Holub V (2012) Ensemble classifiers for steganalysis of digital media. IEEE Trans Inf Forensics Secur 7:432–444
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th international conference on neural information processing systems. IEEE, pp 1097–1105
Kumar S, Sharma B, Sharma VK, Sharma H, Bansal JC (2018) Plant leaf disease identification using exponential spider monkey optimization. Sustain Comput Inform Syst 17(7):456–468
Li J (2016) Automatic identification of tobacco diseases based on convolutional neural network [D]. Shandong Agricultural University
Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110
Lin M, Chen Q, Yan S (2013) Network in network. arXiv:1312.4400
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384
Mohammadzadeh A, Ghasemi S, Kaynak O (2019) Robust predictive synchronization of uncertain fractional-order time-delayed chaotic systems. Soft Comput 23(16):6883–6898
Mohanty SP, Hughes DP, Salathe M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66
Pawara P, Okafor E, Surinta O, Schomaker L, Wiering M (2017) Comparing local descriptors and bags of visual words to deep convolutional neural networks for plant recognition. In: Proceedings of the 6th international conference on pattern recognition applications and methods (ICPRAM 2017), IEEE¸ pp 479–486
Ramezani M, Ghaemmaghami S (2010) Towards genetic feature selection in image steganalysis. In: 7th IEEE consumer communications and networking conference. IEEE, pp 1–4
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252
Schapire R (1999) A brief introduction to boosting. In Proceedings of the sixteenth international joint conference on artificial intelligence, Stockholm, Sweden, vol. 2, pp 1401–1406
Sardogan M, Tuncer A, Ozen Y (2018) Plant leaf disease detection and classification based on CNN with LVQ algorithm. In: 2018 3rd international conference on computer science and engineering (UBMK). IEEE, pp 382–385
Sharifzadeh S, Clemmensen LH, Borggaard C, Støier S, Ersbøll BK (2014) Supervised feature selection for linear and non-linear regression of L*a*b* color from multispectral images of meat. Eng Appl Artif Intell 27:211–227
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, IEEE, pp 1–9
Sun XX, Mu SM, Xu YY, Cao ZH, Su TT (2019) Image recognition of tea leaf diseases based on convolutional neural network. arXiv:1901.02694
Sheikhan M, Pezhmanpour M, Moin MS (2012) Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks. Neural Comput Appl 21:1717–1728
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Tang H, Ni R, Zhao Y, Li X (2018) Median filtering detection of small-size image based on CNN. J Vis Commun Image Represention 51:162–168
Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. arXiv:1611.05431
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision-ECCV 2014. Springer, Cham, pp 818–833
Zhang K, Sun M, Han TX, Yuan X, Guo L, Liu T (2017) Residual networks of residual networks: multilevel residual networks. IEEE Trans Circuits Syst Video Technol 28(6):1303–1314
Acknowledgements
The writers want to appreciate Pzcnet Ltd. (https://www.pzcnet.com/) and Mr. Wang Wen-Hua, director of research at the Fujian Institute of Subtropical Botany, for a valuable discussion and participation in the successful implementation of the project and beneficial comments. The author also likes to appreciate all the judges and editors whose useful suggestions helped improve the article.
Funding
This work is partly supported by grants from the National Natural Science Foundation of China (Project no. 61672439) and the Fundamental Research Funds for the Central Universities (#20720181004).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nanehkaran, Y.A., Zhang, D., Chen, J. et al. Recognition of plant leaf diseases based on computer vision. J Ambient Intell Human Comput (2020). https://doi.org/10.1007/s12652-020-02505-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12652-020-02505-x