Skip to main content
Log in

Recognition of plant leaf diseases based on computer vision

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Agriculture is one of the most important sources of income for people in many countries. However, plant disease issues influence many farmers, as diseases in plants often naturally occur. If proper care is not taken, diseases can have hazardous effects on plants and influence the product quality, quantity or productivity. Therefore, the detection and prevention of plant diseases are serious concerns and should be considered to increase productivity. An effective identification technology can be beneficial for monitoring plant diseases. Generally, the leaves of plants show the first signs of plant disease, and most diseases can be detected from the symptoms that appear on the leaves. Therefore, this paper introduces a novel method for the detection of plant leaf diseases. The method is divided into two parts: image segmentation and image classification. First, a hue, saturation and intensity-based and LAB-based hybrid segmentation algorithm is proposed and used for the disease symptom segmentation of plant disease images. Then, the segmented images are input into a convolutional neural network for image classification. The validation accuracy obtained using this approach was approximately 15.51% higher than that for the conventional method. Additionally, the detection results showed that the average detection rate was 75.59% under complex background conditions, and most of the diseases were effectively detected. Thus, the approach of combined segmentation and classification is effective for plant disease identification, and our empirical research validates the advantages of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Amara J, Bouaziz B, Algergawy A (2017) A deep learning-based approach for banana leaf diseases classification. In: Lecture notes in informatics (LNI). Gesellschaft für Informatik, Bonn

  • Bashish AD, Braik M, Bani-Ahmad S (2011) Detection and classification of leaf diseases using K-means-based segmentation and neural-networks-based classification. Inf Technol J 10:267–275

    Article  Google Scholar 

  • Alrahamneh Z, Braik M, Reyalat M, Ahmad SB, Al Hiary H (2011) Fast and accurate detection and classification of plant diseases. Int J Comput Appl 17:31–38

    Google Scholar 

  • Alvaro F, Sook Y, Sang CK, Dong SP (2020) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022

    Google Scholar 

  • Bai X, Cao Z, Zhao L, Zhang J, Lv C, Li C, Xie J (2018) Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method. Agric For Meteorol 259:260–270

    Article  Google Scholar 

  • Barbedo JGA (2016) A novel algorithm for semi-automatic segmentation of plant leaf disease symptoms using digital image processing. Trop Plant Pathol 41:210–224

    Article  Google Scholar 

  • Barbedo JGA (2018a) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91

    Article  Google Scholar 

  • Barbedo JGA (2018b) Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Comput Electron Agric 153:46–53

    Article  Google Scholar 

  • Barbedo JGA (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107

    Article  Google Scholar 

  • Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:293–297

    MATH  Google Scholar 

  • Cugu I, Sener E, Erciyes C, Balci B, Akin E, Onal I, Oguz-Akyuz A, Treelogy (2017) A novel tree classifier utilizing deep and hand-crafted representations. arXiv:1701.08291v1

  • Deepa S (2017) Steganalysis on images using svm with selected hybrid features of gini index feature selection algorithm. Int J Adv Res Comput Sci 8:1503–1509

    Google Scholar 

  • Dhaygude SB, Kumbhar NP (2013) Agricultural plant leaf disease detection using image processing. Int J Adv Res Electr Electron Instrum Eng 2:599–602

    Google Scholar 

  • Duan Y, Liu F, Jiao L, Zhao P, Zhang L (2017) SAR Image segmentation based on convolutional-wavelet neural network and markov random field. Pattern Recognit 64:255–267

    Article  Google Scholar 

  • Dalal N, Trigs B (2005) Histogram of oriented gradients for human detection. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, San Diego, CA, USA, pp 20–25

  • Ebrahimi MA, Khoshtaghaza MH, Minaei S, Jamshidi B (2017) Vision-based pest detection based on SVM classification method. Comput Electron Agric 137:52–58

    Article  Google Scholar 

  • Elaziz MA, Oliva D, Ewees AA, Xiong S (2019) Multi-level thresholding-based grey scale image segmentation using multi-objective multi-verse optimizer. Expert Syst Appl 125:112–129

    Article  Google Scholar 

  • Faithpraise F, Birch P, Young R, Obu J, Faithpraise B, Chatwin C (2013) Automatic plant pest detection & recognition using k-means clustering algorithm & correspondence filters. Int J Adv Biotechnol Res 4:1052–1062

    Google Scholar 

  • Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318

    Article  Google Scholar 

  • Fujita E, Kawasaki Y, Uga H, Kagiwada S, Iyatomi H (2016) Basic investigation on a robust and practical plant diagnostic system. In: Proceedings of the 2016 15th IEEE international conference on machine learning and applications (ICMLA), Anaheim, CA, USA, pp 18–20

  • Garcia A, Escolano S, Oprea S, Villena M, Garcia R (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:1704.06857

  • Garcia L, Cervantes F, López J, Rodriguez L (2018) Segmentation of images by color features: a survey. Neurocomputing 292:1–27

    Article  Google Scholar 

  • García J, Pope C, Altimiras F (2017) A distributed K-means segmentation algorithm applied to lobesia botrana recognition. Complexity 2017:1–14

    Article  MATH  Google Scholar 

  • Gaura J, Sojka E, Krumnikl M (2011) Image segmentation based on k-means clustering and energy-transfer proximity, advances in visual computing. Springer, Cham, pp 567–577

    Google Scholar 

  • Ghaiwat SN, Arora P (2014) Detection and classification of plant leaf diseases using image processing techniques: a review. Int J Recent Adv Eng Technol 2:2347–2812

    Google Scholar 

  • Glauner PO (2015) Deep convolutional neural networks for smile recognition. IEEE ACM Trans. Audio Speech Lang Process 22:1533–1545

    Google Scholar 

  • Guettari N, Capelle-Laizé AS, Carré P (2016) Blind image steganalysis based on evidential K-nearest neighbors. In: IEEE international conference on image processing (ICIP), IEEE, pp 2742–2746

  • Huang HW, Li QT, Zhang DM (2018) Deep learning-based image recognition for crack and leakage defects of metro shield tunnel. Tunnel Undergr Space Technol 77:166–176

    Article  Google Scholar 

  • Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S et al (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, Honolulu, HI, USA, pp 22–25

  • Huang R, Sang N, Luo D, Tang Q (2011) Image segmentation via coherent clustering. Pattern Recognit Lett 32:891–902

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016a) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer, vision, pattern recognition, Las Vegas, NV, USA, 27–30, pp 770–778

  • He K, Zhang X, Ren S, Sun J (2016b) Identity mapping in deep residual networks. arXiv:1603.05027

  • Ito S, Yoshioka M, Omatu S, Kita K, Kugo K (2006) An image segmentation method using histograms and the human characteristics of HSI color space for a scene image. Artif Life Robot 10:6–10

    Article  Google Scholar 

  • Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Diez-Navajas A, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209

    Article  Google Scholar 

  • Kamilaris A, Prenafeta-Boldú FX (2018) Deep learning in agriculture: a survey. Comput Electron Agric 147:70–90

    Article  Google Scholar 

  • Kawasaki Y, Uga H, Kagiwada S, Iyatomi H (2015) Basic study of automated diagnosis of viral plant diseases using convolutional neural networks. In: Bebis G, Boyle R, Parvin B, Koracin D, Pavlidis I, Feris R, McGraw T, Elendt M, Kopper R, Ragan E, Ye Z, Weber G (eds) Advances in visual computing. Proceedings of the 11th international symposium, ISVC 2015, Las Vegas, NV, USA, 14–16 December 2015. Lecture notes in computer science. Springer, Cham, pp 638–645

  • Kodovsky J, Fridrich J, Holub V (2012) Ensemble classifiers for steganalysis of digital media. IEEE Trans Inf Forensics Secur 7:432–444

    Article  Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th international conference on neural information processing systems. IEEE, pp 1097–1105

  • Kumar S, Sharma B, Sharma VK, Sharma H, Bansal JC (2018) Plant leaf disease identification using exponential spider monkey optimization. Sustain Comput Inform Syst 17(7):456–468

    Google Scholar 

  • Li J (2016) Automatic identification of tobacco diseases based on convolutional neural network [D]. Shandong Agricultural University

  • Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110

    Article  Google Scholar 

  • Lin M, Chen Q, Yan S (2013) Network in network. arXiv:1312.4400

  • Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384

    Article  Google Scholar 

  • Mohammadzadeh A, Ghasemi S, Kaynak O (2019) Robust predictive synchronization of uncertain fractional-order time-delayed chaotic systems. Soft Comput 23(16):6883–6898

    Article  MATH  Google Scholar 

  • Mohanty SP, Hughes DP, Salathe M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419

    Article  Google Scholar 

  • Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66

    Article  Google Scholar 

  • Pawara P, Okafor E, Surinta O, Schomaker L, Wiering M (2017) Comparing local descriptors and bags of visual words to deep convolutional neural networks for plant recognition. In: Proceedings of the 6th international conference on pattern recognition applications and methods (ICPRAM 2017), IEEE¸ pp 479–486

  • Ramezani M, Ghaemmaghami S (2010) Towards genetic feature selection in image steganalysis. In: 7th IEEE consumer communications and networking conference. IEEE, pp 1–4

  • Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252

    Article  MathSciNet  Google Scholar 

  • Schapire R (1999) A brief introduction to boosting. In Proceedings of the sixteenth international joint conference on artificial intelligence, Stockholm, Sweden, vol. 2, pp 1401–1406

  • Sardogan M, Tuncer A, Ozen Y (2018) Plant leaf disease detection and classification based on CNN with LVQ algorithm. In: 2018 3rd international conference on computer science and engineering (UBMK). IEEE, pp 382–385

  • Sharifzadeh S, Clemmensen LH, Borggaard C, Støier S, Ersbøll BK (2014) Supervised feature selection for linear and non-linear regression of L*a*b* color from multispectral images of meat. Eng Appl Artif Intell 27:211–227

    Article  Google Scholar 

  • Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the 2015 IEEE conference on computer vision and pattern recognition, IEEE, pp 1–9

  • Sun XX, Mu SM, Xu YY, Cao ZH, Su TT (2019) Image recognition of tea leaf diseases based on convolutional neural network. arXiv:1901.02694

  • Sheikhan M, Pezhmanpour M, Moin MS (2012) Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks. Neural Comput Appl 21:1717–1728

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  • Tang H, Ni R, Zhao Y, Li X (2018) Median filtering detection of small-size image based on CNN. J Vis Commun Image Represention 51:162–168

    Article  Google Scholar 

  • Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. arXiv:1611.05431

  • Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision-ECCV 2014. Springer, Cham, pp 818–833

    Chapter  Google Scholar 

  • Zhang K, Sun M, Han TX, Yuan X, Guo L, Liu T (2017) Residual networks of residual networks: multilevel residual networks. IEEE Trans Circuits Syst Video Technol 28(6):1303–1314

    Article  Google Scholar 

Download references

Acknowledgements

The writers want to appreciate Pzcnet Ltd. (https://www.pzcnet.com/) and Mr. Wang Wen-Hua, director of research at the Fujian Institute of Subtropical Botany, for a valuable discussion and participation in the successful implementation of the project and beneficial comments. The author also likes to appreciate all the judges and editors whose useful suggestions helped improve the article.

Funding

This work is partly supported by grants from the National Natural Science Foundation of China (Project no. 61672439) and the Fundamental Research Funds for the Central Universities (#20720181004).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Defu Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nanehkaran, Y.A., Zhang, D., Chen, J. et al. Recognition of plant leaf diseases based on computer vision. J Ambient Intell Human Comput (2020). https://doi.org/10.1007/s12652-020-02505-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12652-020-02505-x

Keywords

Navigation