Abstract
Nitrogen (N) concentration is a significant parameter to check the status of health in rice crop. Nitrogen (N) plays an essential role in the growth and productivity of rice plant. This paper proposes a convolutional neural network (CNN) based approach for prediction of rice nitrogen deficiency. The pre-trained CNN architecture is modified to improve the classification accuracy with the inclusion of pre-eminent classifier like support vector machine (SVM) by replacing the last output layer of CNN. Here, six leading deep learning architectures such as ResNet-18, ResNet-50, GoogleNet, AlexNet, VGG-16 and VGG-19 with SVM are used for prediction of nitrogen deficiency with 5790 number image samples. The performance of each classifier is measured and compared in terms of accuracy, sensitivity, specificity, false positive rate (FPR) and F1 score. Again, the statistical analysis is performed to choose the better classification model considering the results of 100 independent simulations. The statistical analysis confirmed the superiority of ResNet-50+SVM than the other five CNN-based classification models with an accuracy of 99.84%. Besides, the accuracy score of CNN classification models is compared with other traditional image classification models such as bag-of-feature, colour feature + SVM, local binary patterns (LBP) + SVM, histogram of oriented gradients (HOG)+SVM and Gray Level Co-occurrence Matrix (GLCM)+SVM.
Similar content being viewed by others
Data availability
The nitrogen deficient rice leaf image dataset used for training and testing CNN model is available in “https://data.mendeley.com/datasets/gzm5pxntyv/draft?a=68bc492f-89ce-4c5c-9bb5-73f2bf528f4a”, and all the data generated during and/or analysed during the current study are included in the manuscript.
References
Asfarian A, Herdiyeni Y, Rauf A, Mutaqin KH (2014) A computer vision for rice disease identification to support integrated pest management. Crop Prot 61:103–104
Barbedo JGA (2013) Digital image processing techniques for detecting, quantifying and classifying plant diseases. SpringerPlus 2(1):660–672
Bengio Y, LeCun Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444
Borianne P, Borne F, Sarron J, Faye E (2019) Deep Mangoes: from fruit detection to cultivar identification in colour images of mango trees. arXiv preprint arXiv:1909.10939
Borrell AK, Garside AL, Fukai S, Reid DJ (1998) Season, nitrogen rate, and plant type affect nitrogen uptake and nitrogen use efficiency in rice. Aust J Agric Res 49:829–843
Borrell A, Hammer G, Van Oosterom E (2001) Stay-green: a consequence of the balance between supply and demand for nitrogen during grain filling. Ann Appl Biol 138:91–95
California Rice News (2020) https://www.calricenews.org/2017/03/24/updated-leaf-color-chart-is-in-the-mail. Accessed 06 Jan 2020
Chai Y, Wang XD (2013) Recognition of greenhouse tomato disease based on image processing technology. Tech Autom Appl 9:83–89
Chen LS, Sun YY, Wang K (2014) Identifying of rice nitrogen stress based on machine vision and multiscale information extraction. Sens Lett 12:824–830
Chen LS, Wang K (2014) Diagnosing of rice nitrogen stress based on static scanning technology and image information extraction. J Soil Sci Plant Nutr 14(2):382–393
Chen Y, Wang J, Xia R et al (2019) The visual object tracking algorithm research based on adaptive combination kernel. J Ambient Intell Human Comput 10:4855. https://doi.org/10.1007/s12652-018-01171-4
Chen LS, Zhang SJ, Wang K, Shen ZQ, Deng JS (2013) Identifying of rice phosphorus stress based on machine vision technology. Life Sci J 10(2):2655–2663
Chen L, Yuan Y (2019) Agricultural disease image dataset for disease identification based on machine learning. In: Li J, Meng X, Zhang Y, Cui W, Du Z (eds) Big scientific data management. BigSDM 2018. Lecture Notes in Computer Science, vol 11473. Springer, Cham
Cho H, Ahn C, Min Yoo K, Seol J, Lee SG (2019) Leveraging class hierarchy in fashion classification. In: Proceedings of the IEEE international conference on computer vision workshops
Deng J et al (2009) Imagenet: a large-scale hierarchical image database. In: computer vision and pattern recognition, 2009. CVPR 2009. IEEE Conference on IEEE
Donahue J et al (2013) Decaf: a deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531
Ge Y, Zhang R, Wang X, Tang X, Luo P (2019) DeepFashion2: a versatile benchmark for detection, pose estimation, segmentation and re-identification of clothing images. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5337–5345
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the 2014 IEEE conference on computer vision and pattern recognition, pp 580–587
Girshick R (2015) Fast R-CNN. In: Proceedings of the 2015 IEEE international conference on computer vision, pp 1440–1448
Jian Z, Wei Z (2010) Support vector machine for recognition of cucumber leaf diseases. In: Proceedings of the international conference on advanced computer control (ICACC), Patiala, India, pp 264–266
Karpathy A, Toderici G, Shetty S et al (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1725–1732
Kawasaki R, Uga H, Kagiwada S, Iyatomi H (2015) Basic study of automated diagnosis of viral plant diseases using convolutional neural networks. In: Proceedings of the international symposium on visual computing (ISVC), pp 638–645
Khairnar K, Dagade R (2014) Disease detection and diagnosis on plant using image processing—a review. Int J Comput Appl 108(13):36–39
Krizhevsky A, Ilya S, Geoffrey EH (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems
Li WM (2012) Crop symptoms under nutrition stress. Qinghai Agro-Technol Extension 2:44–45
Lian XM, Xing YZ, Yan H, Xu CG, Li XH, Zhang QF (2005) QTLs for low nitrogen tolerance at seedling stage identified using a recombinant inbred line population derived from an elite rice hybrid. Theor Appl Genet 112:85–96
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384. https://doi.org/10.1016/j.neucom.2017.06.023
Misra S, Laskar RH (2019) Development of a hierarchical dynamic keyboard character recognition system using trajectory features and scale-invariant holistic modeling of characters. J Ambient Intell Human Comput 10:4901. https://doi.org/10.1007/s12652-019-01189
Moslehi F, Haeri A (2019) An evolutionary computation-based approach for feature selection. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01570-1
Mulvaney RL, Khan SA, Ellsworth TR (2009) Synthetic nitrogen fertilizers deplete soil nitrogen: a global dilemma for sustainable cereal production. J Environ Qual 38:2295–2314
PLAGRON (2010) https://www.plagron.com/en/grow-topics/nitrogen-deficiency. Accessed 5 Jan 2010
Phadikar S, Sil J (2008) Rice disease identification using pattern recognition techniques. In: Proceedings of the IEEE international conference on computer and information technology (ICCIT), Khulna, Bangladesh, pp 420–423
Prasad S, Peddoju SK, Ghosh D (2016) Multi-resolution mobile vision system for plant leaf disease diagnosis. Sig Image Video Process 10(2):379–388
Ren S, He K, Gershick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149
Sahu GC, Mishra A (2005) Soil of Odisha and its management, Odisha Review
Sanyal P, Bhattacharya U, Parui SK, Bandyopadhyay SK, Patel S (2007) Color texture analysis of rice leaves diagnosing deficiency in the balance of mineral levels towards improvement of crop productivity. In: 10th International Conference on Information Technology (ICIT 2007), pp 85–90. https://doi.org/10.1109/ICIT.2007.40
Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117
Semary NA, Tharwat A, Elhariri E, Hassanien AE (2015) Fruit-based tomato grading system using features fusion and support vector machine. In: Filev D et al (eds) Intelligent Systems’2014. AISC, vol 323, pp 401–410. Springer, Cham. https://doi.org/10.1007/978-3-319-11310-435
Shi YY, Deng JS, Chen LS, Zhang DY, Ding XD et al (2009) Leaf characteristics extraction of rice under potassium stress based on static scan and spectral segmentation technique. Spectrosc Spect Anal 29(7):1745–1748
Shicha Z, Hanping M, Bo H, Yancheng Z (2007) Morphological feature extraction for cotton disease recognition by machine vision. Microcomput Inf 23(4):290–292
Simonyan K, Andrew Z (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Sun Y, Zhu S, Yang X, Weston MV, Wang K, Shen Z, Xu H, Chen L (2018) Nitrogen diagnosis based on dynamic characteristics of rice leaf image. PLoS ONE 13(4):e0196298
Tian YW, Li TL, Zhang L, Wang XJ (2010) Diagnosis method of cucumber disease with hyperspectral imaging in greenhouse. Trans Chin Soc Agric Eng 26(5):202–206
Uijlings JRR, van de Sande KEA, Gevers T, Smeulders AWM (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171
Wang X, Zhang S, Wang Z, Zhang Q (2014) Recognition of cucumber diseases based on leaf image and environmental information. Trans Chin Soc Agric Eng 30(14):148–153
Yang W-H, Peng SH, Jianliang S, Arnel B, Roland WC (2003) Using leaf color charts to estimate leaf nitrogen status of rice. Agron J 2003:95
Zhang X, Lu Y, Zhang S (2016) Multi-task learning for food identification and analysis with deep convolutional neural networks. J Comput Sci Technol 31(3):489–500
Zhang SW, Shang YJ, Wang L (2015) Plant disease recognition based on plant leaf image. J Anim Plant Sci 25(3):42–45
Zhang LN, Yang B (2014) Research on recognition of maize disease based on mobile internet and support vector machine technique. Trans Tech Publ 108(13):659–662
Zhao WS, Peng YL (2012) Rice Diseases and insect pests atlas. China Agriculture Press, Beijing
Zitnick CL, Dollar P (2014) Edge boxes: locating object proposals from edges. In: European conference on computer vision, pp 391–405.
Acknowledgements
We are thankful and express our sincere regards to the editors and reviewers for their constructive suggestion towards the improvement of the manuscript to a high mark.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sethy, P.K., Barpanda, N.K., Rath, A.K. et al. Nitrogen Deficiency Prediction of Rice Crop Based on Convolutional Neural Network. J Ambient Intell Human Comput 11, 5703–5711 (2020). https://doi.org/10.1007/s12652-020-01938-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-01938-8