Abstract
The brown rice planthopper (Nilaparvata lugens Stal) is one of the main pests of rice. The rapid and accurate detection of brown rice planthoppers (BRPH) can help treat rice in time. Due to the small size, large number and complex background of BRPHs, image detection of them is challenging. In this paper, a two-layer detection algorithm based on deep learning technology is proposed to detect them. The algorithm for both layers is the Faster RCNN (regions with CNN features). To effectively utilize the computing resources, different feature extraction networks have been selected for each layer. In addition, the second layer detection network was optimized to improve the final detection performance. The detection results of the two-layer detection algorithm were compared with the detection results of the single-layer detection algorithm. The detection results of the two-layer detection algorithm for detecting different populations and numbers of BRPHs were tested, and the test results were compared with YOLO v3, a deep learning target detection network. The test results show that the detection results of the two-layer detection algorithm were significantly better than those of the single-layer detection algorithm. In the tests for different numbers of BRPHs, the average recall rate of this algorithm was 81.92%, and the average accuracy was 94.64%; meanwhile, the average recall rate of YOLO v3 was 57.12%, and the average accuracy rate was 97.36%. In the experiment with different ages of BRPHs, the average recall rate of the algorithm was 87.67%, and the average accuracy rate was 92.92%. In comparison, for the YOLO v3, the average recall rate was 49.60%, and the average accuracy rate was 96.48%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aki, T., Shigyo, M., Nakano, R., Yoneyama, T., & Yanagisawa, S. (2008). Nano scale proteomics revealed the presence of regulatory proteins including three FT-like proteins in phloem and xylem saps from rice. Plant and Cell Physiology, 49(5), 767–790. https://doi.org/10.1093/pcp/pcn049.
Alvaro, F., Sook, Y., Sang, K., & Dong, P. (2017). A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors, 17(9), 2022–2043. https://doi.org/10.3390/s17092022.
Asefpour Vakilian, K., & Massah, J. (2013). Performance evaluation of a machine vision system for insect pests identification of field crops using artificial neural networks. Archives of Phytopathology and Plant Protection, 46(11), 1262–1269. https://doi.org/10.1080/03235408.2013.763620.
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014). Return of the devil in the details: Delving deep into convolutional nets. arXiv: 1405.3531v4.
Cheng, X., Zhang, Y., Chen, Y., Wu, Y., & Yue, Y. (2017). Pest identification via deep residual learning in complex background. Computers and Electronics in Agriculture, 141, 351–356. https://doi.org/10.1016/j.compag.2017.08.005.
Craig, T. (2015). The rise and demise of integrated pest management in, rice in Indonesia. Insects, 6(2), 381–408. https://doi.org/10.3390/insects6020381.
Ding, W. G., & Taylor, G. (2016). Automatic moth detection from trap images for pest management. Computers and Electronics in Agriculture, 123(C), 17–28. https://doi.org/10.1016/j.compag.2016.02.003.
Dong, X., Zhai, Y., Zhang, J., Sun, Z., Chen, J., Chen, J., et al. (2011). Fork head transcription factor is required for ovarian mature in the brown planthopper, Nilaparvata lugens (Stål). BMC Molecular Biology, 12(1), 53–53. https://doi.org/10.1186/1471-2199-12-53.
Dubey, S. R., & Jalal, A. S. (2012). Adapted approach for fruit disease identification using images. International Journal of Computer Vision and Image Processing, 2(3), 44–58. https://doi.org/10.4018/ijcvip.2012070104.
Everingham, M., Eslami, S. M. A., Van Gool, L., et al. (2015). The Pascal visual object classes challenge: A retrospective. International Journal of Computer Vision, 111(1), 98–136.
Gurr, G. M., Liu, J., Read, D. M. Y., Catindig, J. L. A., Cheng, J. A., Lan, L. P., et al. (2015). Parasitoids of Asian rice planthopper (Hemiptera: Delphacidae) pests and prospects for enhancing biological control by ecological engineering. Annals of Applied Biology, 158(2), 149–176. https://doi.org/10.1111/j.1744-7348.2010.00455.x.
Jena, K. K., & Kim, S. M. (2010). Current status of brown planthopper (BPH) resistance and genetics. Rice, 3(2–3), 161–171. https://doi.org/10.1007/s12284-010-9050-y.
Liu, L., Wu, Z., & Cheng, Z. (2012). Image recognition of wheat diseases based on improved color. Feature. Journal of Anhui Agricultural Sciences, 40(26), 12877–12879. https://doi.org/10.3969/j.issn.0517-6611.2012.26.054.
Mark, E., & John, W. (2006). The PASCAL visual object classes challenge 2007 (VOC2007) development kit. International Journal of Computer Vision, 111(1), 98–136.
More, S., & Nighot, M. (2016). AgroSearch: A web based search tool for pomegranate diseases and pests detection using image processing. In The second international conference on Information & Communication Technology for Competitive Strategies. New York, USA: Association for Computing Machinery, pp. 1–6. https://doi.org/10.1145/2905055.2905102.
Moscetti, R., Monarca, D., Cecchini, M., Haff, R. P., Contini, M., et al. (2014). Detection of mold-damaged chestnuts by near-infrared spectroscopy. Postharvest Biology and Technology, 93(2), 83–90. https://doi.org/10.1016/j.postharvbio.2014.02.009.
Redmon, J., Divvala, S., & Girshick, B. (2016). You only look once: Unified, real-time object detection. In 2016 IEEE conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR.2016.91.
Redmon, J., & Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv:1409.1556.
Redmon, J., & Farhadi, A. (2017). YOLO9000: Better, faster, stronger. In 2017 IEEE conference on computer vision and pattern recognition (pp. 6517–6525). https://doi.org/10.1109/CVPR.2017.690.
Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031.
Roldan-Serrato, L., Baydyk, T., Kussul, E., Escalante-Estrada, A., & Gonzalez Rodriguez, M. T. (2015). Recognition of pests on crops with a random subspace classifier. San Sebastian, Spain: IEEE.
Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556.
Singh, C. B., Jayas, D. S., Paliwal, J., & White, N. D. G. (2009). Detection of insect-damaged wheat kernels using near-infrared hyperspectral imaging. Journal of Stored Products Research, 45(3), 151–158. https://doi.org/10.1016/j.jspr.2008.12.002.
Wang, Y., Xu, L., Xia, X., & Kang, Y. (2009). Experimental study on the effect of different spraying apparatus on rice diseases and insect pests. Modern Agricultural Science and Technology, 2009(1), 117–120. https://doi.org/10.3969/j.issn.1007-5739.2009.01.071.
Wang, J., Zhang, W., Liu, L., & Huang, S. (2014). Summary of crop diseases and pests image recognition technology. Computer Engineering and Science, 36(7), 1363–1370. https://doi.org/10.3969/j.issn.1007-130X.2014.07.026.
Westbrook, J. K., Eyster, R. S., & Wolf, W. W. (2014). WSR-88D Doppler radar detection of corn earworm moth migration. International Journal of Biometeorology, 58(5), 931–940. https://doi.org/10.1007/s00484-013-0676-5.
Xie, J., Hou, Q., Shi, Y., Peng, L., Jing, L., Zhuang, F., et al. (2018). The automatic identification of butterfly species. Journal of Computer Research and Development, 55(8), 1609–1618. https://doi.org/10.7544/issn1000-1239.2018.20180181.
Xu, J. (2013). Pyramiding of two BPH resistance genes and Stv-b i gene using marker-assisted selection in japonica rice. Crop Breeding and Applied Biotechnology, 13(2), 99–106. https://doi.org/10.1590/S1984-70332013000200001.
Zeiler, M. D., & Fergus, R. (2014). Visualizing and understanding convolutional networks. In European conference on computer vision 2014. Zurich, Switzerland: Springer.
Zhang, X., Fang, R., Cai, J., & Xu, L. (2001). Research on image recognition technique for Pebrine in silkworm. Transactions of the Chinese Society of Agricultural Machinery, 32(05), 65–68. https://doi.org/10.3969/j.issn.1000-1298.2001.05.021.
Zhou, Z., Luo, X., Zhang, Y., Li, Y., & Zang, Y. (2010). Machine-based technologies for detecting and monitoring insect pests of crops: A review. Acta Entomologica Sinica, 53(1), 98–109. https://doi.org/10.1016/S1002-0721(10)60377-8.
Acknowledgements
This work was supported by the National Natural Science Foundation of China (31871520 and 31371539), the National Key R&D Program of China (2018YFD0200301), Science and Technology Plan of Guangdong Province of China (2017B090903007) and Innovative Research Team of Agricultural and Rural Big Data in Guangdong Province of China (2019KJ138). We also thank the anonymous reviewers for their critical comments and suggestions to improve the manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
He, Y., Zhou, Z., Tian, L. et al. Brown rice planthopper (Nilaparvata lugens Stal) detection based on deep learning. Precision Agric 21, 1385–1402 (2020). https://doi.org/10.1007/s11119-020-09726-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-020-09726-2