Skip to main content

Abnormal Behavior Detection in Farming Stream Data

  • Conference paper
  • First Online:
Smart and Sustainable Agriculture (SSA 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1470))

Included in the following conference series:

  • 371 Accesses

Abstract

Farmers have been able to detect, quantify, and respond to spatial and temporal variation in crops thanks to a variety of technological advancements in recent years. Precision farming aims to provide precise targeting of agricultural inputs while reducing waste and negative consequences. Precision agriculture technologies are effective instruments for increasing farm sustainability and production. These technologies provide ways to create more with less resources. Nowadays, improving agricultural production efficiency and crop yields is impossible without the use of contemporary digital technologies and smart machinery. The introduction of high-accuracy GPS technology into farm machinery, such as combine harvesters, has been a significant component of precision farming. In this paper, we present a streaming-based methodology for detecting anomalies in combine harvester GPS recordings. The key hypothesis is that, “similar points in a feature space have similar anomaly scores”. We examine a data-driven strategy with the goal of applying unsupervised detection algorithms to find anomalies on the fly. Based on the results of the experiments, we can conclude that LSCP beats all other strategies when the number of base detectors is varied. The AUCPR performance of LSCP with two base detectors (HBOS and MCD) is 8.02% better than the second best technique MCD.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abdallah, M., Lee, W.J., Raghunathan, N., Mousoulis, C., Sutherland, J.W., Bagchi, S.: Anomaly detection through transfer learning in agriculture and manufacturing IoT systems. arXiv preprint arXiv:2102.05814 (2021)

  2. Aggarwal, C.C.: Outlier analysis. In: Aggarwal, C.C. (ed.) Data Mining, pp. 237–263. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-14142-8_8

    Chapter  Google Scholar 

  3. Boyd, K., Eng, K.H., Page, C.D.: Area under the precision-recall curve: point estimates and confidence intervals. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) ECML PKDD 2013. LNCS (LNAI), vol. 8190, pp. 451–466. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40994-3_29

    Chapter  Google Scholar 

  4. Campos, G.O., et al.: On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. Data Min. Knowl. Disc. 30(4), 891–927 (2016). https://doi.org/10.1007/s10618-015-0444-8

    Article  MathSciNet  Google Scholar 

  5. Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. (CSUR) 41(3), 1–58 (2009)

    Article  Google Scholar 

  6. Christiansen, P., Nielsen, L.N., Steen, K.A., Jørgensen, R.N., Karstoft, H.: DeepAnomaly: combining background subtraction and deep learning for detecting obstacles and anomalies in an agricultural field. Sensors 16(11), 1904 (2016)

    Article  Google Scholar 

  7. Faezipour, M., Nourani, M., Saeed, A., Addepalli, S.: Progress and challenges in intelligent vehicle area networks. Commun. ACM 55(2), 90–100 (2012)

    Article  Google Scholar 

  8. Fawcett, T.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006)

    Article  MathSciNet  Google Scholar 

  9. Goldstein, M., Dengel, A.: Histogram-based outlier score (HBOS): a fast unsupervised anomaly detection algorithm. In: KI-2012: Poster and Demo Track, pp. 59–63 (2012)

    Google Scholar 

  10. Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1), 29–36 (1982)

    Article  Google Scholar 

  11. Liu, F.T., Ting, K.M., Zhou, Z.H.: Isolation forest. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 413–422. IEEE (2008)

    Google Scholar 

  12. Mandrekar, J.N.: Receiver operating characteristic curve in diagnostic test assessment. J. Thorac. Oncol. 5(9), 1315–1316 (2010)

    Article  Google Scholar 

  13. Mouret, F., Albughdadi, M., Duthoit, S., Kouamé, D., Rieu, G., Tourneret, J.Y.: Outlier detection at the parcel-level in wheat and rapeseed crops using multispectral and SAR time series. Remote Sens. 13(5), 956 (2021)

    Article  Google Scholar 

  14. Pevný, T.: Loda: lightweight on-line detector of anomalies. Mach. Learn. 102(2), 275–304 (2015). https://doi.org/10.1007/s10994-015-5521-0

    Article  MathSciNet  MATH  Google Scholar 

  15. Rousseeuw, P.J., Driessen, K.V.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3), 212–223 (1999)

    Article  Google Scholar 

  16. Rousseeuw, P.J., Hubert, M.: Anomaly detection by robust statistics. Wiley Interdiscip. Rev.: Data Min. Knowl. Discov. 8(2), e1236 (2018)

    Google Scholar 

  17. Saito, T., Rehmsmeier, M.: The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PloS One 10(3), e0118432 (2015)

    Article  Google Scholar 

  18. Toshniwal, A., Mahesh, K., Jayashree, R.: Overview of anomaly detection techniques in machine learning. In: 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC), pp. 808–815. IEEE (2020)

    Google Scholar 

  19. Wang, X., Fagette, A., Sartelet, P., Sun, L.: A probabilistic tensor factorization approach to detect anomalies in spatiotemporal traffic activities. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 1658–1663. IEEE (2019)

    Google Scholar 

  20. Wang, Y., Balmos, A., Krogmeier, J., Buckmaster, D.: Data-driven agricultural machinery activity anomaly detection and classification. In: Proceedings of the 14th International Conference on Precision Agriculture (2018)

    Google Scholar 

  21. Yaguang, Z., James, K.: Combine kart truck GPS data archive (2020)

    Google Scholar 

  22. Yilmaz, S.F., Kozat, S.S.: PySAD: a streaming anomaly detection framework in Python. arXiv preprint arXiv:2009.02572 (2020)

  23. Zhang, Y., Balmos, A., Krogmeier, J.V., Buckmaster, D.: Working zone identification for specialized micro transportation systems using GPS tracks. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 1779–1784. IEEE (2015)

    Google Scholar 

  24. Zhao, Y., Nasrullah, Z., Hryniewicki, M.K., Li, Z.: LSCP: locally selective combination in parallel outlier ensembles. In: Proceedings of the 2019 SIAM International Conference on Data Mining, pp. 585–593. SIAM (2019)

    Google Scholar 

  25. Zhao, Y., Nasrullah, Z., Li, Z.: PyOD: a Python toolbox for scalable outlier detection. J. Mach. Learn. Res. 20(96), 1–7 (2019). http://jmlr.org/papers/v20/19-011.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Juliet Chebet Moso .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moso, J.C., Cormier, S., Fouchal, H., Runz, C.d., Wandeto, J.M. (2021). Abnormal Behavior Detection in Farming Stream Data. In: Boumerdassi, S., Ghogho, M., Renault, É. (eds) Smart and Sustainable Agriculture. SSA 2021. Communications in Computer and Information Science, vol 1470. Springer, Cham. https://doi.org/10.1007/978-3-030-88259-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-88259-4_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-88258-7

  • Online ISBN: 978-3-030-88259-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics