Skip to main content

Advertisement

Log in

Comprehensive machine and deep learning analysis of sensor-based human activity recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Human Activity Recognition (HAR) is a crucial research focus in the body area networks and pervasive computing domains. The goal of HAR is to examine activities from raw sensor data, video sequences, or even images. It aims to classify input data correctly into its underlying category. In the current study, machine and deep learning approaches along with different traditional dimensionality reduction and TDA feature extraction techniques are suggested to solve the HAR problem. Two public datasets (i.e., WISDM and UCI-HAR) are used to conduct the experiments. Different data balancing techniques are utilized to deal with the problem of imbalanced data. Additionally, a sampling mechanism with two overlapping percentages (i.e., 0% and 50%) is applied to each dataset to retrieve four balanced datasets. Five traditional dimensionality reduction techniques in addition to the Topological Data Analysis (TDA) are utilized. Seven machine learning (ML) algorithms are used to perform HAR where six of them are ensemble classifiers. In addition to that, 1D-CNN, BiLSTM, and GRU deep learning approaches are utilized. Three categories of experiments (i.e., ML with traditional features, ML with TDA, and DL) are applied. For the first category experiments, the best-reported scores concerning the WISDM dataset are accuracy and WSM of 99.10% and 86.61%, respectively. When concerning the UCI-HAR dataset, the best-reported scores are accuracy and WSM of 100% and 100%, respectively. For the second category experiments, the best-reported scores concerning the WISDM dataset are accuracy and WSM of 95.34% and 89.62%, respectively. When concerning the UCI-HAR dataset, the best-reported scores are accuracy and WSM of 96.70% and 92.57%, respectively. For the third category experiments, the best-reported scores concerning the WISDM dataset are accuracy and WSM of 99.90% and 99.76%, respectively. When concerning the UCI-HAR dataset, the best-reported scores are accuracy and WSM of 100% and 100%, respectively. After concluding the final results, the suggested approach is compared with 6 related studies utilizing the same dataset(s).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

The datasets, if existing, that are used, generated, or analyzed during the current study (A) if the datasets are owned by the authors, they are available from the corresponding author on reasonable request, (B) if the datasets are not owned by the authors, the supplementary information including the links and sizes are included in this published article.

Abbreviations

AI:

Artificial intelligence

HAR:

Human activity recognition

SVM:

Support vector machine

CNN:

Convolution neural network

LSTM:

Long short-term memory

SMOTE:

Synthetic minority oversampling technique

SMOTEN:

Synthetic minority over-sampling technique for nominal

DBSMOTE:

Density-based SMOTE

PCA:

Principal component analysis

LDA:

Linear discriminant analysis

ICA:

Independent component analysis

RP:

Random projection

T-SVD:

Truncated singular value decomposition

TDA:

Topological data analysis

ML:

Machine learning

LGBM:

Light gradient boosting machine

XGB:

XGBoost

AdaBoost:

Adaptive boosting

HGB:

Histogram-based gradient boosting

RF:

Random forest

DT:

Decision tree

ETs:

Extra trees

ADASYN:

Adaptive synthetic

SOTA:

State-of-the-art

GS:

Grid search

GBDT:

Gradient boosting decision tree

References

  1. Balaha HM, Hassan AE-S (2022) Skin cancer diagnosis based on deep transfer learning and sparrow search algorithm. Neural Comput Appl 35:1–39

    Google Scholar 

  2. Balaha HM, Hassan AE-S (2022) A variate brain tumor segmentation, optimization, and recognition framework. Artif Intell Rev https://doi.org/10.1007/s10462-022-10337-8

    Article  Google Scholar 

  3. Baghdadi NA, Alsayed SK, Malki GA, Balaha HM, Farghaly Abdelaliem SM (2023) An analysis of burnout among female nurse educators in saudi arabia using k-means clustering. EEur J Investig Health Psychol Educ 13(1):33–53

    Google Scholar 

  4. Balaha HM, Saafan MM (2021) Automatic exam correction framework (aecf) for the mcqs, essays, and equations matching. IEEE Access 9:32368–32389

    Google Scholar 

  5. Balaha MH, El-Ibiary MT, El-Dorf AA, El-Shewaikh SL, Balaha HM (2022) Construction and writing flaws of the multiple-choice questions in the published test banks of obstetrics and gynecology: Adoption, caution, or mitigation? Avicenna J Med 12(03):138–147

    Google Scholar 

  6. Balaha HM, El-Gendy EM, Saafan MM (2022) A complete framework for accurate recognition and prognosis of covid-19 patients based on deep transfer learning and feature classification approach.Artif Intell Rev 55(6):5063–5108

    Google Scholar 

  7. Baghdadi NA, Malki A, Balaha HM, AbdulAzeem Y, Badawy M, Elhosseini M (2022) Classification of breast cancer using a manta-ray foraging optimized transfer learning framework.PeerJ Comput Sci 8:1054

    Google Scholar 

  8. Balaha HM, Shaban AO, El-Gendy EM, Saafan MM (2022) A multi-variate heart disease optimization and recognition framework. Neural Comput Appl 34(18):15907–15944

    Google Scholar 

  9. Balaha MM, El-Kady S, Balaha HM, Salama M, Emad E, Hassan M, Saafan MM (2022) A vision-based deep learning approach for independent-users arabic sign language interpretation. Multimed Tools Appl https://doi.org/10.1007/s11042-022-13423-9

    Article  Google Scholar 

  10. Baghdadi NA, Malki A, Balaha HM, AbdulAzeem Y, Badawy M, Elhosseini M (2022) An optimized deep learning approach for suicide detection through arabic tweets. PeerJ Comput Sci 8:1070

    Google Scholar 

  11. Yousif NR, Balaha HM, Haikal AY, El-Gendy EM (2022) A generic optimization and learning framework for parkinson disease via speech and handwritten records. J Ambient Intell Human Comput https://doi.org/10.1007/s12652-022-04342-6

    Article  Google Scholar 

  12. Yassine A, Singh S, Alamri A (2017) Mining human activity patterns from smart home big data for health care applications. IEEE Access 5:13131–13141

    Google Scholar 

  13. Gupta HP, Chudgar HS, Mukherjee S, Dutta T, Sharma K (2016) A continuous hand gestures recognition technique for human-machine interaction using accelerometer and gyroscope sensors. IEEE Sensors J16(16):6425–6432

    Google Scholar 

  14. Subasi A, Radhwan M, Kurdi R, Khateeb K (2018) Iot based mobile healthcare system for human activity recognition. In: 2018 15th Learning and Technology Conference (L &T), pp. 29–34 . IEEE

  15. Sridevi G, Kumar SS (2019) Image inpainting based on fractional-order nonlinear diffusion for image reconstruction. Circuits Syst Signal Process 38(8):3802–3817

    Google Scholar 

  16. Babiker M, Khalifa OO, Htike KK, Hassan A, Zaharadeen M (2017) Automated daily human activity recognition for video surveillance using neural network. In: 2017 IEEE 4th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA), pp. 1–5 . IEEE

  17. Park S.Y, Ju H, Park C.G (2016) Stance phase detection of multiple actions for military drill using foot-mounted imu. sensors 14:16

    Google Scholar 

  18. Sathyanarayana A, Ofli F, Fernandez-Luque L, Srivastava J, Elmagarmid A, Arora T, Taheri S (2016) Robust automated human activity recognition and its application to sleep research. In: 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW), pp. 495–502 . IEEE

  19. Rezaie H, Ghassemian M (2017) An adaptive algorithm to improve energy efficiency in wearable activity recognition systems.IEEE Sens J 17(16):5315–5323

    Google Scholar 

  20. Karantonis DM, Narayanan MR, Mathie M, Lovell NH, Celler BG (2006) Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring. IEEE Trans Inform Technol Biomed 10(1):156–167

    Google Scholar 

  21. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recognit Lett 119:3–11

    Google Scholar 

  22. Chen L, Hoey J, Nugent C.D, Cook D.J, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybernet Part C Appl Rev 42(6):790–808

    Google Scholar 

  23. Azorin-Lopez J, Saval-Calvo M, Fuster-Guillo A, Garcia-Rodriguez J (2016) A novel prediction method for early recognition of global human behaviour in image sequences. Neural Process Lett 43(2):363–387

    Google Scholar 

  24. Abdulazeem Y, Balaha HM, Bahgat WM, Badawy M (2021) Human action recognition based on transfer learning approach. IEEE Access 9:82058–82069

    Google Scholar 

  25. Vavoulas G, Pediaditis M, Spanakis EG, Tsiknakis M (2013) The mobifall dataset: An initial evaluation of fall detection algorithms using smartphones. In: 13th IEEE International Conference on BioInformatics and BioEngineering, pp. 1–4 . IEEE

  26. Ali S, Khan NA, Haneef M, Luo X (2017) Blind source separation schemes for mono-sensor and multi-sensor systems with application to signal detection. Circuits Syst Signal Process 36(11):4615–4636

    MathSciNet  Google Scholar 

  27. Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimed Tools Appl 76(8):10701–10719

    Google Scholar 

  28. Jain A, Kanhangad V (2016) Investigating gender recognition in smartphones using accelerometer and gyroscope sensor readings. In: 2016 International Conference on Computational Techniques in Information and Communication Technologies (ICCTICT), pp. 597–602 . IEEE

  29. Lim WK, Davila S, Teo JX, Yang C, Pua CJ, Blöcker C, Lim JQ, Ching J, Yap JJL, Tan SY et al (2018) Beyond fitness tracking: the use of consumer-grade wearable data from normal volunteers in cardiovascular and lipidomics research. PLoS Biol 16(2):2004285

    Google Scholar 

  30. Tison GH, Sanchez JM, Ballinger B, Singh A, Olgin JE, Pletcher MJ, Vittinghoff E, Lee ES, Fan SM, Gladstone RA et al (2018) Passive detection of atrial fibrillation using a commercially available smartwatch. JAMA Cardiol 3(5):409–416

    Google Scholar 

  31. Lu T-C, Fu C-M, Ma MH-M, Fang C-C, Turner AM (2016) Healthcare applications of smart watches. Appl Clin Inform 7(03):850–869

    Google Scholar 

  32. Lunney A, Cunningham NR, Eastin MS (2016) Wearable fitness technology: a structural investigation into acceptance and perceived fitness outcomes. Comput Human Behav 65:114–120

    Google Scholar 

  33. Alani AA, Cosma G, Taherkhani A (2020) Classifying imbalanced multi-modal sensor data for human activity recognition in a smart home using deep learning. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 . IEEE

  34. Zhang Y, Zhang Z, Zhang Y, Bao J, Zhang Y, Deng H (2019) Human activity recognition based on motion sensor using u-net. IEEE Access 7:75213–75226

    Google Scholar 

  35. Buda M, Maki A, Mazurowski MA (2018) A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw 106:249–259

    Google Scholar 

  36. Ravi D, Wong C, Lo B, Yang G-Z (2016) Deep learning for human activity recognition: A resource efficient implementation on low-power devices. In: 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 71–76 . IEEE

  37. Wang J, Chen Y, Hao S, Peng X, Hu L (2018) Deep learning for sensor-based activity recognition: a survey, pattern recognition letters. Elsevier, Oxford

    Google Scholar 

  38. Panwar M, Dyuthi SR, Prakash KC, Biswas D, Acharyya A, Maharatna K, Gautam A, Naik GR (2017) Cnn based approach for activity recognition using a wrist-worn accelerometer. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2438–2441 . IEEE

  39. Balaha HM, Ali HA, Saraya M, Badawy M (2021) A new arabic handwritten character recognition deep learning system (ahcr-dls). Neural Comput Appl 33:6325–6367

    Google Scholar 

  40. Sainath TN, Vinyals O, Senior A, Sak H (2015) Convolutional, long short-term memory, fully connected deep neural networks. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4580–4584 . IEEE

  41. Reining C, Niemann F, Moya Rueda F, Fink GA, ten Hompel M (2019) Human activity recognition for production and logistics-a systematic literature review. Information 10(8):245

    Google Scholar 

  42. Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL (2012) Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine. In: International Workshop on Ambient Assisted Living, pp. 216–223 . Springer

  43. Jiang W, Yin Z (2015) Human activity recognition using wearable sensors by deep convolutional neural networks. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1307–1310

  44. Shi J, Zuo D, Zhang Z (2020) Transition activity recognition system based on standard deviation trend analysis. Sensors 20(11):3117

    Google Scholar 

  45. Garcia-Gonzalez D, Rivero D, Fernandez-Blanco E, Luaces MR (2020) A public domain dataset for real-life human activity recognition using smartphone sensors. Sensors 20(8):2200

    Google Scholar 

  46. Ahmed N, Rafiq JI, Islam MR (2020) Enhanced human activity recognition based on smartphone sensor data using hybrid feature selection model. Sensors 20(1):317

    Google Scholar 

  47. Reyes-Ortiz J-L, Oneto L, Sama A, Parra X, Anguita D (2016) Transition-aware human activity recognition using smartphones. Neurocomputing 171:754–767

    Google Scholar 

  48. Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681

    Google Scholar 

  49. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Google Scholar 

  50. Chen K, Zhang D, Yao L, Guo B, Yu Z, Liu Y (2021) Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities.ACM Comput Surv (CSUR) 54(4):1–40

    Google Scholar 

  51. Barut O, Zhou L, Luo Y (2020) Multitask lstm model for human activity recognition and intensity estimation using wearable sensor data. IEEE Internet Things J 7(9):8760–8768

    Google Scholar 

  52. Wang L, Liu R (2020) Human activity recognition based on wearable sensor using hierarchical deep lstm networks. Circuits Syst Signal Process39(2):837–856

    Google Scholar 

  53. Pham C, Nguyen-Thai S, Tran-Quang H, Tran S, Vu H, Tran T-H, Le T-L (2020) Senscapsnet: Deep neural network for non-obtrusive sensing based human activity recognition. IEEE Access 8:86934–86946

    Google Scholar 

  54. Gil-Martín M, San-Segundo R, Fernandez-Martinez F, Ferreiros-López J (2020) Improving physical activity recognition using a new deep learning architecture and post-processing techniques. Eng Appl Artif Intell 92:103679

    Google Scholar 

  55. Xu C, Chai D, He J, Zhang X, Duan S (2019) Innohar: a deep neural network for complex human activity recognition. Ieee Access 7:9893–9902

    Google Scholar 

  56. Kwapisz JR, Weiss GM, Moore SA (2011) Activity recognition using cell phone accelerometers. ACM SigKDD Explor Newslett 12(2):74–82

    Google Scholar 

  57. Chavarriaga R, Sagha H, Calatroni A, Digumarti S.T, Tröster G, Millán J.d.R, Roggen D (2013) The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit Lett 34(15):2033–2042

    Google Scholar 

  58. Teng Q, Wang K, Zhang L, He J (2020) The layer-wise training convolutional neural networks using local loss for sensor-based human activity recognition. IEEE Sens J 20(13):7265–7274

    Google Scholar 

  59. Roggen D, Calatroni A, Rossi M, Holleczek T, Förster K, Tröster G, Lukowicz P, Bannach D, Pirkl G, Ferscha A, et al (2010) Collecting complex activity datasets in highly rich networked sensor environments. In: 2010 Seventh International Conference on Networked Sensing Systems (INSS), pp. 233–240. IEEE

  60. Micucci D, Mobilio M, Napoletano P (2017) Unimib shar: a dataset for human activity recognition using acceleration data from smartphones. Appl Sci 7(10):1101

    Google Scholar 

  61. Reiss A, Stricker D (2012) Introducing a new benchmarked dataset for activity monitoring. In: 2012 16th International Symposium on Wearable Computers, pp. 108–109 . IEEE

  62. Ronao CA, Cho S-B (2016) Human activity recognition with smartphone sensors using deep learning neural networks. Expert Syst Appl 59:235–244

    Google Scholar 

  63. Lee Y-S, Cho S-B (2011) Activity recognition using hierarchical hidden markov models on a smartphone with 3d accelerometer. In: International Conference on Hybrid Artificial Intelligence Systems, pp. 460–467 . Springer

  64. Bianchi V, Bassoli M, Lombardo G, Fornacciari P, Mordonini M, De Munari I (2019) Iot wearable sensor and deep learning: An integrated approach for personalized human activity recognition in a smart home environment. IEEE Internet Things J 6(5):8553–8562

    Google Scholar 

  65. Lawal IA, Bano S (2020) Deep human activity recognition with localisation of wearable sensors. IEEE Access 8:155060–155070

    Google Scholar 

  66. Ordóñez FJ, Roggen D (2016) Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1):115

    Google Scholar 

  67. Zappi P, Lombriser C, Stiefmeier T, Farella E, Roggen D, Benini L, Tröster G (2008) Activity recognition from on-body sensors: accuracy-power trade-off by dynamic sensor selection. In: European Conference on Wireless Sensor Networks, pp. 17–33. Springer

  68. Xia K, Huang J, Wang H (2020) Lstm-cnn architecture for human activity recognition. IEEE Access 8:56855–56866

    Google Scholar 

  69. Ignatov A (2018) Real-time human activity recognition from accelerometer data using convolutional neural networks. Appl Soft Comput 62:915–922

    Google Scholar 

  70. Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL et al (2013) A public domain dataset for human activity recognition using smartphones. Esann 3:3

    Google Scholar 

  71. Khan ZN, Ahmad J (2021) Attention induced multi-head convolutional neural network for human activity recognition. Appl Soft Comput 110:107671

    Google Scholar 

  72. Twomey N, Diethe T, Kull M, Song H, Camplani M, Hannuna S, Fafoutis X, Zhu N, Woznowski P, Flach P, et al (2016) The sphere challenge: Activity recognition with multimodal sensor data. arXiv preprint arXiv:1603.00797

  73. Grzeszick R, Lenk JM, Rueda FM, Fink GA, Feldhorst S, ten Hompel M (2017) Deep neural network based human activity recognition for the order picking process. In: Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction, pp. 1–6

  74. Feldhorst S, Masoudenijad M, ten Hompel M, Fink GA (2016) Motion classification for analyzing the order picking process using mobile sensors. In: Proc. Int. Conf. Pattern Recognition Applications and Methods, pp. 706–713

  75. Sun Y, Wong AK, Kamel MS (2009) Classification of imbalanced data: a review. Int J Pattern Recognit Artif Intell 23(04):687–719

    Google Scholar 

  76. He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263–1284

    Google Scholar 

  77. Branco P, Torgo L, Ribeiro R (2015) A survey of predictive modelling under imbalanced distributions. arXiv preprint arXiv:1505.01658

  78. He H, Ma Y (2013) Imbalanced learning: foundations, algorithms, and applications

  79. Tomek I (1976) A generalization of the k-nn rule. IEEE Trans Syst Man Cybern 2:121–126

    MathSciNet  MATH  Google Scholar 

  80. Lemaître G, Nogueira F, Aridas CK (2017) Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning. J Mach Learn Res 18(1):559–563

    Google Scholar 

  81. Yap BW, Abd Rani K, Abd Rahman HA, Fong S, Khairudin Z, Abdullah NN (2014) An application of oversampling, undersampling, bagging and boosting in handling imbalanced datasets. In: Proceedings of the First International Conference on Advanced Data and Information Engineering (DaEng-2013), pp. 13–22 . Springer

  82. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) Smote: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357

    MATH  Google Scholar 

  83. Stanfill C, Waltz D (1986) Toward memory-based reasoning. Commun ACM 29(12):1213–1228

    Google Scholar 

  84. Cost S, Salzberg S (1993) A weighted nearest neighbor algorithm for learning with symbolic features. Mach Learn 10(1):57–78

    Google Scholar 

  85. Han H, Wang W-Y, Mao B-H (2005) Borderline-smote: a new over-sampling method in imbalanced data sets learning. In: International Conference on Intelligent Computing, pp. 878–887 . Springer

  86. He H, Bai Y, Garcia EA, Li S (2008) Adasyn: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp. 1322–1328 . IEEE

  87. Last F, Douzas G, Bacao F (2017) Oversampling for imbalanced learning based on k-means and smote. arXiv preprint arXiv:1711.00837

  88. Nguyen HM, Cooper EW, Kamei K (2011) Borderline over-sampling for imbalanced data classification. Int J Knowl Eng Soft Data Paradig 3(1):4–21

    Google Scholar 

  89. Yan W, Yu L (2019) On accurate and reliable anomaly detection for gas turbine combustors: A deep learning approach. arXiv preprint arXiv:1908.09238

  90. Domingos P (2012) A few useful things to know about machine learning. Commun ACM 55(10):78–87

    Google Scholar 

  91. Brownlee J (2014) Discover feature engineering, how to engineer features and how to get good at it. Machine Learning Process

  92. Balaha HM, Ali HA, Youssef EK, Elsayed AE, Samak RA, Abdelhaleem MS, Tolba MM, Shehata MR, Mahmoud MR, Abdelhameed MM et al (2021) Recognizing arabic handwritten characters using deep learning and genetic algorithms.Multimed Tools Appl 80:32473–32509

    Google Scholar 

  93. Chatzimparmpas A, Martins RM, Kucher K, Kerren A (2022) Featureenvi: Visual analytics for feature engineering using stepwise selection and semi-automatic extraction approaches. IEEE Trans Visual Comput Graphic 28(4):1773–1791

    Google Scholar 

  94. Heaton J (2016) An empirical analysis of feature engineering for predictive modeling. In: SoutheastCon 2016, pp. 1–6. IEEE

  95. Liu H, Motoda H (1998) Feature transformation and subset selection. IEEE Intell Syst Their Appl 13(2):26–28

    Google Scholar 

  96. Patel K, Fogarty J, Landay JA, Harrison B (2008) Investigating statistical machine learning as a tool for software development. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 667–676

  97. Markovitch S, Rosenstein D (2002) Feature generation using general constructor functions. Machine Learn 49(1):59–98

    MATH  Google Scholar 

  98. Schuller B, Reiter S, Rigoll G (2006) Evolutionary feature generation in speech emotion recognition. In: 2006 IEEE International Conference on Multimedia and Expo, pp. 5–8 . IEEE

  99. Kankanige Y, Bailey J (2014) Improved feature transformations for classification using density estimation. In: Pacific Rim International Conference on Artificial Intelligence, pp. 117–129 . Springer

  100. Storcheus D, Rostamizadeh A, Kumar S (2015) A survey of modern questions and challenges in feature extraction. In: Feature Extraction: Modern Questions and Challenges, pp. 1–18 . PMLR

  101. Molina LC, Belanche L, Nebot À (2002) Feature selection algorithms: a survey and experimental evaluation. In: 2002 IEEE International Conference on Data Mining, 2002. Proceedings., pp. 306–313 . IEEE

  102. Chandrashekar G, Sahin F (2014) A survey on feature selection methods. Comput Electr Eng 40(1):16–28

    Google Scholar 

  103. Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(Mar):1157–1182

    MATH  Google Scholar 

  104. Khalid S, Khalil T, Nasreen S (2014) A survey of feature selection and feature extraction techniques in machine learning. In: 2014 Science and Information Conference, pp. 372–378 . IEEE

  105. Tharwat A (2016) Principal component analysis-a tutorial. Int J Appl Pattern Recognit 3(3):197–240

    Google Scholar 

  106. Fisher RA (1938) The statistical utilization of multiple measurements. Ann Eugen 8(4):376–386

    MATH  Google Scholar 

  107. Fukunaga K (2013) Introduction to Statistical Pattern Recognition. Elsevier, Newyork

    MATH  Google Scholar 

  108. Tang B, Shepherd M, Milios E, Heywood MI (2005) Comparing and combining dimension reduction techniques for efficient text clustering. In: Proceeding of SIAM International Workshop on Feature Selection for Data Mining, pp. 17–26

  109. Dasgupta S (2000) Experiments with random projection. Uncertainty in Artificial Intelligence: Proceedings of the Sixteenth Conference (UAI-2000)(pp. 143–151). Morgan Kaufmann

  110. Halko N, Martinsson P-G, Tropp JA (2011) Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev 53(2):217–288

    MathSciNet  MATH  Google Scholar 

  111. Euler L (1741) Solutio problematis ad geometriam situs pertinentis. Commentarii academiae scientiarum Petropolitanae, 128–140

  112. Carlsson G (2009) Topology and data. Bull Am Math Soc 46(2):255–308

    MathSciNet  MATH  Google Scholar 

  113. Chazal F (2016) High-dimensional topological data analysis. CRC Press

    Google Scholar 

  114. Rosenstock S (2021) Learning from the shape of data. Philos Sci 88(5):1033–1044

    MathSciNet  Google Scholar 

  115. Edelsbrunner H, Letscher D, Zomorodian A (2000) Topological persistence and simplification. In: Proceedings 41st Annual Symposium on Foundations of Computer Science, pp. 454–463 . IEEE

  116. Zomorodian A, Carlsson G (2005) Computing persistent homology. Discret Compu Geom 33(2):249–274

    MathSciNet  MATH  Google Scholar 

  117. Singh G, Mémoli F, Carlsson GE et al (2007) Topological methods for the analysis of high dimensional data sets and 3d object recognition. PBG @ Eurograp 2:91–100

    Google Scholar 

  118. Li L, Cheng W-Y, Glicksberg BS, Gottesman O, Tamler R, Chen R, Bottinger EP, Dudley JT (2015) Identification of type 2 diabetes subgroups through topological analysis of patient similarity. Sci Trans Med 7(311):311–174311174

    Google Scholar 

  119. Nicolau M, Levine AJ, Carlsson G (2011) Topology based data analysis identifies a subgroup of breast cancers with a unique mutational profile and excellent survival. Proc Natl Acad Sci 108(17):7265–7270

    Google Scholar 

  120. Balaha HM, Balaha MH, Ali HA (2021) Hybrid covid-19 segmentation and recognition framework (hmb-hcf) using deep learning and genetic algorithms. Artif Intell Med 119:102156

    Google Scholar 

  121. Ahsan MM, Mahmud M, Saha PK, Gupta KD, Siddique Z (2021) Effect of data scaling methods on machine learning algorithms and model performance. Technologies 9(3):52

    Google Scholar 

  122. Smaczny C (2018) Feature preprocessing in hep at the example of a susy classification problem

  123. Shaheen H, Agarwal S, Ranjan P (2020) Minmaxscaler binary pso for feature selection. In: First International Conference on Sustainable Technologies for Computational Intelligence, pp. 705–716 . Springer

  124. Abosamra G, Faloudah A (2019) Machine learning based marks prediction to support recommendation of optimum specialization and study track. Int J Comput Appl 975:8887

    Google Scholar 

  125. Iglewicz B (1983) Robust scale estimators and confidence intervals for location. Understanding robust and exploratory data analysis, 405431

  126. Hu J, Niu H, Carrasco J, Lennox B, Arvin F (2020) Voronoi-based multi-robot autonomous exploration in unknown environments via deep reinforcement learning. IEEE Trans Veh Technol 69(12):14413–14423

    Google Scholar 

  127. Ribeiro M, Grolinger K, Capretz MA (2015) Mlaas: Machine learning as a service. In: 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA), pp. 896–902 . IEEE

  128. Marr B (2018) What is deep learning ai? a simple guide with 8 practical examples. Forbes. Retrieved October 9, 2021

  129. Baghdadi NA, Malki A, Abdelaliem SF, Balaha HM, Badawy M, Elhosseini M (2022) An automated diagnosis and classification of covid-19 from chest ct images using a transfer learning-based convolutional neural network. Comput Biol Med 144:105383

    Google Scholar 

  130. Sejnowski TJ (2018) The Deep Learning Revolution. MIT press, Cambridge

    Google Scholar 

  131. Balaha HM, Saif M, Tamer A, Abdelhay EH (2022) Hybrid deep learning and genetic algorithms approach (hmb-dlgaha) for the early ultrasound diagnoses of breast cancer. Neural Comput Appl 34(11):8671–8695

    Google Scholar 

  132. Baghdadi NA, Malki A, Balaha HM, Badawy M, Elhosseini M (2022) A3c-tl-gto: Alzheimer automatic accurate classification using transfer learning and artificial gorilla troops optimizer. Sensors 22(11):4250

    Google Scholar 

  133. Straczkiewicz M, James P, Onnela J-P (2021) A systematic review of smartphone-based human activity recognition methods for health research. NPJ Dig Med 4(1):1–15

    Google Scholar 

  134. Polikar R (2012) Ensemble learning. In: Ensemble Machine Learning, pp. 1–34. Springer

  135. Brownlee J (2020) Gradient boosting with scikit-learn, xgboost, lightgbm, and catboost. Machine Learning Mastery

  136. Kopitar L, Kocbek P, Cilar L, Sheikh A, Stiglic G (2020) Early detection of type 2 diabetes mellitus using machine learning-based prediction models. Sci Rep 10(1):1–12

    Google Scholar 

  137. Quinlan JR (1987) Simplifying decision trees. Int J Man-mach Stud 27(3):221–234

    Google Scholar 

  138. Rawat R, Mahor V, Chirgaiya S, Shaw RN, Ghosh A (2021) Analysis of darknet traffic for criminal activities detection using tf-idf and light gradient boosted machine learning algorithm. In: Innovations in Electrical and Electronic Engineering, pp. 671–681. Springer

  139. Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, pp. 785–794

  140. Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139

    MathSciNet  MATH  Google Scholar 

  141. Breiman L (2001) Random forests. Mach Learn 45(1):5–32

    MATH  Google Scholar 

  142. Ho TK (1995) Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 278–282 . IEEE

  143. Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844

    Google Scholar 

  144. Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and regression trees (wadsworth, belmont, ca). ISBN-13, 978–0412048418

  145. Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learnin. Cited on, 33

  146. Geurts P, Ernst D, Wehenkel L (2006) Extremely randomized trees. Mach Learn 63(1):3–42

    MATH  Google Scholar 

  147. Brownlee J (2018) 1D convolutional neural network models for human activity recognition

  148. Kiranyaz S, Avci O, Abdeljaber O, Ince T, Gabbouj M, Inman DJ (2021) 1d convolutional neural networks and applications: a survey. Mech Syst signal Process 151:107398

    Google Scholar 

  149. Cho K, Van Merriënboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259

  150. Gers FA, Schmidhuber J, Cummins F (2000) Learning to forget: continual prediction with lstm. Neural Comput 12(10):2451–2471

    Google Scholar 

  151. Britz D (2015) Recurrent neural network tutorial, part 4 implementing a gru/lstm rnn with python and theano. URL http://www.wildml.com/2015/10/recurrent-neural-network-tutorial-part-4-implementing-a-grulstm-rnn-with-python-and-theano

  152. Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555

  153. Zhao C, Huang X, Li Y, Yousaf Iqbal M (2020) A double-channel hybrid deep neural network based on cnn and bilstm for remaining useful life prediction. Sensors 20(24):7109

    Google Scholar 

  154. Refaeilzadeh P, Tang L, Liu H (2009) Cross-validation. EEncycl Database Syst 5:532–538

    Google Scholar 

  155. Sharaby I, Alksas A, Nashat A, Balaha HM, Shehata M, Gayhart M, Mahmoud A, Ghazal M, Khalil A, Abouelkheir RT et al (2023) Prediction of wilms’ tumor susceptibility to preoperative chemotherapy using a novel computer-aided prediction system. Diagnostics 13(3):486

    Google Scholar 

  156. Bahgat WM, Balaha HM, AbdulAzeem Y, Badawy MM (2021) An optimized transfer learning-based approach for automatic diagnosis of covid-19 from chest x-ray images.PeerJ Comput Sci 7:555

    Google Scholar 

  157. Balaha HM, El-Gendy EM, Saafan MM (2021) Covh2sd: A covid-19 detection approach based on harris hawks optimization and stacked deep learning. Expert Syst Appl 186:115805

    Google Scholar 

  158. Kapp MN, Sabourin R, Maupin P (2012) A dynamic model selection strategy for support vector machine classifiers. Appl Soft Comput 12(8):2550–2565

    Google Scholar 

  159. MONTGOMERY D.C (2013) Design and analysis of experiments, eight ed.,. a john wiley & sons. Inc

    Google Scholar 

  160. Elgendy M, Balaha HM, Shehata M, Alksas A, Ghoneim M, Sherif F, Mahmoud A, Elgarayhi A, Taher F, Sallah M et al (2022) Role of imaging and ai in the evaluation of covid-19 infection: a comprehensive survey. Front biosci (Landmark edition) 27(9):276

    Google Scholar 

Download references

Funding

No funding was received for this work (i.e., study).

Author information

Authors and Affiliations

Authors

Contributions

All the authors have participated in writing the manuscript and have revised the final version. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hossam Magdy Balaha.

Ethics declarations

Conflict of interest

No conflict of interest exists. We wish to confirm that, there are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome.

Intellectual property

We confirm that, we have given due consideration to the protection of intellectual property associated with this work and that there are no impediments to publication, including the timing of publication, concerning intellectual property. In so doing we confirm that we have followed the regulations of our institutions concerning intellectual property.

Research ethics

We further confirm, if existing, that any aspect of the work covered in this manuscript that has involved human patients has been conducted with the ethical approval of all relevant bodies and that such approvals are acknowledged within the manuscript. Written consent to publish potentially identifying information, such as details of the case and photographs, was obtained from the patient(s) or their legal guardian(s).

Authorship

We confirm that the manuscript has been read and approved by all named authors. We confirm that the order of authors listed in the manuscript has been approved by all named authors.

Compliance with ethical standards

The current study does not contain any studies with human participants and/or animals performed by any of the authors.

Consent to participate

There is no informed consent for the current study.

Consent for publication

Not Applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Balaha, H.M., Hassan, A.ES. Comprehensive machine and deep learning analysis of sensor-based human activity recognition. Neural Comput & Applic 35, 12793–12831 (2023). https://doi.org/10.1007/s00521-023-08374-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08374-7

Keywords

Navigation