Skip to main content

Abstract

Supervised learning is the popular version of machine learning. It trains the system in the training phase by labeling each of its input with its desired output value. Unsupervised learning is another popular version of machine learning which generates inferences without the concept of labels. The most common supervised learning methods are linear regression, support vector machine, random forest, naïve Bayes, etc. The most common unsupervised learning methods are cluster analysis, K-means, Apriori algorithm, etc. This survey paper gives an overview of supervised algorithms, namely, support vector machine, decision tree, naïve Bayes, KNN, and linear regression, and an overview of unsupervised algorithms, namely, K-means, agglomerative divisive, and neural networks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Abbreviations

KNN:

K-nearest neighbor

WSD:

Word-sense disambiguation

CNN:

Convolution neural network

DT:

Decision tree

NB:

Naïve Bayes

References

  1. Chikersal P, Poria S, Cambria E. Sentimental analysis of Tweets by combining a rule-based classifier with supervised learning. International workshop on Semantic Evaluation, pp 647–651

    Google Scholar 

  2. Zemmal N, Azizi N, Dey N, Sellami M (2016) Adaptive semi supervised SVM supervised learning with feature cooperation for breast cancer classification. Journal 6:53–62

    Google Scholar 

  3. Riaz F, Hassan A, Rehman S, Niazi IK, Dremstrup K (2016) EMD-based temporal and spectral features for the classification of EEG signals using supervised learning. IEEE Trans 24(1):28–35

    Google Scholar 

  4. Neelakantan A, Collins M (2015) Learning dictionaries for named entity recognition using minimal supervision, 24 April 2015

    Google Scholar 

  5. Mansson KNT, Frick A, Boraxbekk C-J, Marquand AF, Williams SCR, Calbring P, Andersson G, Furmark T (2015) Predicting long-term outcome of Internet-delivered cognitive behaviour therapy for social anxiety disorder using fMRI and SVM

    Google Scholar 

  6. Devi Arockia Vanitha C, Devaraj D, Venkatesulu M (2015) Gene expression data classification using SVM and mutual information-based gene selection, 13–21, 2015

    Google Scholar 

  7. Ozgur Kisi, Kulwinder Singh Parmar (2015) Application of least square SVM and multivariate adaptive regression spline models in long term prediction of river water pollution, 3 August 2015

    Google Scholar 

  8. Chen L, Bi L, Si H, Zhang J, Ren Y (2015) Research on prediction method for pivotal indicator of hospital medical quality using decision tree. In: IEEE international conference, pp 247–250, 30 November 2015

    Google Scholar 

  9. Joshi A, Dangra J, Rawat M (2016) Decision tree based classification technique for accurate heart disease classification and prediction. Int J 3(11):1–4

    Google Scholar 

  10. Pradhan VM, Vala J, Balani P (2016) A survey on sentimental analysis algorithms for opinion mining. Int J 133:7–11

    Google Scholar 

  11. Gai K, Qiu M, Elnagdy SA (2016) Security-aware information classifications using supervised learning for cloud-based cyber risk management in financial big data. In: International conference

    Google Scholar 

  12. Yuan Z, Wang C (2016) Online analysis and computing science (ICOACS). IEEE international conference:53–56

    Google Scholar 

  13. Sarmah J, Sharma SKR (2016) Decision tree based supervised word sense disambiguation for Assamese. Int J Comput Appl 141(1):42–48

    Google Scholar 

  14. Jyh-Jian Sheu, Yin-Kai Chen, Ko-Tsung Chu, Jin-Hsin Tang, Wei-Pang Yang. An intelligent three phase spam filtering method based on decision tree data mining

    Google Scholar 

  15. Hui LI, Deliang Y, Lingling Y, Yao L, Xia LIN (2016) Supervised massive data analysis for telecommunication customer churn prediction. IEEE international conference

    Google Scholar 

  16. Jung YG, Kim KT, Lee B, Youn HY (2016) Enhanced naive bayes classifier for real-time sentiment analysis with SparkR. IEEE International Conference

    Google Scholar 

  17. Jiang L, Li C, Wang S, Zhang L (2016) Deep feature weighting for naive Bayes and its application to text classification. Eng Appl Artif Intell 52:26–39

    Article  Google Scholar 

  18. Nagarajan S, Chandrasekaran RM (2015) Design and implementation of expert clinical system for diagnosing diabetes using data mining techniques. Indian J Sci Technol 8(8):771–776

    Article  Google Scholar 

  19. Tchakounté F, Hayata F (2017) Supervised learning based detection of malware on Android

    Chapter  Google Scholar 

  20. Kaushik A, Gupta H, Latwal DS (2016) Impact of feature selection and engineering in the classification of handwritten text. IEEE international conference

    Google Scholar 

  21. Guinness RE (2015) Beyond where to how: a machine learning approach for sensing mobility contexts using smartphone sensors

    Google Scholar 

  22. Dhanalakshmi V, Bino D, Saravanan AM (2016) Opinion mining from student feedback data using supervised learning algorithms. International conference

    Google Scholar 

  23. de Silva H, Shehan Perera A (2017) Evolutionary K-nearest neighbour imputation algorithm for gene expression data. In: Int J

    Google Scholar 

  24. Naghibi SA, Moradi Dashtpagerdi M (2017) Evaluation of Supervised learning methods for ground water spring potential mapping in khalkhal region using GIS-based features, pp 169–189

    Google Scholar 

  25. Asencio-Cortes, Martinez-Alvarez F, Morales-Esteban A, Reyes J (2016) A Sensitivity study of seismicity indicators in supervised learning to improve earthquake prediction

    Google Scholar 

  26. Siwakorn Srisakaokul, Zhengkai Wu, Angello Astroga, Oreoluwa Alebiosu, Tao Xie, “Multiple-Implementation Testing of Supervised Learning Software”, 2018

    Google Scholar 

  27. Galan-Garcia P, de la Puerta JG, Gomez CL, Santos I, Bringas PG (2016) Supervised ML for the detection of troll profiles in twitter social network. 24(1):42–53

    Google Scholar 

  28. Kusner MJ, Sun Y, Kolkin NI, Weinberg KQ (2015) From word embeddings to document distances. International conference, vol:37

    Google Scholar 

  29. Beegum S, Chakraborty D (2016) Identifying cancer biomarkers from leukemia data using feature selection and supervised learning. IEEE international conference

    Google Scholar 

  30. Conneau A, Kiela D, Schwenk H, Barrault L, Bordes A (2018) Supervised learning of universal sentence representations from natural language inference data, July 2018

    Google Scholar 

  31. Rodrigues F, Lourenco M, Ribeiro B, Pereira FC (2017) Learning supervised topic models for classification and regression from crowds. IEEE Trans Pattern Anal Mach Intell 39(12):2409–2422

    Article  Google Scholar 

  32. Jiang C, Zhang H, Ren Y, Han Z, Chen K-C, Hanzo L (2017) Machine learning paradigms for next-generation wireless networks. IEEE Wirel Commun 24(2):98–105

    Article  Google Scholar 

  33. Quanzeng You, Jiebo Luo, Hailin Jin, Jianchao Yang. Cross-modality consistent regression for joint visual-textual sentiment analysis of social multimedia

    Google Scholar 

  34. PeirongXu HP, huang T (2018) Unsupervised learning of mixture regression models for longitudinal data. Comput Stat Data Anal 125:44–56

    Article  MathSciNet  Google Scholar 

  35. Li Y, Tao C, Tan Y, Shang K, Tian J (2016) Unsupervised multilayer feature learning for satellite image scene classification. IEEE Geosci Remote Sens Lett 13(2):157–161

    Article  Google Scholar 

  36. Salamon J, Bello JP (2015) Unsupervised feature learning for urban sound classification

    Google Scholar 

  37. Kahou SE, Bouthillier X, Lamblin P, Gulcehre C, Michalski V, Konda K, Jean S, Froumenty P, Dauphin Y, Mirza M, Warde-Farley D, Courville A, Vincent P, bangillo Y (2015) EmoNets: multimodal deep learning approaches for emotion recognition on video. J Multimod User Interface 10(2):99–111

    Article  Google Scholar 

  38. Miotto R, Li L, Kidd BA, Dudle JT (2016) Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Sci Rep 6:1

    Article  Google Scholar 

  39. Husic BE, Pande VS (2017) Unsupervised learning of dynamical and molecular similarity using variance minimization. In: Conference

    Google Scholar 

  40. Rueda A, Krishnan S. Clustering Parkinson’s and age-related voice impairment signal features for unsupervised learning

    Google Scholar 

  41. Kulkarni RA (2018) Scrutinizing action performed by user on mobile app through network using ML techniques. IEEE international conference

    Google Scholar 

  42. Weber M, Wang J, Zhou Y (2018) Unsupervised clustering for identification of malicious domain campaigns

    Google Scholar 

  43. Mazzeo GM, Zaniolo C (2016) The parallelization of a complex hierarchical clustering algorithm: faster unsupervised learning on larger datasets

    Google Scholar 

  44. Gargouri M, Touj SM, Ben Amara NE (2015) Towards unsupervised learning and graphical representation for on-line handwriting script. IEEE international conference

    Google Scholar 

  45. Unnisa M, Ameen A, Raziuddin S (2016) Opinion Mining on Twitter data using Unsupervised Learning Technique. Vol:148

    Google Scholar 

  46. Lam D, Wei M, Wunsch D (2015) Clustering data of mixed categorical and numeric type with unsupervised feature learning

    Google Scholar 

  47. Gultepe E, Edward T (2018) Predicting and grouping digitized paintings by style using unsupervised feature learning. J Cult Heritage 31:13–23

    Article  Google Scholar 

  48. Khalid S, Judge A, Pinedo-Villanueva R (2018) An unsupervised learning model for pattern recognition in routinely collected healthcare data. In: International conference, vol 5, pp 266–273

    Google Scholar 

  49. Unnisa M, Ameen A, Raziuddin S (2016) Opinion mining on Twitter data using unsupervised learning technique. Int J Comput Appl 148:12–19

    Google Scholar 

  50. Wang X, Gupta A (2015) Unsupervised learning of visual representation using videos. IEEE

    Google Scholar 

  51. dos Santos CN, Gatti M. Deep CNN for sentimental analysis of short texts

    Google Scholar 

  52. Severyn A, Moschitti A (2016) Twitter sentimental analysis with deep CNN

    Google Scholar 

  53. Liskowski P, Kraweic K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imaging 35(11):2369–2380

    Article  Google Scholar 

  54. Lample G, Ballesteros M, Subramanian S, Kawakami K, Dyer C (2016) Neural architectures for named entity recognition, 17April 2016

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sindhu Meena, K., Suriya, S. (2020). A Survey on Supervised and Unsupervised Learning Techniques. In: Kumar, L., Jayashree, L., Manimegalai, R. (eds) Proceedings of International Conference on Artificial Intelligence, Smart Grid and Smart City Applications. AISGSC 2019 2019. Springer, Cham. https://doi.org/10.1007/978-3-030-24051-6_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-24051-6_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-24050-9

  • Online ISBN: 978-3-030-24051-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics