Abstract
Feature Selection (FS) is an important topic in the domain of machine learning. Support Vector Machine (SVM) is one of the most popular ML models for classification tasks. Efficient feature selection may ensure enhanced classification accuracy. Although there are several feature selection algorithms in practice, they are either separately used, combinedly used with linear SVM or, used with kernel-based SVM. Additionally, there exists another problem in classification methods, which is the selection of correct kernel function. There seems to be as such no general rule for selecting a kernel that maximizes the model’s performance. To handle the issues together, we propose a model called non-linear kernel-free twin quadratic surface SVM with optimized feature selection (LTQSSVM-OFS) which can eventually tackle both feature selection and classification tasks efficiently. We are doing feature selection in a kernel-free way by applying optimization method on a Laplacian Twin Quadratic Surface SVM classifier. We have validated our proposed model using (i) min-max approach-based SVM without FS, (ii) linear SVM, and (iii) radial basis function-based SVM models applied on four datasets, namely ‘Star3642balanced’, ‘Diabetes’, ‘Health care: Heart attack possibility’, and ‘Blood Transfusion’. Experimental results reveal that the proposed model outperforms the other models. Additional worth noting benefit of our model is that it yields better results in case of working with fewer features.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7(11) (2006)
Hamed, T., Dara, R., Kremer, S.C.: Network intrusion detection system based on recursive feature addition and bigram technique. Comput. Secur. 73, 137–155 (2018)
Huang, M.W., Chen, C.W., Lin, W.C., Ke, S.W., Tsai, C.F.: DSVM and SVM ensembles in breast cancer prediction. PLoS ONE 12(1), e0161501 (2017)
Jiménez-Cordero, A., Morales, J.M., Pineda, S.: A novel embedded min-max approach for feature selection in nonlinear support vector machine classification. Eur. J. Oper. Res. 293(1), 24–35 (2021)
Kim, K.J.: Financial time series forecasting using support vector machines. Neurocomputing 55(1–2), 307–319 (2003)
Lin, Y., Guo, H., Hu, J.: An SVM-based approach for stock market trend prediction. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE (2013)
Melacci, S., Belkin, M.: Laplacian support vector machines trained in the primal. J. Mach. Learn. Res. 12(3), 1149–1184 (2011)
Morris, A.P., et al.: Large-scale association analysis provides insights into the genetic architecture and pathophysiology of type 2 diabetes. Nat. Genet. 44(9), 981 (2012)
Pramanik, A., Djeddi, C., Sarkar, S., Maiti, J., et al.: Region proposal and object detection using hog-based CNN feature map. In: 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), pp. 1–5. IEEE (2020)
Pramanik, A., Gorai, A., Sarkar, S., Gupta, P.: A novel feature extraction-based human identification approach using 2D ear biometric. In: 2018 IEEE Applied Signal Processing Conference (ASPCON), pp. 168–172. IEEE (2018)
Pramanik, A., Nande, V., Pradhan, A.S., Sarkar, S., Maiti, J.: Dynamic functional bandwidth kernel-based SVM: an efficient approach for functional data analysis. In: Hassanien, A.E., Bhattacharyya, S., Chakrabati, S., Bhattacharya, A., Dutta, S. (eds.) Emerging Technologies in Data Mining and Information Security. AISC, vol. 1286, pp. 673–681. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-9927-9_65
Pramanik, A., Sarkar, S., Maiti, J.: Oil spill detection using image processing technique: an occupational safety perspective of a steel plant. In: Abraham, A., Dutta, P., Mandal, J., Bhattacharya, A., Dutta, S. (eds.) Emerging Technologies in Data Mining and Information Security. AISC, pp. 247–257. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1501-5_21
Pramanik, A., Sarkar, S., Maiti, J.: A real-time video surveillance system for traffic pre-events detection. Accid. Anal. Prev. 154, 106019 (2021)
Pramanik, A., Sarkar, S., Maiti, J., Mitra, P.: Rt-gsom: rough tolerance growing self-organizing map. Inf. Sci. 566, 19–37 (2021)
Pramanik, A., Sarkar, S., Sai Siddharth, V., Maiti, J., Mitra, P.: Semi-automated ontology creation and upgradation for rail-road incidents: a case of a steel plant in India. In: Tavares, J.M.R.S., Chakrabarti, S., Bhattacharya, A., Ghatak, S. (eds.) Emerging Technologies in Data Mining and Information Security. LNNS, vol. 164, pp. 285–294. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-9774-9_28
Rastogi (nee Khemchandani), R., Bharti, A.: Least squares twin extreme learning machine for pattern classification. In: Deb, D., Balas, V.E., Dey, R. (eds.) Innovations in Infrastructure. AISC, vol. 757, pp. 561–571. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1966-2_50
Sarkar, S., Baidya, S., Maiti, J.: Application of rough set theory in accident analysis at work: a case study. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 245–250. IEEE (2017)
Sarkar, S., Chain, M., Nayak, S., Maiti, J.: Decision support system for prediction of occupational accident: a case study from a steel plant. In: Abraham, A., Dutta, P., Mandal, J., Bhattacharya, A., Dutta, S. (eds.) Emerging Technologies in Data Mining and Information Security. AISC, pp. 787–796. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1498-8_69
Sarkar, S., Khatedi, N., Pramanik, A., Maiti, J.: An ensemble learning-based undersampling technique for handling class-imbalance problem. In: Proceedings of ICETIT 2019, pp. 586–595. Springer (2020)
Sarkar, S., Kumar, A., Mohanpuria, S.K., Maiti, J.: Application of bayesian network model in explaining occupational accidents in a steel industry. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 337–392. IEEE (2017)
Sarkar, S., Lakha, V., Ansari, I., Maiti, J.: Supplier selection in uncertain environment: a fuzzy MCDM approach. In: Mandal, J., Satapathy, S., Sanyal, M., Bhateja, V. (eds) Proceedings of the First International Conference on Intelligent Computing and Communication, pp. 257–266. Springer, Singapore (2017)
Sarkar, S., Pramanik, A., Khatedi, N., Maiti, J.: An investigation of the effects of missing data handling using ‘R’-packages. In: Raju, K.S., Senkerik, R., Lanka, S.P., Rajagopal, V. (eds.) Data Engineering and Communication Technology. AISC, vol. 1079, pp. 275–284. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-1097-7_24
Sarkar, S., Pramanik, A., Maiti, J., Reniers, G.: Predicting and analyzing injury severity: a machine learning-based approach using class-imbalanced proactive and reactive data. Saf. Sci. 125, 104616 (2020)
Sarkar, S., Vinay, S., Pateshwari, V., Maiti, J.: Study of optimized SVM for incident prediction of a steel plant in India. In: 2016 IEEE Annual India Conference (INDICON), pp. 1–6. IEEE (2016)
Sarkar, S., Vinay, S., Raj, R., Maiti, J., Mitra, P.: Application of optimized machine learning techniques for prediction of occupational accidents. Comput. Oper. Res. 106, 210–224, e0161501 (2019). https://doi.org/10.1016/j.cor.2018.02.021
Vapnik, V., Guyon, I., Hastie, T.: Support vector machines. Mach. Learn. 20(3), 273–297 (1995)
Verma, A., Chatterjee, S., Sarkar, S., Maiti, J.: Data-driven mapping between proactive and reactive measures of occupational safety performance. In: Maiti, J., Ray, P.K. (eds.) Industrial Safety Management. MAC, pp. 53–63. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-6328-2_5
Yan, X., Zhu, H., Luo, J.: A novel kernel-free nonlinear SVM for semi-supervised classification in disease diagnosis. J. Comb. Optim. 42, 948–965 (2021). https://doi.org/10.1007/s10878-019-00484-0
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Maity, S., Rastogi, A., Djeddi, C., Sarkar, S., Maiti, J. (2022). A Novel Optimized Method for Feature Selection Using Non-linear Kernel-Free Twin Quadratic Surface Support Vector Machine. In: Djeddi, C., Siddiqi, I., Jamil, A., Ali Hameed, A., Kucuk, İ. (eds) Pattern Recognition and Artificial Intelligence. MedPRAI 2021. Communications in Computer and Information Science, vol 1543. Springer, Cham. https://doi.org/10.1007/978-3-031-04112-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-04112-9_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04111-2
Online ISBN: 978-3-031-04112-9
eBook Packages: Computer ScienceComputer Science (R0)