Abstract
Takagi–Sugeno–Kang (TSK) fuzzy systems are well known for their good balance between approximation accuracy and interpretability. Nowadays, multi-view TSK fuzzy systems have drawn world-wide attention since the multi-view data has emerged in many application scenarios. However, many multi-view data contains weak views which may bring negative influences on the task of pattern recognition. How to reduce the weak views and hence improve the performance of multi-view TSK fuzzy systems have become a hot topic. In this paper, we propose a view-reduction based multi-view TSK fuzzy system termed as VR-MV-TSK-FS in which two powerful mechanisms are developed: (1) during the collaborative learning of data in each view, an object-distribution-dependent parameter is defined to control the learning of the weight of each view. The parameter is not fixed by users, it is set according to the feature space in advance such that the learnt weight of each view indeed reflects the amount of pattern information involved in each view; (2) during the iteration of VR-MV-TSK-FS, weak views are automatically reduced by comparing the learnt weight with a fixed threshold which is also automatically set according to the number of objects and the dimension of the feature space. With the two mechanisms, a training algorithm is developed. Extensive experiments on synthetic datasets, UCI datasets and a case study of textile color classification indicate that the proposed algorithm can effectively reduce weak views and achieves better performance than other benchmarking algorithms.
Similar content being viewed by others
References
Bache K, Lichman M (2015) UCI machine learning repository. School of Information and Computer Science, University of California, Irvine, CA. http://archive.ics.uci.edu/
Bian Z, Ishibuchi H, Wang S (2018) Joint learning of spectral clustering structure and fuzzy similarity matrix of data. IEEE Trans Fuzzy Syst 27(1):31–44
Bouchard K, Lapalu J, Bouchard B, Bouzouane A (2019) Clustering of human activities from emerging movements. J Amb Intel Hum Comput 10(9):3505–3517
Chen Y, Hao Y (2017) A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction. Expert Syst Appl 80:340–355
Cox D, Lewis P (1996) The statistical analysis of series of events. Methuen & Co, London
Delgado A, Reyes E (2016) Applying shannon entropy to select alternative plants as food for livestock: a case study in Ecuador. In: IEEE CACIDI 2016-IEEE Conference on Computer Sciences, pp 1–5
Deng Z, Jiang Y, Choi K, Chung F, Wang S (2013) Knowledge-leverage-based TSK fuzzy system modeling. IEEE Trans Neural Netw Learn Syst 24(8):1200–1212
Fratello M, Caiazzo G, Trojsi F, Russo A, Tedeschi G, Tagliaferri R, Esposito F (2017) Multi-view ensemble classification of brain connectivity images for neurodegeneration type discrimination. Neuroinformatics 15(2):199–213
Glasser M, Coalson T, Robinson E, Hacker C, Harwell J, Yacoub E, Smith S (2016) A multi-modal parcellation of human cerebral cortex. Nature 536(7615):171
He C, Liu S, Zhang L, Zheng J (2019) A fuzzy clustering based method for attributed graph partitioning. J Amb Intel Hum Comput 10(9):3399–3407
Hernández-Leo D, Bote-Lorenzo M, Asensio-Pérez J, Gocmez-Sanchez E, Villasclaras-Fernández E, Jorrín-Abellán I, Dimitriadis Y (2007) Free- and open-source software for a course on network management: authoring and enactment of scripts based on collaborative learning strategies. IEEE Trans Educ 50(4):292–301
Jiang Y, Deng Z, Chung F, Wang S (2016a) Realizing two-view TSK fuzzy classification system by using collaborative learning. IEEE Trans Syst Man Cybern Syst 47(1):145–160
Jiang Y, Deng Z, Chung F, Wang G, Qian P, Choi K, Wang S (2016b) Recognition of epileptic EEG signals using a novel multiview TSK fuzzy system. IEEE Trans Fuzzy Syst 25(1):3–20
Jiang Y, Wu D, Deng Z, Qian P, Wang J, Wang G, Wang S (2017) Seizure classification from EEG signals using transfer learning, semi-supervised learning and TSK fuzzy system. IEEE Trans Neural Syst Rehabil Eng 25(12):2270–2284
Li Y, Wu FX, Ngom A (2016) A review on machine learning principles for multi-view biological data integration. Brief Bioinform 19(2):325–340
Liu Y, Lin F, Wang X (2004) Using agents in web-based constructivist collaborative learning system. Tsinghua Sci Technol 9(2):189–196
Liu S, Liu S, Cai W, Che H, Pujol S, Kikinis R, Fulham M (2014) Multimodal neuroimaging feature learning for multiclass diagnosis of Alzheimer’s disease. IEEE Trans Biomed Eng 62(4):1132–1140
Makkuva A, Wu Y (2018) Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy. IEEE Trans Inform Theory 64(5):3579–3589
Mei J, Wang Y, Chen L, Miao C (2016) Large scale document categorization with fuzzy clustering. IEEE Trans Fuzzy Syst 25(5):1239–1251
Sharma D, Dhurandher S, Agarwal D, Arora K (2019) kROp: k-Means clustering based routing protocol for opportunistic networks. J Amb Intel Hum Comput 10(4):1289–1306
Sim T, Baker S, Bsat M (2002) The CMU pose, illumination, and expression (PIE) database. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp 53–58
Srba I, Bielikova M (2014) Dynamic group formation as an approach to collaborative learning support. IEEE Trans Learn Technol 8(2):173–186
Sun S (2013) A survey of multi-view machine learning. Neural Comput Appl 23(7–8):2031–2038
Tan C, Chan Y (2008) Knowledge community: a knowledge-building system for global collaborative project learning. Proc IEEE 96(6):1049–1061
Vapnik V (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988–999
Wang B, Mezlini A, Demir F, Fiume M, Tu Z, Brudno M, Goldenberg A (2014) Similarity network fusion for aggregating data types on a genomic scale. Nat Methods 11(3):333
Wang J, Yang D, Jiang W, Zhou J (2017a) Semisupervised incremental support vector machine learning based on neighborhood kernel estimation. IEEE Trans Syst Man Cybern Syst 47(10):2677–2687
Wang G, Zhang G, Choi K, Lu J (2017b) Deep additive least squares support vector machines for classification with model transfer. IEEE Trans Syst Man Cybern Syst 49(7):1527–1540
Zhang H, Zhang H (2014) The analysis of the associated Shannon entropy on the populations with homologous genotypes mating and homologous phenotypes mating. In: The 26th Chinese Control and Decision Conference (2014 CCDC), pp 3885–3889
Zhang Y, Ishibuchi H, Wang S (2017a) Deep Takagi–Sugeno–Kang fuzzy classifier with shared linguistic fuzzy rules. IEEE Trans Fuzzy Syst 26(3):1535–1549
Zhang Y, Chung F, Wang S (2017b) Fast reduced set-based exemplar finding and cluster assignment. IEEE Trans Syst Man Cybern Syst 49(5):917–931
Zhang Y, Chung F, Wang S (2019) A multi-view & multi-exemplar fuzzy clustering approach: theoretical analysis and experimental studies. IEEE Trans Fuzzy Syst 27(8):1543–1557
Zhou T, Chung F, Wang S (2016) Deep TSK fuzzy classifier with stacked generalization and triplely concise interpretability guarantee for large data. IEEE Trans Fuzzy Syst 25(5):1207–1221
Zhou T, Ishibuchi H, Wang S (2018) Stacked blockwise combination of interpretable TSK fuzzy classifiers by negative correlation learning. IEEE Trans Fuzzy Syst 26(6):3327–3341
Zou W, Li C, Zhang N (2017) AT–S fuzzy model identification approach based on a modified inter type-2 FRCM algorithm. IEEE Trans Fuzzy Syst 26(3):1104–1113
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grants 81701793, the Philosophy and Social Science Foundation of Jiangsu Province (18YSC009), and the Jiangsu Students’ Innovation and Entrepreneurship Training Program (201910304027Z).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, Y., Li, J., Zhou, X. et al. A view-reduction based multi-view TSK fuzzy system and its application for textile color classification. J Ambient Intell Human Comput (2019). https://doi.org/10.1007/s12652-019-01495-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12652-019-01495-9