Abstract
Cognitive psychology works have shown that the cognitive representation of categories is based on a typicality notion: all objects of a category do not have the same representativeness, some are more characteristic or more typical than others, and better exemplify their category. Categories are then defined in terms of prototypes, i.e. in terms of their most typical elements. Furthermore, these works showed that an object is all the more typical of its category as it shares many features with the other members of the category and few features with the members of other categories.
In this paper, we propose to profit from these principles in a machine learning framework: a formalization of the previous cognitive notions is presented, leading to a prototype building method that makes it possible to characterize data sets taking into account both common and discriminative features. Algorithms exploiting these prototypes to perform tasks such as classification or clustering are then presented.
The formalization is based on the computation of typicality degrees that measure the representativeness of each data point. These typicality degrees are then exploited to define fuzzy prototypes: in adequacy with human-like description of categories, we consider a prototype as an intrinsically imprecise notion. The fuzzy logic framework makes it possible to model sets with unsharp boundaries or vague and approximate concepts, and appears most appropriate to model prototypes. We then exploit the computed typicality degrees and the built fuzzy prototypes to perform machine learning tasks such as classification and clustering. We present several algorithms, justifying in each case the chosen parameters. We illustrate the results obtained on several data sets corresponding both to crisp and fuzzy data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
D.W. Aha, D. Kibler, and M.K. Albert. Instance-based learning algorithms. Machine Learning, 6:37–66, 1991.
J. Bezdek. Fuzzy mathematics in pattern classification. PhD thesis, Applied Mathematical Center, Cornell University, 1973.
S. Bothorel, B. Bouchon-Meunier, and S. Muller. Fuzzy logic-based approach for semiological analysis of microcalcification in mammographic images. International Journ. of Intelligent Systems, 12:814–843, 1997.
B. Bouchon-Meunier, M. Rifqi, and S. Bothorel. Towards general measures of comparison of objects. Fuzzy Sets and Systems, 84(2):143–153, 1996.
T. Calvo, A. Kolesarova, M. Komornikova, and R. Mesiar. Aggregation operators: properties, classes and construction methods. In Aggregation operators: new trends and applications, pp. 3–104. Physica-Verlag, 2002.
R. Davé. Characterization and detection of noise in clustering. Pattern Recognition Letters, 12:657–664, 1991.
M. Detyniecki. Mathematical Aggregation Operators and their Application to Video Querying. PhD thesis, University of Pierre and Marie Curie, 2000.
D. Dubois and H. Prade. Fuzzy Sets and Systems, Theory and Applications. Academic Press, New York, 1980.
D. Dubois and H. Prade. A unifying view of comparison indices in a fuzzy set-theoretic framework. In R. R. Yager, editor, Fuzzy set and possibility theory, pp. 3–13. Pergamon Press, 1982.
J.C. Dunn. A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. Journ. of Cybernetics, 3:32–57, 1973.
M. Friedman, M. Ming, and A. Kandel. On the theory of typicality. Int. Journ. of Uncertainty, Fuzziness and Knowledge-Based Systems, 3(2):127–142, 1995.
E. Gustafson and W. Kessel. Fuzzy clustering with a fuzzy covariance matrix. In Proc. of IEEE CDC, pp. 761–766, 1979.
F. Höppner, F. Klawonn, R. Kruse, and T. Runkler. Fuzzy Cluster Analysis, Methods for classification, data analysis and image recognition. Wiley, 2000.
A. Jain, M. Murty, and P. Flynn. Data clustering: a review. ACM Computing survey, 31(3): 264–323, 1999.
J. Kacprzyk and R. Yager. Linguistic summaries of data using fuzzy logic. Int. Journ. of General Systems, 30:133–154, 2001.
J. Kacprzyk, R. Yager, and S. Zadrozny. A fuzzy logic based approach to linguistic summaries of databases. Int. Journ. of Applied Mathematics and Computer Science, 10:813–834, 2000.
A. Kelman and R. Yager. On the application of a class of shape MICA operators. Int. Journ. of Uncertainty, Fuzziness and Knowledge-Based Systems, 7:113–126, 1995.
R. Krishnapuram and J. Keller. A possibilistic approach to clustering. IEEE Transactions on fuzzy systems, 1:98–110, 1993.
M.-J. Lesot. Similarity, typicality and fuzzy prototypes for numerical data. In 6th European Congress on Systems Science, Workshop “Similarity and resemblance”, 2005.
M.-J. Lesot. Typicality-based clustering. Int. Journ. of Information Technology and Intelligent Computing, 2006.
M.-J. Lesot and R. Kruse. Data summarisation by typicality-based clustering for vectorial data and nonvectorial data. In Proc. of the IEEE Int. Conf. on Fuzzy Systems, Fuzz-IEEE’06, pp. 3011–3018, 2006.
M.-J. Lesot and R. Kruse. Gustafson-Kessel-like clustering algorithm based on typicality degrees. In Proc. of IPMU’06, 2006.
M.-J. Lesot, L. Mouillet, and B. Bouchon-Meunier. Fuzzy prototypes based on typicality degrees. In B. Reusch, editor, Proc. of the 8th Fuzzy Days 2004, Advances in Soft Computing, pp. 125–138. Springer, 2005.
M. Mizumoto. Pictorial representations of fuzzy connectives, part I: Cases of t-norms, t-conorms and averaging operators. Fuzzy Sets and Systems, 31(2):217–242, 1989.
M. Mizumoto. Pictorial representations of fuzzy connectives, part II: Cases of compensatory operators and self-dual operators. Fuzzy Sets and Systems, 32(1):45–79, 1989.
N. Pal, K. Pal, and J. Bezdek. A mixed c-means clustering model. In Proc. of the IEEE Int. Conf. on Fuzzy Systems, Fuzz-IEEE’97, pp. 11–21, 1997.
M.I. Posner and S.W. Keele. On the genesis of abstract ideas. Journ. of Experimental Psychology, 77:353–363, 1968.
A. Rick, S. Bothorel, B. Bouchon-Meunier, S. Muller, and M. Rifqi. Fuzzy techniques in mammographic image processing. In Etienne Kerre and Mike Nachtegael, editors, Fuzzy Techniques in Image Processing, Studies in Fuzziness and Soft Computing, pp. 308–336. Springer Verlag, 2000.
M. Rifqi. Constructing prototypes from large databases. In Proc. of IPMU’96, pp. 301–306, 1996.
M. Rifqi, V. Berger, and B. Bouchon-Meunier. Discrimination power of measures of comparison. Fuzzy sets and systems, 110:189–196, 2000.
E. Rosch. Principles of categorization. In E. Rosch and B. Lloyd, editors, Cognition and categorization, pp. 27–48. Lawrence Erlbaum associates, 1978.
E. Rosch and C. Mervis. Family resemblance: studies of the internal structure of categories. Cognitive psychology, 7:573–605, 1975.
W. Silvert. Symmetric summation: a class of operations on fuzzy sets. IEEE Transactions on Systems, Man and Cybernetics, 9:659–667, 1979.
H. Timm and R. Kruse. A modification to improve possibilistic fuzzy cluster analysis. In Proc. of the IEEE Int. Conf. on Fuzzy Systems, Fuzz-IEEE’02, 2002.
A. Tversky. Features of similarity. Psychological Review, 84:327–352, 1977.
L. Wittgenstein. Philosophical investigations. Macmillan, 1953.
R. Yager. A human directed approach for data summarization. In Proc. of the IEEE Int. Conf. on Fuzzy Systems, Fuzz-IEEE’06, pp. 3604–3609, 2006.
L. A. Zadeh. A note on prototype theory and fuzzy sets. Cognition, 12:291–297, 1982.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Lesot, MJ., Rifqi, M., Bouchon-Meunier, B. (2008). Fuzzy Prototypes: From a Cognitive View to a Machine Learning Principle. In: Bustince, H., Herrera, F., Montero, J. (eds) Fuzzy Sets and Their Extensions: Representation, Aggregation and Models. Studies in Fuzziness and Soft Computing, vol 220. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73723-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-73723-0_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73722-3
Online ISBN: 978-3-540-73723-0
eBook Packages: EngineeringEngineering (R0)