skip to main content
10.1145/1102351.1102386acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmlConference Proceedingsconference-collections
Article

Robust one-class clustering using hybrid global and local search

Published:07 August 2005Publication History

ABSTRACT

Unsupervised learning methods often involve summarizing the data using a small number of parameters. In certain domains, only a small subset of the available data is relevant for the problem. One-Class Classification or One-Class Clustering attempts to find a useful subset by locating a dense region in the data. In particular, a recently proposed algorithm called One-Class Information Ball (OC-IB) shows the advantage of modeling a small set of highly coherent points as opposed to pruning outliers. We present several modifications to OC-IB and integrate it with a global search that results in several improvements such as deterministic results, optimality guarantees, control over cluster size and extension to other cost functions. Empirical studies yield significantly better results on various real and artificial data.

References

  1. Ash A. Alizadeh et al. (2000). Distinct types of diffuse large b-cell lymphoma identified by gene expression profiling. Nature, 403, 503--511.Google ScholarGoogle ScholarCross RefCross Ref
  2. Banerjee, A., Merugu, S., Dhillon, I., & Ghosh, J. (2004). Clustering with Bregman divergences. Proc. SDM2004 (pp. 234--245).Google ScholarGoogle ScholarCross RefCross Ref
  3. Crammer, K., & Chechik, G. (2004). A needle in a haystack: Local one-class optimization. ICML. Banff, Alberta, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Dhillon, I. S., Marcotte, E. M., & Roshan, U. (2003). Diametrical clustering for identifying anti-correlated gene clusters. Bioinformatics, 19, 1612--1619.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dhillon, I. S., & Modha, D. S. (2001). Concept decompositions for large sparse text data using clustering. Machine Learning, 42, 143--175. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Gasch A. P. et al. (2000). Genomic expression programs in the response of yeast cells to environmental changes. Molecular Biology of the Cell, 11, 4241--4257.Google ScholarGoogle ScholarCross RefCross Ref
  7. Mansson, R., Tsapogas, P., Akerlund, M., & et. al. (2004). Pearson correlation analysis of microarray data allows for the identification of genetic targets for early b-cell factor. J. Biol. Chem., 279, 17905--17913.Google ScholarGoogle ScholarCross RefCross Ref
  8. Pietra, S. D., Pietra, V. D., & Lafferty, J. (2001). Duality and auxiliary functions for bregman distances. Technical Report CMU-CS-01-109, School of Computer Science. Carnegie Mellon University.Google ScholarGoogle Scholar
  9. Rockafeller, R. T. (1970). Convex analysis. Princeton University Press.Google ScholarGoogle Scholar
  10. Schölkopf, B., Burges, C., & Vapnik, V. (1995). Extracting support data for a given task. KDD. Menlo Park, CA: AAAI Press.Google ScholarGoogle Scholar
  11. Schölkopf, B., Platt, J. C., Shawe-Taylor, J. S., Smola, A. J., & Williamson, R. C. (2001). Estimating the support of a high-dimensional distribution. Neural Computation, 13, 1443--1471. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Sharan, R., & Shamir, R. (2000). Click: A clustering algorithm with applications to gene expression analysis. Proc. 8th ISMB, 307--316. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tax, D., & Duin, R., (1999). Data domain description using support vectors. Proceedings of the European Symposium on Artificial Neural Networks (pp. 251--256).Google ScholarGoogle Scholar
  14. White, D., & Jain, R. (1996). Similarity indexing with ss-tree. 12th International Conf. on Data Engineering (pp. 516--523). New Orleans. Google ScholarGoogle ScholarDigital LibraryDigital Library
  1. Robust one-class clustering using hybrid global and local search

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICML '05: Proceedings of the 22nd international conference on Machine learning
      August 2005
      1113 pages
      ISBN:1595931805
      DOI:10.1145/1102351

      Copyright © 2005 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 August 2005

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate140of548submissions,26%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader