ABSTRACT
Aggregate outputs learning differs from the classical supervised learning setting in that, training samples are packed into bags with only the aggregate outputs (labels for classification or real values for regression) known. This setting of the problem is associated with several kinds of application background. We focus on the aggregate outputs classification problem in this paper, and set up a manifold regularization framework to deal with it. The framework can be of both instance level and bag level for different testing goals. We propose four concrete algorithms based on our framework, each of which can cope with both binary and multi-class scenarios. The experimental results on several datasets suggest that our algorithms outperform the state-of-art technique.
- A. Asuncion and D. Newman. UCI machine learning repository, 2007.Google Scholar
- M. Belkin, P. Niyogi, and V. Sindhwani. On manifold regularization. In AISTAT, 2005.Google Scholar
- T. Gartner, P. Flach, A. Kowalczyk, and A. Smola. Multi-instance kernels. In ICML, 2002. Google ScholarDigital Library
- D. Musicant, J. Christensen, and J. Olson. Supervised learning by training on aggregate outputs. In ICDM, pages 252--261, 2007. Google ScholarDigital Library
- B. Scholkopf and A. Smola. Learning with kernels. MIT press Cambridge, Mass, 2002.Google Scholar
Index Terms
- Instance- and bag-level manifold regularization for aggregate outputs classification
Recommendations
Classification by semi-supervised discriminative regularization
Linear discriminant analysis (LDA) is a well-known dimensionality reduction method which can be easily extended for data classification. Traditional LDA aims to preserve the separability of different classes and the compactness of the same class in the ...
Semi-supervised classification via discriminative sparse manifold regularization
In this paper, a newly semi-supervised manifold learning algorithm named Discriminative Sparse Manifold Regularization (DSMR) is proposed. In DSMR, the whole unlabeled sample set is used to reconstruct the mean vector of each class, then obtains the ...
Discriminative semi-supervised feature selection via manifold regularization
Feature selection has attracted a huge amount of interest in both research and application communities of data mining. We consider the problem of semi-supervised feature selection, where we are given a small amount of labeled examples and a large amount ...
Comments