Yang Zhang
ABSTRACT
In this paper we describe a generic methodology to create an "optimal" feature extraction pre-processing stage for pattern classification. Our aim is to map the input data into a new, one-dimensional feature space in which separability is maximized under a simple thresholding classification. We have used multi-objective genetic programming with Pareto strength-based ranking to bias the selection procedure. The methodology is applied to the edge detection problem in image processing; we make quantitative comparison with the pre-processing stages of the well-known Canny edge detector using synthetic and real-world edge data and conclude that the performance of our evolutionary-based method is much superior to the Canny algorithm based on the criterion of minimum Bayes risk.
- P.I.Rockett. Performance Assessment of Feature Detection Algorithms: A Methodology and Case Study on Corner Detectors. IEEE Transactions on Image Processing. Vol.12, No.11. Nov 2003. Google Scholar
Digital Library
- N.R. Harvey, S.P. Brumby, S. Perkins, J.J. Szymanski. J. Theiler, J.J. Bloch, R.B. Porter, M. Galassi & A.C. Young. Image Feature Extraction: GENIE vs Conventional Supervised Classification Techniques. IEEE Transactions on Geoscience and Remote Sensing, Vol. 40, No. 2, pp 393--404, 2002.Google ScholarCross Ref
- J.R.Sherrah, R.E.Bogner & A.Bouzerdoum. The Evolutionary Pre-Processor: Automatic Feature Extraction for Supervised Classification using Genetic Programming. Genetic Programming 1997: Proceedings of the Second Annual Conference. Stanford University, CA, USA. Pages 304--312 1997Google Scholar
- C.Gathercole & P.Ross, Dynamic training subset selection for supervised learning in genetic programming, Parallel Problem Solving from Nature-PPSN III, pp. 312--321, Springer-Verlag, 1994. Google ScholarDigital Library
- K. Fukanaga. Introduction to Statistical Pattern Recognition. Academic Press, Boston, second edition, 1990. Google ScholarDigital Library
- L.Devroye, L. Györfi & G. Lugosi. A Problabilistic Theory of Pattern Recognition. Springer-Verlag, 1996.Google ScholarCross Ref
- J.R.Sherrah, Automatic Feature Extraction for Pattern Recognition. PhD Thesis, Dept. of EEE, The University of Adelaide, South Australia, July. 1998Google Scholar
- P.J.Angeline. Genetic programming and emergent intelligence. In K.E.Kinear, Jr., editor, Advances in Genetic Programming, chapter 4, pages 75--98. MIT Press, 1994. Google ScholarDigital Library
- M.D.Heath, S.Sarkar, T.Sanocki & K.W.Bowyer. Comparison of Edge Detectors: A Methodology and Initial Study. In Computer Vision and Pattern Recognition, 1996. Proceedings CVPR '96, Pages 143--148. 1996 Google ScholarDigital Library
- S. Bleuler, M. Brack, L. Thiele & E. Zitzler. Multiobjective Genetic Programming: Reducing Bloat Using SPEA2. Congress on Evolutionary Computation (CEC 2001). Pages 536--543. 5/2001Google ScholarCross Ref
- W. B. Langdon & S. J. Barrett. Genetic Programming in Data Mining for Drug Discovery, Chapter 10 in Evolutionary Computing in Data Mining, Ashish Ghosh and Lakhmi C. Jain editors, Physica Verlag, pages 211--235, 2004.Google Scholar
- T. Ito, I. Iba & S. Sato. Non-destructive depth-dependent crossover for genetic programming. In W. Banzhaf, R. Poli, M. Schoenauer, and T. C. Fogarty, editors, Proceedings of the First European Workshop on Genetic Programming, LNCS, Paris, 14--15 April 1998. Google ScholarDigital Library
- K.Bowyer, C.Kranenburg S.Dougherty. Edge Detector Evaluation Using Empirical ROC Curves. In Computer Vision and Image Understanding vol.84, NO.1, pages 77--103 Oct. 2001. Google ScholarDigital Library
- M.H.Zweig & G.Campbell. Receiver Operating Characteristic (ROC) Plots: A Fundamental Evaluation Tool in Clinical Medicine. In Clinical Chemistry, vol. 39, iss. 4, pp561--577 1993Google ScholarCross Ref
- W.C.Chen, N.A.Thacker & P.I.Rockett. An adaptive step edge model for self-consistent training of a neural network for probabilistic edge labeling. In IEE Proceedings - Vision, Image & Signal Processing, VISP 143 No.1, Pages 41--50 Feb. 1996.Google ScholarCross Ref
- R.K.Cope & P.I.Rockett. The efficacy of Gaussian smoothing in the Canny edge detector. In Electronics Letters, Vol 36 (19), Pages 1615--1617 2000.Google Scholar
- T.Kanungo & R.M.Haralick. Receiver operating characteristic curves and optimal Bayesian operating points. In International Conference on Image Processing - Proceedings, Vol.3 Pages. 256--259, Washington, DC, Oct 23-26, 1995 Google ScholarDigital Library
- W.A.Tackett. Genetic Programming for feature discovery and image discrimination. In S. Forrest, editor, Proceedings of the Fifth International Conference on Genetic Algorithms, Pages. 303-309. Morgan Kaufmann, 1999. Google ScholarDigital Library
- Evolving optimal feature extraction using multi-objective genetic programming: a methodology and preliminary study on edge detection
Recommendations
Multi-objective genetic programming for feature learning in face recognition
AbstractFace recognition is a challenging task due to high variations of pose, expression, ageing, and illumination. As an effective approach to face recognition, feature learning can be formulated as a multi-objective optimisation task of ...
Highlights- A new GP representation to automatically learn effective features for classification
Highlights of semantics in multi-objective genetic programming
GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference CompanionSemantics is a growing area of research in Genetic programming (GP) and refers to the behavioural output of a Genetic Programming individual when executed. This research expands upon the current understanding of semantics by proposing a new approach: ...
Semantics in Multi-objective Genetic Programming
AbstractSemantics has become a key topic of research in Genetic Programming (GP). Semantics refers to the outputs (behaviour) of a GP individual when this is run on a dataset. The majority of works that focus on semantic diversity in single-...
Highlights- Developed a new semantic-distance based approach for Multi-objective GP named SDO.
Comments