Skip to main content

Filtering Irrelevant Information for Rational Decision Making

  • Chapter
  • First Online:
  • 2026 Accesses

Part of the book series: Advanced Information and Knowledge Processing ((AI&KP))

Abstract

This chapter deals with the concept of using relevant information as a basis of rational decision making. In this regard, whenever information is irrelevant it needs to be marginalized or eliminated. Making decisions using information which contains irrelevant information often confuses a decision making process. In this chapter we discuss four methods for making rational decisions by either marginalizing irrelevant information or not using irrelevant information. These methods are marginalization of irrationality approach, automatic relevance determination, principal component analysis and independent component analysis. These techniques are applied to condition monitoring, credit scoring, interstate conflict and face recognition.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Abbasi A, Eslamloueyan R (2014) Determination of binary diffusion coefficients of hydrocarbon mixtures using MLP and ANFIS networks based on QSPR method. Chemom Intell Lab Syst 132:39–51

    Article  Google Scholar 

  • Ahmad I (2014) Enhancing MLP performance in intrusion detection using optimal feature subset selection based on genetic principal components. Applied Mathematics and. Inf Sci 8(2):639–649

    Google Scholar 

  • Alfaro CA, Aydin B, Valencia CE, Bullitt E, Ladha A (2014) Dimension reduction in principal component analysis for trees. Comput Stat Data Anal 74:157–179

    Article  MathSciNet  Google Scholar 

  • Ayhan MS, Benton RG, Raghavan VV, Choubey S (2013) Composite kernels for automatic relevance determination in computerized diagnosis of Alzheimer’s disease. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). LNAI 8211:126–137

    Google Scholar 

  • Bache K, Lichman M (2013) UCI Machine Learning Repository. [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science

  • Ben-Israel A, Greville TNE (2003) Generalized inverses. Springer, New York

    MATH  Google Scholar 

  • Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

    Google Scholar 

  • Broadbent DE (1954) The role of auditory localization in attention and memory span. J Exp Psychol 47(3):191–196

    Article  Google Scholar 

  • Bronkhorst AW (2000) The cocktail party phenomenon: a review on speech intelligibility in multiple-talker conditions (pdf). Acta Acust United Acust 86:117–128

    Google Scholar 

  • Brungart DS, Simpson BD (2007) Cocktail party listening in a dynamic multitalker environment. Percept Psychophys 69(1):79–91

    Article  Google Scholar 

  • Chen J-B, Sun S-Q, Yu J, Zhou Q (2014a) Tracking the curing process of automotive paint by moving-window two-dimensional infrared correlation spectroscopy and principal component analysis. J Mol Struct 1069(1):112–117

    Google Scholar 

  • Chen R-B, Chen Y, Härdle WK, (2014b) TVICA-Time varying independent component analysis and its application to financial data. Comput Stat Data Anal 74:95–109

    Google Scholar 

  • Cherry EC (1953) Some experiments on the recognition of speech, with one and with two ears. J Acoust Soc Am 25(5):975–979

    Article  Google Scholar 

  • Chohra A, Bahrammirzaee A, Madani K (2013) The impact of irrationality on negotiation strategies with incomplete information. Proceedings of the IADIS International Conference Intelligent Systems and Agents 2013, ISA 2013, Proceedings of the IADIS European Conference on Data Mining 2013, ECDM 2013, pp 3–10

    Google Scholar 

  • Choma MA, Sarunic MV, Yang C, Izatt JA (2003) Sensitivity advantage of swept source and Fourier domain optical coherence tomography. Opt Express 11(18):2183–2189

    Article  Google Scholar 

  • Cohen A (2006) Selective Attention. Ency of Cogn Sci. doi:10.1002/0470018860.s00612

    Google Scholar 

  • Collins GP (2011) Solving the cocktail party problem. Sci Am 304(4):66–67

    Article  Google Scholar 

  • Dayan P (2014) Rationalizable irrationalities of choice. Top Cogn Sci 6(2):204–228

    Article  Google Scholar 

  • Ding Y, Dai H, Wang S (2014) Image quality assessment scheme with topographic independent components analysis for sparse feature extraction. Electron Lett 50(7):509–510

    Article  Google Scholar 

  • Duma M, Twala B, Nelwamondo F, Marwala T (2012) Predictive modeling with missing data using an automatic relevance determination ensemble: a comparative study. Appl Artif Intell 26(10):967–984

    Article  Google Scholar 

  • Fan J, Wang Y (2014) Fault detection and diagnosis of non-linear non-Gaussian dynamic processes using kernel dynamic independent component analysis. Inform Sciences 259:369–379

    Article  MathSciNet  Google Scholar 

  • Gerschgorin S (1931) Über die Abgrenzung der Eigenwerte einer Matrix. Izv Akad Nauk USSR Otd Fiz-Mat Nauk 6:749–754 [1]

    Google Scholar 

  • Golub GH, Van Loan CF (1996) Matrix computations. Johns Hopkins University, Baltimore

    MATH  Google Scholar 

  • Gross R, Shi J, Cohn J (2001) Quo vadis face recognition? CMU-RI-TR-01-17, Robotics Institute. Carnegie Mellon University, Pittsburgh

    Google Scholar 

  • Hafter ER, Xia J, Kalluri S (2013) A naturalistic approach to the cocktail party problem. Adv Exp Med Biol 787:527–534

    Article  Google Scholar 

  • Hartigan JA (1975) Clustering algorithms. Wiley, New York

    MATH  Google Scholar 

  • Hartigan JA, Wong MA (1979) Algorithm AS 136: a K-means clustering algorithm. J Roy Statist Soc Ser C (Appl Stat) 28(1):100–108

    MATH  Google Scholar 

  • Hawley ML, Litovsky RY, Culling JF (2004) The benefit of binaural hearing in a cocktail party: effect of location and type of interferer. J Acoust Soc Am 115(2):833–843

    Article  Google Scholar 

  • Haykin S, Chen Z (2005) The cocktail party problem. Neural Comput 17(9):1875–1902

    Article  Google Scholar 

  • Hess D, Orbe S (2013) Irrationality or efficiency of macroeconomic survey forecasts? Implications from the anchoring bias test. Eur Finan Rev 17(6):2097–2131

    Article  Google Scholar 

  • Hotelling H (1933) Analysis of a complex of statistical variables into principal components. J Educ Psychol 24:417–441; 498–520

    Google Scholar 

  • Hyvarinen J, Karhunen E, Oja (2001) Independent component analysis, 1st edn. Wiley, New York

    Google Scholar 

  • Islam MS, Hannan MA, Basri H, Hussain A, Arebey M (2014) Solid waste bin detection and classification using dynamic time warping and MLP classifier. Waste Manage (Oxford) 34(2):281–290

    Article  Google Scholar 

  • Jolliffe IT (2002) Principal component analysis, series: Springer Series in statistics, 2nd edn. Springer, NY

    Google Scholar 

  • Kahneman D (1973) Attention and effort. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Karaman S, Kesler Y, Goksel M, Dogan M, Kayacier A (2014) Rheological and some physicochemical properties of selected hydrocolloids and their interactions with guar gum: characterization using principal component analysis and viscous synergism index. Int J Food Prop 17(8):1655–1667

    Article  Google Scholar 

  • Karhunen K (1947) Über lineare Methoden in der Wahrscheinlichkeitsrechnung. Ann Acad Sci Fennicae Ser A I Math-Phys 37:1–79

    MathSciNet  Google Scholar 

  • ldrich J (2006) Eigenvalue, eigenfunction, eigenvector, and related terms. In: Jeff Miller (ed) Earliest known uses of some of the words of mathematics, last retrieved 20 May 2014

    Google Scholar 

  • Link JV, Lemes ALG, Marquetti I, dos Santos SMB, Bona E (2014) Geographical and genotypic classification of arabica coffee using Fourier transform infrared spectroscopy and radial-basis function networks. Chemometr Intell Lab 135:150–156

    Article  Google Scholar 

  • Lloyd SP (1982) Least squares quantization in PCM. IEEE Trans Inf Theory 28(2):129–137

    Article  MathSciNet  MATH  Google Scholar 

  • Loève M (1978) Probability theory, vol. II, 4th edn. Graduate texts in mathematics 46. Springer, New York

    Google Scholar 

  • Lu Y, Gao B, Chen P, Charles D, Yu L (2014) Characterisation of organic and conventional sweet basil leaves using chromatographic and flow-injection mass spectrometric (FIMS) fingerprints combined with principal component analysis. Food Chem 154:262–268

    Article  Google Scholar 

  • MacKay DJC (1991) Bayesian Methods for Adaptive Models. PhD Thesis, California Institute of Technology

    Google Scholar 

  • MacKay DJC (1992) A practical Bayesian framework for back propagation networks. Neural Comput 4:448–472

    Article  Google Scholar 

  • Mahalanobis PC (1936) On the generalised distance in statistics. Proc Nat Instit Sci India 2(1):49–55

    MathSciNet  MATH  Google Scholar 

  • Malek-Khatabi A, Kompany-Zareh M, Gholami S, Bagheri S (2014) Replacement based non-linear data reduction in radial basis function networks QSAR modeling. Chemomtr Intell Lab 135:157–165

    Article  Google Scholar 

  • Martinez AR, Benavente R (1998) The AR face database. Technical Report. Computer vision centre technical report. Barcelona, Spain

    Google Scholar 

  • Marwala T (2001) Fault identification using neural networks and vibration data. Doctor of Philosophy Topic, University of Cambridge

    Google Scholar 

  • Marwala T (2009) Computational intelligence for missing data imputation, estimation and management: knowledge optimization techniques. IGI Global Publications, information science reference imprint. IGI Global Publications, New York

    Google Scholar 

  • Marwala T (2012) Condition monitoring using computational intelligence methods. Springer, Heidelberg

    Book  Google Scholar 

  • Marwala T (2014) Causality, correlation and artificial intelligence for rational decision making. World Scientific Publications, Singapore

    Google Scholar 

  • Marwala T, Lagazio M (2011) Militarized conflict modeling using computational intelligence techniques. Springer, New York

    Book  Google Scholar 

  • Metsomaa J, Sarvas J, Ilmoniemi RJ (2014) Multi-trial evoked EEG and independent component analysis. J Neurosci Methods 228:15–26

    Article  Google Scholar 

  • Moore EH (1920) On the reciprocal of the general algebraic matrix. Bull Amer Math Soc 26(9):394–395

    Article  Google Scholar 

  • Palmieri F, Fiore U, Castiglione A (2014) A distributed approach to network anomaly detection based on independent component analysis. Concurr Comput Pract Ex 26(5):1113–1129

    Article  Google Scholar 

  • Pazoki AR, Farokhi F, Pazoki Z (2014) Classification of rice grain varieties using two artificial neural networks (mlp and neuro-fuzzy). J Anim Plant Sci 24(1):336–343

    Google Scholar 

  • Pearson K (1901) On lines and planes of closest fit to systems of points in space (PDF). Philos Phenomenol 2(11):559–572

    Google Scholar 

  • Pegram GGS (1983) Spatial relationships in stream flow residuals. Seminar on principal components analysis in the atmospheric and Earth sciences, Pretoria, (CSIR, Pretoria, National Programme for Weather, Climate & Atmosphere Research; CSIR-S-334), pp 134–155

    Google Scholar 

  • Penrose R (1955) A generalized inverse for matrices. Proc Camb Philos Soc 51:406–413

    Article  MathSciNet  MATH  Google Scholar 

  • Preisendorfer RW (1988) Principal component analysis in meteorology and oceanography. Elsevier, Holland

    Google Scholar 

  • Rad JA, Kazem S, Parand K (2014) Optimal control of a parabolic distributed parameter system via radial basis functions. Commun Nonlinear Sci Numer Simul 19(8):2559–2567

    Article  MathSciNet  Google Scholar 

  • Raol JR (2009) Multi-Sensor data fusion. Theory and practice. CRC Press, Boca Raton

    Book  Google Scholar 

  • Russ JC (2007) The image processing handbook. CRC Press, Boca Raton

    MATH  Google Scholar 

  • Scharf B (1990) On hearing what you listen for: the effects of attention and expectancy. Can Psychol 31(4):386–387

    Google Scholar 

  • Schmidt AKD, Römer H (2011) Solutions to the cocktail party problem in insects: selective filters, spatial release from masking and gain control in tropical crickets. Vol. 6. PLoS ONE 6(12) (art. no. e28593)

    Google Scholar 

  • Schroeder DJ (1999) Astronomical optics, 2nd edn. Academic Press, San Diego, p 433

    Google Scholar 

  • Setiono R, Liu H (1997) NeuroLinear: from neural networks to oblique decision rules. In: Proceedings: NeuroComputing, vol. 17, pp. 1–24. [View Context]

    Google Scholar 

  • Shen N (2014) Consumer rationality/irrationality and financial literacy in the credit card market: implications from an integrative review. J Financ Serv Markrting 19(1):29–42

    Article  Google Scholar 

  • Shutin D, Buchgraber T (2012) Trading approximation quality versus sparsity within incremental automatic relevance determination frameworks. IEEE International Workshop on Machine Learning for Signal Processing, pp 1–6, MLSP art. no. 6349805

    Google Scholar 

  • Starfield DM, Rubin DM, Marwala T (2006) Near-field artifact reduction using realistic limited-field-of-view coded apertures in planar nuclear medicine imaging. In: Sun I Kim and Tae Suk Sah (eds) Imaging the Future Medicine. Proceedings of the IFMBE vol. 14, pp 3581–3585, Springer, Berlin Heidelberg, ISBN: 978-3-540-36839-7

    Google Scholar 

  • Starfield DM, Rubin DM, Marwala T (2007) Sampling considerations and resolution enhancement in ideal planar coded aperture nuclear medicine imaging, pp 806-809. 11th Mediterranean Conference on Medical and Biological Engineering June 2007, Ljubljana, Slovenia (IFMBE Proceedings vol. 16) (Paperback) and Computing 2007: MEDICON 2007, 26-30 by Tomaz Jarm, Peter Kramar, Anze Zupanic (eds) Springer, ISBN–10: 3540730435

    Google Scholar 

  • Stone JV (2004) Independent component analysis: a tutorial introduction. MIT Press, Cambridge

    Google Scholar 

  • Strang G (1993) Introduction to linear algebra. Wellesley-Cambridge Press, Wellesley

    MATH  Google Scholar 

  • Surajpal D (2007) An independent evaluation of subspace facial recognition algorithms. University of the Witwatersrand Master Thesis

    Google Scholar 

  • Surajpal D, Marwala T (2007) An independent evaluation of subspace face recognition algorithms. Proceedings of the 18th Annual Pattern Recognition Association of South Africa, ArXiv: 0705.0952

    Google Scholar 

  • Tan VYF, Févotte C (2013) Automatic relevance determination in nonnegative matrix factorization with the (β)-divergence. IEEE Trans Pattern Anal Mach Intell 35(7):1592–1605. (art. no. 6341758)

    Article  Google Scholar 

  • Treisman AM (1969) Strategies and models of selective attention. Psychol Rev 76(3):282–299

    Article  Google Scholar 

  • Varga RS (2002) Matrix iterative Analysis, 2nd edn. (of 1962 Prentice Hall edition), Springer, Englewood Cliffs

    Google Scholar 

  • Wang XZ, Yang Y, Li R, Mcguinnes C, Adamson J, Megson IL, Donaldson K (2014) Principal component and causal analysis of structural and acute in vitro toxicity data for nanoparticles. Nanotoxicology 8(5):465–476

    Article  Google Scholar 

  • Wood N, Cowan N (1995) The cocktail party phenomenon revisited: how frequent are attention shifts to one’s name in an irrelevant auditory channel? J Exp Psychol Learn Mem Cogn 21(1):255–260

    Article  Google Scholar 

  • Xu J, Yang J, Shen A, Chen J (2014) A novel ANN-based harmonic extraction method tested with ESN, RNN and MLP in shunt active power filters. Int J Wireless Mobile Comput 7(2):123–131

    Article  Google Scholar 

  • Yamaguchi N (2012) Variational Bayesian inference with automatic relevance determination for generative topographic mapping. 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012, art. no. 6505056, pp 2124–2129

    Google Scholar 

  • Yan G, Wang X, Li S, Yang J, Xu D (2014) Aberration measurement based on principal component analysis of aerial images of optimized marks. Opt Commun 329:63–68

    Article  Google Scholar 

  • Yang Y, Nagarajaiah S (2014) Blind identification of damage in time-varying systems using independent component analysis with wavelet transform. Mech Syst Signal Pr 47(1–2):3–20

    Article  Google Scholar 

  • Zhan X, Dai W, Zhou S (2014) Application of independent component regression in dam deformation analysis. J Inform Comput Sci 11(6):1939–1946

    Article  Google Scholar 

  • Zhang J, Zhang Z, Zhu G, Chen B, Cheng W, He Z (2014) Multi-unit deflation constraint independent component analysis and its application to source contribution estimation. Jixie Gongcheng Xuebao/J MechE 50(5):57–64+ 73

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tshilidzi Marwala .

Conclusions

Conclusions

This chapter studied methods that are used for dealing with irrelevant information. Four techniques were considered and these were the marginalization of irrationality approach, automatic relevance determination , principal component analysis and independent component analysis . These techniques were applied to the problems of condition monitoring, credit scoring, interstate conflict and face recognition and were found to be effective on handling irrelevant information.

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Marwala, T. (2014). Filtering Irrelevant Information for Rational Decision Making. In: Artificial Intelligence Techniques for Rational Decision Making. Advanced Information and Knowledge Processing. Springer, Cham. https://doi.org/10.1007/978-3-319-11424-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11424-8_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11423-1

  • Online ISBN: 978-3-319-11424-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics