Jurgen Martens
Abstract
We develop a new approach to the validation of simulation models by exploiting elements from fuzzy set theory and machine learning. A fuzzy resemblance relation concept is used to set up a mathematical framework for measuring the degree of similarity between the input-output behavior of a simulation model and the corresponding behavior of the real system. A neuro-fuzzy inference algorithm is employed to automatically learn the required resemblance relation from real and simulated data. Ultimately, defuzzification strategies are applied to obtain a coefficient on the unit interval that characterizes the degree of model validity. An example in the airline industry illustrates the practical application of this methodology.
- Adem, J. and Martens, J. 2001. Analyzing and improving network punctuality at a Belgian airline company using simulation. DTEW Research Report 0140, K.U. Leuven.Google Scholar
- Balci, O. 1998. Verification, validation and testing. In Handbook of Simulation, J. Banks, Ed. Wiley, New York, 335--393.Google Scholar
- Balci, O. and Sargent, R. 1984. Validation of simulation models via simultaneous confidence intervals. Amer. J. Math. Manage. Sci. 4, 3-4, 375--406.Google Scholar
- Barlas, Y. and Carpenter, S. 1990. Philosophical roots of model validation: Two paradigms. Syst. Dynam. Rev. 6, 2, 148--166.Google Scholar
- De Cock, M. and Kerre, E. 2003. On (un)suitable fuzzy relations to model approximate equality. Fuzzy Sets Syst. 133, 2, 137--153. Google Scholar
- Déry, R., Landry, M., and Banville, C. 1993. Revisiting the issue of model validation in or: an epistemological view. Europ. J. Oper. Res. 66, 2, 168--183.Google Scholar
- Dubois, D. and Prade, H. 1980. Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York. Google Scholar
- Fishman, G. and Kiviat, P. 1967. The analysis of simulation-generated time series. Manage. Sci. 13, 7, 525--557.Google Scholar
- Fullér, R. 1995. Neural Fuzzy Systems. Institute for Advanced Management Systems Research, Åbo.Google Scholar
- Gupta, M. and Qi, J. 1991. Theory of t-norms and fuzzy inference methods. Fuzzy Sets Syst. 40, 3, 431--450. Google Scholar
- Hsu, D. and Hunter, J. 1977. Analysis of simulation-generated responses using autoregressive models. Manage. Sci. 24, 2, 181--190.Google Scholar
- Kerre, E. 1993. Introduction to the Basic Principles of Fuzzy Set Theory and Some of Its Applications. Communication and Cognition, Ghent.Google Scholar
- Kleijnen, J. and Sargent, R. 2000. A methodology for the fitting and validation of metamodels in simulation. Europ. J. Oper. Res. 120, 1, 14--29.Google Scholar
- Kleindorfer, G., O'Neill, L., and Ganeshan, R. 1998. Validation in simulation: Various positions in the philosophy of science. Manage. Sci. 44, 8, 1087--1099. Google Scholar
- Law, A. and Kelton, W. 2000. Simulation Modeling and Analysis. McGraw-Hill, New York. Google Scholar
- Martens, J. 2004. A fuzzy set and stochastic system theoretic technique to validate simulation models. Ph.D. dissertation, K. U. Leuven.Google Scholar
- Martens, J., Wets, G., Vanthienen, J., and Mues, C. 2000. Improving a neuro-fuzzy classifier using exploratory factor analysis. Int. J. Intell. Syst. 15, 8, 785--800.Google Scholar
- Nauck, D., Klawonn, F., and Kruse, R. 1997. Neuro-Fuzzy Systems. Wiley, Chichester. Google Scholar
- Naylor, T. and Finger, J. 1967. Verification of computer simulation models. Manage. Sci. 14, 2, 92--101.Google Scholar
- Sargent, R. 1994. Verification and validation of simulation models. In Proceedings of the 1994 Winter Simulation Conference. IEEE Press, Piscataway, NJ, 77--87. Google Scholar
- Zadeh, L. 1965. Fuzzy sets. Inf. Control 8, 3, 338--353.Google Scholar
- Zadeh, L. 1979. A theory of approximate reasoning. In Machine Intelligence, J. Hayes, D. Michie, and L. Mikulich, Eds. Elsevier, Amsterdam, 149--194.Google Scholar
- Zeigler, B. 1976. Theory of Modeling and Simulation. Wiley, New York. Google Scholar
- Zimmermann, J. 1991. Fuzzy Set Theory and its Applications. Kluwer Academic Publishers, Boston, MA. Google Scholar
Index Terms
- A fuzzy set theoretic approach to validate simulation models
Recommendations
A Fuzzy-neural Resemblance Approach to Validate Simulation Models
Fuzzy-neural computation and roboticsValidation is one of the most important steps in developing a reliable simulation model. It evaluates whether or not the model forms a representation of the simulated system accurate enough to satisfy the goals of the modelling study. The methods that ...
Interval Type-2 Fuzzy Set Reconstruction Based on Fuzzy Information-Theoretic Kernels
This paper presents a universal methodology for generating an interval type-2 fuzzy set membership function from a collection of type-1 fuzzy sets. The key idea of the proposed methodology is to designate a specific type-1 fuzzy set as the representative ...
Decision-theoretic rough fuzzy set model and application
This article investigates the rough approximation of a fuzzy concept on a probabilistic approximation space. We propose the probabilistic rough fuzzy set by defining the conditional probability of a fuzzy event. Then we establish the model of ...
Comments