A group AHP-TOPSIS framework for human spaceflight mission planning at NASA
Highlights
► A generic framework is proposed to evaluate a number of decision alternatives. ► The information requirements are stratified into hierarchies. ► The analytical procedures decompose complex problems into manageable steps. ► The built-in inconsistency checking identifies discrepancies in judgments. ► The framework is applicable to a wide range of real-world decision making problems.
Introduction
The primary goal in multi-criteria decision making (MCDM) is to provide a set of attribute aggregation methodologies that enable the development of models considering the decision makers’ (DMs’) preferential system and judgment policy (Doumpos & Zopounidis, 2002). Achieving this goal requires the implementation of complex procedures. While intuition and simple rules are still favorite decision making methods, they may be dangerously inaccurate for complex decision problems.
Roy (1990) argues that solving MCDM problems is not searching for an optimal solution, but rather helping DMs master the complex judgments and data involved in their problems and advance towards an acceptable solution. Multi-attributes analysis is not an off-the-shelf recipe that can be applied to every problem and situation. The development of MCDM models has often been dictated by real-life problems. Therefore, it is not surprising that methods have appeared in a rather diffuse way, without any clear general methodology or basic theory (Vincke, 1992). The selection of a MCDM framework or method should be done carefully according to the nature of the problem, types of choices, measurement scales, dependency among the attributes, type of uncertainty, expectations of the DMs, and quantity and quality of the available data and judgments (Vincke, 1992). Finding the “best” MCDM framework is an elusive goal that may never be reached (Triantaphyllou, 2000).
The MCDM methods are frequently used to solve real-world problems with multiple, conflicting, and incommensurate attributes. Several authors have used MCDM to effectively solve complex space exploration problems at the National Aeronautic and Space Administration (NASA). Tavana (2003) developed a MCDM model with crisp data to evaluate and prioritize advanced-technology projects at the Kennedy Space Center (KSC). Tavana and Sodenkamp (2009) extended this model with fuzzy data and proposed a fuzzy MCDM model for technology assessment at KSC. Tavana (2004) proposed a MCDM model to evaluate a set of alternative mission architectures for the human exploration of Mars. Tavana et al., 2007, Tavana, 2008 developed two group multi-criteria decision support systems at JSC, a workforce planning system, and an environmental benchmarking system, respectively.
MCDM problems are generally categorized as continuous or discrete, depending on the domain of alternatives. Hwang and Yoon (1981) have classified the MCDM methods into two general categories: multi-objective decision making (MODM) and multi-attribute decision making (MADM). MODM has been widely studied by means of mathematical programming methods with well-formulated theoretical frameworks. MODM methods have decision variable values that are determined in a continuous or integer domain with either an infinitive or a large number of alternative choices, the best of which should satisfy the DMs constraints and preference priorities (Hwang and Masud, 1979, Ehrgott and Wiecek, 2005). MADM methods, on the other hand, have been used to solve problems with discrete decision spaces and a predetermined or a limited number of alternative choices. Churchman, Ackoff, and Arnoff (1954) initially proposed a simple additive weighting method for selecting a business investment policy. The MADM solution process requires inter and intra-attribute comparisons and involves implicit or explicit tradeoffs (Hwang & Yoon, 1981). A detailed analysis of the theoretical foundations of different MCDM methods and their comparative strengths and weaknesses is presented in Larichev and Olson, 2001, Belton and Stewart, 2002, Figueira et al., 2005.
This study presents a group MADM framework based on the analytic hierarchy process (AHP), entropy and the technique for order preference by similarity to the ideal solution (TOPSIS) that were developed for the Integrated Human Exploration Mission Simulation Facility (INTEGRITY) project at the Johnson Space Center (JSC) to assess the priority of a set of human spaceflight mission simulators. The proposed MADM framework integrates subjective judgments derived from the AHP with entropy data and TOPSIS into a series of preference models to prioritize five mission simulators for the human exploration of Mars. The structured framework presented in this study has some obvious attractive features:
- a.
The generic nature of the framework proposed in this study allow for the subjective evaluation of a finite number of decision alternatives on a finite number of performance attributes by a group of DMs.
- b.
The mathematical and computational properties of the models are applicable to a wide range of real-world decision making problems in MADM.
- c.
The information requirements of the proposed framework are stratified into a hierarchy to simplify information input and allow the DMs to focus on a small area of the large problem. This process is also useful for seeking input from multiple DMs.
- d.
Inconsistencies are inevitable when dealing with subjective information from different DMs. The built-in inconsistency checking mechanism of the proposed framework helps to identify inconsistencies in judgments at very early stages of the computation process.
The remainder of the paper is organized as follows. Section 2 presents a brief overview of AHP. In Section 3, we provide a detailed description of three TOPSIS models considered for the proposed framework. Section 4 demonstrates the problem of rank reversal in MADM and TOPSIS through numerical examples. In Section 5, we introduce the INTEGRITY project at NASA. Section 6 presents the details of the group MADM framework proposed in this study along with the results of the INEGRITY problem. Section 7 summarizes our conclusions and future research directions.
Section snippets
A brief overview of AHP
The AHP developed by Saaty, 1977, Saaty, 1994, Saaty, 2000 is a MADM approach that simplifies complex and ill-structured problems by arranging the decision attributes and alternatives in a hierarchical structure with the help of a series of pairwise comparisons. Dyer and Forman (1992) describe the advantages of AHP in a group setting as follows: (1) the discussion focuses on both tangibles and intangibles, individual and shared values; (2) the discussion can be focused on objectives rather than
A detailed description of TOPSIS
The TOPSIS method was initially presented by Hwang and Yoon (1981). It has been applied to a large number of application cases in advanced manufacturing (Agrawal et al., 1991, Parkan and Wu, 1999), purchasing and outsourcing (Kahraman et al., 2009, Shyura and Shih, 2006), and financial performance measurement (Feng & Wang, 2001). Its basic principle is that the chosen alternatives should have the shortest distance from the positive ideal solution (PIS) and the farthest distance from the
The rank-reversal phenomenon in TOPSIS
In MADM, several authors have looked into the rank reversal phenomenon which is the alteration of the ranking of alternatives by the addition (or deletion) of irrelevant alternatives. (e.g., Bana e Costa and Vansnick, 2008, Wang and Luo, 2009, Wang and Ehang, 2006). Buede and Maxwell, 1995, Wang and Luo, 2009, Zanakis et al., 1998 have conducted a series of rank reversal experiments to demonstrate the rank reversal phenomenon in TOPSIS. The three TOPSIS models described in the previous section
The INTEGRITY case study
The INTEGRITY project initiated at the JSC is expected to play an important role in increasing the success of analog missions. Analog missions are real-life, Earth-based science missions whose primary purpose is to help understand the operations, techniques, and technologies required to perform similar tasks during future human spaceflight missions. The goal of performing an analog mission is to prepare crewmembers and support teams as well as increasing the productivity and scientific return
The proposed framework
The MADM models presented in this study were used by the IT to assess the importance of each INTEGRITY simulator. Schoemaker and Russo (1993) describe four general approaches to decision making ranging from intuitive to highly analytical. These methods include intuitive judgments, rules and shortcuts, importance weighting, and value analysis. They argue that analytical methods such as importance weighting and value analysis are more complex but also more accurate than the intuitive approaches (
Conclusions and future research directions
Recent technological advances and availability of data have made MCDM more challenging than ever. Schoemaker and Russo (1993) argue that as the complexity and the amount of data increases in a decision problem, so does the importance of the solution quality. Although some mangers may favor simple approaches, they can be dangerously inaccurate for complex decision problems. Our model helps DMs (i) decompose a complex problem into manageable steps, (ii) ensure the consistency and completeness of
Disclaimer
The views and opinions expressed in this paper are those of the authors and do not reflect the views of the National Aeronautic and Space Administration and Johnson Space Center.
Acknowledgements
This research was supported in part by NASA Grant No. NAG9-1526. The authors are grateful to the entire INTEGRITY Team at Johnson Space Center for their cooperation and assistance with this research project.
References (54)
- et al.
A critical analysis of the eigenvalue method used to derive priorities in AHP
European Journal of Operational Research
(2008) - et al.
Inter-company comparison using modified TOPSIS with objective weights
Computers and Operations Research
(2000) - et al.
Group decision support with the analytic hierarchy process
Decision Support Systems
(1992) - et al.
Information systems outsourcing decisions using a group decision-making approach
Engineering Applications of Artificial Intelligence
(2009) - et al.
Identifying investment opportunities for advanced manufacturing systems with comparative-integrated performance measurement
International Journal of Production Economics
(1997) - et al.
TOPSIS for MODM
European Journal of Operational Research
(1994) - et al.
Decision-making and performance measurement models with applications to robot selection
Computers and Industrial Engineering
(1999) Decision-aid and decision making
European Journal of Operational Research
(1990)Highlights and critical points in the theory and application of the analytic hierarchy process
European Journal of Operations Research
(1994)A subjective assessment of alternative mission architectures for the human exploration of Mars at NASA Using multiattributes decision making
Computers and Operations Research
(2004)
D-Side: A facility and workforce planning group multi-attributes decision support system for Johnson Space Center
Computers and Operations Research
Development and evaluation of five fuzzy multiattribute decision making methods
International Journal of Approximate Reasoning
On rank reversal in decision analysis
Mathematical and Computer Modelling
An approach to avoiding rank reversal in AHP
Decision Support Systems
Multi-attribute decision making: a simulation comparison of select methods
European Journal of Operational Research
Computer aided robot selection: The multiple attribute decision making approach
International Journal of Production Research
Multiple attributes decision analysis: An integrated approach
Rank disagreement: A comparison of multi-criteria methodologies
Journal of Multi-Criteria Decision Analysis
Introduction to operations research
Objective weights of attributes for interfirm comparisons
Journées du groupe européen Aide Multicritére à la Décision 36e: Luxembourg
Multiattributes decision aid classification methods
Remarks on the analytic hierarchy process
Management Science
A clarification of Remarks on the analytic hierarchy process
Management Science
Multiobjective programming
Considering the financial ratios on the performance evaluation of highway bus industry
Transport Reviews
Multiple attributes decision analysis: State of the art surveys
Cited by (0)
- 1
Tel.: +32 486 707387; fax: +32 10 47 4301.