A group AHP-TOPSIS framework for human spaceflight mission planning at NASA

https://doi.org/10.1016/j.eswa.2011.04.108Get rights and content

Abstract

Human spaceflight mission planning is a complex task with many interacting systems and mission phases. Analog missions are Earth-based science missions whose purpose is to help understand the complexities inherent in future human spaceflight missions. The goal of performing an analog mission is to prepare crewmembers and support teams for future space missions in a low risk-low cost environment by repeatedly testing vehicles, habitats, and surface terrain simulators. This study presents a group multi-attribute decision making (MADM) framework developed at the Johnson Space Center (JSC) for the Integrated human exploration mission simulation facility (INTEGRITY) project to assess the priority of human spaceflight mission simulators. The proposed framework integrates subjective judgments derived from the analytic hierarchy process (AHP) with the entropy information and the technique for order preference by similarity to the ideal solution (TOPSIS) into a series of preference models for the human exploration of Mars. Three different variations of TOPSIS including conventional, adjusted and modified TOPSIS methods are considered in the proposed framework.

Highlights

► A generic framework is proposed to evaluate a number of decision alternatives. ► The information requirements are stratified into hierarchies. ► The analytical procedures decompose complex problems into manageable steps. ► The built-in inconsistency checking identifies discrepancies in judgments. ► The framework is applicable to a wide range of real-world decision making problems.

Introduction

The primary goal in multi-criteria decision making (MCDM) is to provide a set of attribute aggregation methodologies that enable the development of models considering the decision makers’ (DMs’) preferential system and judgment policy (Doumpos & Zopounidis, 2002). Achieving this goal requires the implementation of complex procedures. While intuition and simple rules are still favorite decision making methods, they may be dangerously inaccurate for complex decision problems.

Roy (1990) argues that solving MCDM problems is not searching for an optimal solution, but rather helping DMs master the complex judgments and data involved in their problems and advance towards an acceptable solution. Multi-attributes analysis is not an off-the-shelf recipe that can be applied to every problem and situation. The development of MCDM models has often been dictated by real-life problems. Therefore, it is not surprising that methods have appeared in a rather diffuse way, without any clear general methodology or basic theory (Vincke, 1992). The selection of a MCDM framework or method should be done carefully according to the nature of the problem, types of choices, measurement scales, dependency among the attributes, type of uncertainty, expectations of the DMs, and quantity and quality of the available data and judgments (Vincke, 1992). Finding the “best” MCDM framework is an elusive goal that may never be reached (Triantaphyllou, 2000).

The MCDM methods are frequently used to solve real-world problems with multiple, conflicting, and incommensurate attributes. Several authors have used MCDM to effectively solve complex space exploration problems at the National Aeronautic and Space Administration (NASA). Tavana (2003) developed a MCDM model with crisp data to evaluate and prioritize advanced-technology projects at the Kennedy Space Center (KSC). Tavana and Sodenkamp (2009) extended this model with fuzzy data and proposed a fuzzy MCDM model for technology assessment at KSC. Tavana (2004) proposed a MCDM model to evaluate a set of alternative mission architectures for the human exploration of Mars. Tavana et al., 2007, Tavana, 2008 developed two group multi-criteria decision support systems at JSC, a workforce planning system, and an environmental benchmarking system, respectively.

MCDM problems are generally categorized as continuous or discrete, depending on the domain of alternatives. Hwang and Yoon (1981) have classified the MCDM methods into two general categories: multi-objective decision making (MODM) and multi-attribute decision making (MADM). MODM has been widely studied by means of mathematical programming methods with well-formulated theoretical frameworks. MODM methods have decision variable values that are determined in a continuous or integer domain with either an infinitive or a large number of alternative choices, the best of which should satisfy the DMs constraints and preference priorities (Hwang and Masud, 1979, Ehrgott and Wiecek, 2005). MADM methods, on the other hand, have been used to solve problems with discrete decision spaces and a predetermined or a limited number of alternative choices. Churchman, Ackoff, and Arnoff (1954) initially proposed a simple additive weighting method for selecting a business investment policy. The MADM solution process requires inter and intra-attribute comparisons and involves implicit or explicit tradeoffs (Hwang & Yoon, 1981). A detailed analysis of the theoretical foundations of different MCDM methods and their comparative strengths and weaknesses is presented in Larichev and Olson, 2001, Belton and Stewart, 2002, Figueira et al., 2005.

This study presents a group MADM framework based on the analytic hierarchy process (AHP), entropy and the technique for order preference by similarity to the ideal solution (TOPSIS) that were developed for the Integrated Human Exploration Mission Simulation Facility (INTEGRITY) project at the Johnson Space Center (JSC) to assess the priority of a set of human spaceflight mission simulators. The proposed MADM framework integrates subjective judgments derived from the AHP with entropy data and TOPSIS into a series of preference models to prioritize five mission simulators for the human exploration of Mars. The structured framework presented in this study has some obvious attractive features:

  • a.

    The generic nature of the framework proposed in this study allow for the subjective evaluation of a finite number of decision alternatives on a finite number of performance attributes by a group of DMs.

  • b.

    The mathematical and computational properties of the models are applicable to a wide range of real-world decision making problems in MADM.

  • c.

    The information requirements of the proposed framework are stratified into a hierarchy to simplify information input and allow the DMs to focus on a small area of the large problem. This process is also useful for seeking input from multiple DMs.

  • d.

    Inconsistencies are inevitable when dealing with subjective information from different DMs. The built-in inconsistency checking mechanism of the proposed framework helps to identify inconsistencies in judgments at very early stages of the computation process.

The remainder of the paper is organized as follows. Section 2 presents a brief overview of AHP. In Section 3, we provide a detailed description of three TOPSIS models considered for the proposed framework. Section 4 demonstrates the problem of rank reversal in MADM and TOPSIS through numerical examples. In Section 5, we introduce the INTEGRITY project at NASA. Section 6 presents the details of the group MADM framework proposed in this study along with the results of the INEGRITY problem. Section 7 summarizes our conclusions and future research directions.

Section snippets

A brief overview of AHP

The AHP developed by Saaty, 1977, Saaty, 1994, Saaty, 2000 is a MADM approach that simplifies complex and ill-structured problems by arranging the decision attributes and alternatives in a hierarchical structure with the help of a series of pairwise comparisons. Dyer and Forman (1992) describe the advantages of AHP in a group setting as follows: (1) the discussion focuses on both tangibles and intangibles, individual and shared values; (2) the discussion can be focused on objectives rather than

A detailed description of TOPSIS

The TOPSIS method was initially presented by Hwang and Yoon (1981). It has been applied to a large number of application cases in advanced manufacturing (Agrawal et al., 1991, Parkan and Wu, 1999), purchasing and outsourcing (Kahraman et al., 2009, Shyura and Shih, 2006), and financial performance measurement (Feng & Wang, 2001). Its basic principle is that the chosen alternatives should have the shortest distance from the positive ideal solution (PIS) and the farthest distance from the

The rank-reversal phenomenon in TOPSIS

In MADM, several authors have looked into the rank reversal phenomenon which is the alteration of the ranking of alternatives by the addition (or deletion) of irrelevant alternatives. (e.g., Bana e Costa and Vansnick, 2008, Wang and Luo, 2009, Wang and Ehang, 2006). Buede and Maxwell, 1995, Wang and Luo, 2009, Zanakis et al., 1998 have conducted a series of rank reversal experiments to demonstrate the rank reversal phenomenon in TOPSIS. The three TOPSIS models described in the previous section

The INTEGRITY case study

The INTEGRITY project initiated at the JSC is expected to play an important role in increasing the success of analog missions. Analog missions are real-life, Earth-based science missions whose primary purpose is to help understand the operations, techniques, and technologies required to perform similar tasks during future human spaceflight missions. The goal of performing an analog mission is to prepare crewmembers and support teams as well as increasing the productivity and scientific return

The proposed framework

The MADM models presented in this study were used by the IT to assess the importance of each INTEGRITY simulator. Schoemaker and Russo (1993) describe four general approaches to decision making ranging from intuitive to highly analytical. These methods include intuitive judgments, rules and shortcuts, importance weighting, and value analysis. They argue that analytical methods such as importance weighting and value analysis are more complex but also more accurate than the intuitive approaches (

Conclusions and future research directions

Recent technological advances and availability of data have made MCDM more challenging than ever. Schoemaker and Russo (1993) argue that as the complexity and the amount of data increases in a decision problem, so does the importance of the solution quality. Although some mangers may favor simple approaches, they can be dangerously inaccurate for complex decision problems. Our model helps DMs (i) decompose a complex problem into manageable steps, (ii) ensure the consistency and completeness of

Disclaimer

The views and opinions expressed in this paper are those of the authors and do not reflect the views of the National Aeronautic and Space Administration and Johnson Space Center.

Acknowledgements

This research was supported in part by NASA Grant No. NAG9-1526. The authors are grateful to the entire INTEGRITY Team at Johnson Space Center for their cooperation and assistance with this research project.

References (54)

  • M. Tavana et al.

    D-Side: A facility and workforce planning group multi-attributes decision support system for Johnson Space Center

    Computers and Operations Research

    (2007)
  • E. Triantaphyllou et al.

    Development and evaluation of five fuzzy multiattribute decision making methods

    International Journal of Approximate Reasoning

    (1996)
  • Y.M. Wang et al.

    On rank reversal in decision analysis

    Mathematical and Computer Modelling

    (2009)
  • Y.M. Wang et al.

    An approach to avoiding rank reversal in AHP

    Decision Support Systems

    (2006)
  • S.H. Zanakis et al.

    Multi-attribute decision making: a simulation comparison of select methods

    European Journal of Operational Research

    (1998)
  • V.P. Agrawal et al.

    Computer aided robot selection: The multiple attribute decision making approach

    International Journal of Production Research

    (1991)
  • V. Belton et al.

    Multiple attributes decision analysis: An integrated approach

    (2002)
  • D.M. Buede et al.

    Rank disagreement: A comparison of multi-criteria methodologies

    Journal of Multi-Criteria Decision Analysis

    (1995)
  • C.W. Churchman et al.

    Introduction to operations research

    (1954)
  • D. Diakoulaki et al.

    Objective weights of attributes for interfirm comparisons

    Journées du groupe européen Aide Multicritére à la Décision 36e: Luxembourg

    (2000)
  • M. Doumpos et al.

    Multiattributes decision aid classification methods

    (2002)
  • J.S. Dyer

    Remarks on the analytic hierarchy process

    Management Science

    (1990)
  • J.S. Dyer

    A clarification of Remarks on the analytic hierarchy process

    Management Science

    (1990)
  • M. Ehrgott et al.

    Multiobjective programming

  • Expert Choice (2000). Computer software. Decision Support Software:...
  • C-M. Feng et al.

    Considering the financial ratios on the performance evaluation of highway bus industry

    Transport Reviews

    (2001)
  • J. Figueira et al.

    Multiple attributes decision analysis: State of the art surveys

    (2005)
  • Cited by (0)

    1

    Tel.: +32 486 707387; fax: +32 10 47 4301.

    View full text