Abstract
Organizations are keen to obtain as much value as they can from their information systems (IS) investments. While the first-order benefits of new information systems are usually obtained when they are used routinely, the full potential of new systems is only unlocked when they are used deeply. While the support of managers and peers can encourage individuals to use systems more deeply, the latter’s lack of technical know-how means that they may not be able to allay fears or doubts that arise as they improvise and experiment with new systems to infuse them into their work processes. We use social cognitive theory to frame infusion as a learning process, where individuals model their behavior based on the behaviors of others they observe in the environment and the resources available. We argue that individual users succeed in infusing new systems into their work when they interact with IS professionals. This interaction allows users to observe the actions of IS professionals and receive knowledge and guidance from them. The results of our study show that the discretionary behaviors exhibited by IS professionals positively affect users’ perceptions of the levels of usefulness and ease of use of new systems, encouraging them to use the systems as fully as possible. This study extends our understanding of the role that the discretionary behavior of IS professionals plays in enhancing the value that organizations obtain from their new IS investments.
Similar content being viewed by others
References
Adam, F., & O'Doherty, P. (2003). ERP projects: Good or bad for SMEs. Cambridge: Cambridge University Press.
Ahuja, M. K., McKnight, D. H., Chudoba, K. M., George, J. F., & Kacmar, C. J. (2007). IT road warriors: Balancing work-family conflict, job autonomy, and work overload to mitigate turnover intentions. MIS Quarterly, 31(1), 1–17.
Ahuja, M. K., & Thatcher, J. B. (2005). Moving beyond intentions and toward the theory of trying: Effects of work environment and gender on post-adoption information technology use. MIS Quarterly, 29(3), 427–459.
Arbuckle, J. L. (2014). AMOS (Version 23.0) [Computer Program]. Chicago: IBM SPSS.
Ayyagari, R., Grover, V., & Purvis, R. (2011). Technostress: Technological antecedents and implications. MIS Quarterly, 35(4), 831–858.
Bailey, E., & Becker, J. D. (2014). A comparison of IT governance and control frameworks in cloud computing. Paper presented at the 20th Americas Conference on Information Systems (AMCIS), America.
Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ: Prentice-Hall.
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall, Inc.
Bandura, A. (1988). Organizational applications of social cognitive theory. Australian Journal of Management, 13(2), 275–302.
Bandura, A. (2000). Social cognitive theory of mass communication. Media Psychology, 3(3), 265–299.
Bassellier Reich, B. H., & Benbasat, I. (2001). Information technology competence of business managers: A definition and research model. Journal of Management Information Systems, 17(4), 159–182.
Bassellier, G., & Benbasat, I. (2004). Business competence of information technology professionals: Conceptual development and influence on IT-business partnerships. MIS Quarterly, 28(4), 673–694.
Beaudry, A., & Pinsonneault, A. (2010). The other side of acceptance: Studying the direct and indirect effects of emotions on information technology use. MIS Quarterly, 34(4), 689–710.
Bhattacherjee, A., & Premkumar, G. (2004). Understanding changes in belief and attitude toward information technology usage: A theoretical model and longitudinal test. MIS Quarterly, 28(2), 229–254.
Brief, A. P., & Motowidlo, S. J. (1986). Prosocial organizational behaviors. Academy of Management Review, 11(4), 710–725.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258.
Bryant, S. E., Moshavi, D., & Nguyen, T. V. (2007). A field study on organizational commitment, professional commitment and peer mentoring. ACM SIGMIS Database: the DATABASE for Advances in Information Systems, 38(2), 61–74.
Burton-Jones, A. (2014). What have we learned from the smart machine? Information and Organization, 24(2), 71–105.
Byrne, B. M. (2006). Structural equation modeling with EQS: Basic concepts applications and programming. Mahwah, NJ: Lawrence Erlbaum Associates.
Carter, M. Z., Armenakis, A. A., Feild, H. S., & Mossholder, K. W. (2013). Transformational leadership, relationship quality, and employee performance during continuous incremental organizational change. Journal of Organizational Behavior, 34(7), 942–958.
Chau, P. Y. K. (1997). Reexamining a model for evaluating information center success using a structural equation modeling approach. Decision Sciences, 28(2), 309–334.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255.
Chin, W. W., (1998). The partial least squares approach to structural equation modeling. Modern Methods for Business Research (295(2), 295–336.
Ciborra, C. U. (1996). The platform organization: recombining strategies, structures, and surprises. Organization Science, 7(2), 103–118.
Ciborra, C. U. (1999). Notes on improvisation and time in organizations. Accounting, Management and Information Technologies, 9(2), 77–94.
Compeau, D. R., & Higgins, C. A. (1995). Application of social cognitive theory to training for computer skills. Information Systems Research, 6(2), 118–143.
Constant, D., Kiesler, S., & Sproull, L. (1994). What's mine is ours, or is it? A study of attitudes about information sharing. Information Systems Research, 5(4), 400–421.
Constant, D., Sproull, L., & Kiesler, S. (1996). The kindness of strangers: The usefulness of electronic weak ties for technical advice. Organization Science, 7(2), 119–135.
Cooper, R. B., & Zmud, R. W. (1990). Information technology implementation research: A technological diffusion approach. Management Science, 36(2), 123–139.
Crossan, M., Cunha, M. P. E., Vera, D., & Cunha, J. (2005). Time and organizational improvisation. Academy of Management Review, 30(1), 129–145.
Curtis, B., Krasner, H., & Iscoe, N. (1988). A field study of the software design process for large systems. Communications of the ACM, 31(11), 1268–1287.
Deng, X., & Wang, T. (2014). Understanding post-implementation support for enterprise systems: An empirical study of IT personnel's customer-oriented citizenship behaviors. Journal of Information Systems, 28(2), 17–39.
Deng, X. N., Wang, T., & Galliers, R. D. (2015). More than providing ‘solutions’: Towards an understanding of customer-oriented citizenship behaviours of IS professionals. Information Systems Journal, 25(5), 489–530.
Elbanna, A. R. (2006). The validity of the improvisation argument in the implementation of rigid technology: The case of ERP systems. Journal of Information Technology, 21(3), 165–175.
Eli, J., Suresh, S., & Wynne, C. (2002). Factors leading to sales force automation use: A longitudinal analysis. The Journal of Personal Selling & Sales Management, 22(3), 145–156.
Ewusi-Mensah, K. (1997). Critical issues in abandoned information systems development projects. Communications of ACM, 40(9), 74–80.
Fornell, C., & Larcker, D. F. (1980). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.
Gerbing, D. W., & Anderson, J. C. (1992). Monte Carlo evaluations of goodness-of-fit indices for structural equation models. Sociological Methods & Research, 21(2), 132–160.
Ghosh, B. (2011). Teaching tip GlobePort faces global business challenges-assessing the organizational side of information systems projects. Journal of Information Systems Education, 22(2), 87–94.
Gopalakrishna-Remani, V., Jones, R. P., & Camp, K. M. (2018). Levels of EMR adoption in US hospitals: An empirical examination of absorptive capacity, institutional pressures, top management beliefs, and participation. Information Systems Frontiers, 1–20.
Gray, P. H., & Durcikova, A. (2006). The role of knowledge repositories in technical support environments: Speed versus learning in user performance. Journal of Management Information Systems, 22(3), 159–190.
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis. Upper Saddle River.
Higgins, E. T., & Bargh, J. A. (1987). Social cognition and social perception. Annual Review of Psychology, 38(1), 369–425.
Hmieleski, K. M., & Corbett, A. C. (2006). Proclivity for improvisation as a predictor of entrepreneurial intentions. Journal of Small Business Management, 44(1), 45–63.
Hoffman, B. J., Blair, C. A., Meriac, J. P., & Woehr, D. J. (2007). Expanding the criterion domain? A quantitative review of the OCB literature. Journal of Applied Psychology, 92(2), 555–566.
Hsieh, J. J. P.-A., Rai, A., Petter, S., & Zhang, T. (2012). Impact of user satisfaction with mandated CRM use on employee service quality. MIS Quarterly, 36(4), 1065–1080.
Hsieh, J. J. P.-A., & Wang, W. (2007). Explaining employees' extended use of complex information systems. European Journal of Information Systems, 16(3), 216–227.
Hsu, J. S.-C., Shih, S.-P., Hung, Y. W., & Lowry, P. B. (2015). The role of extra-role behaviors and social controls in information security policy effectiveness. Information Systems Research, 26(2), 282–300.
Hu, L. t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
Jasperson, J., Carter, P. E., & Zmud, R. W. (2005). A comprehensive conceptualization of post-adoptive behaviors associated with information technology enabled work systems. MIS Quarterly, 29(3), 525–557.
Jin, X.-L., Lee, M. K., & Cheung, C. M. (2010). Predicting continuance in online communities: Model development and empirical test. Behaviour & Information Technology, 29(4), 383–394.
Jones, E., Sundaram, S., & Chin, W. (2002). Factors leading to sales force automation use: A longitudinal analysis. Journal of Personal Selling and Sales Management, 22(3), 145–156.
Joseph, D., Ang, S., Chang, R., & Slaughter, S. (2010). Practical intelligence in IT: Assessing soft skills of IT professionals. Communications of the ACM, 53(2), 149–154.
Kamoche, K., & Cunha, M. P. E. (2001). Minimal structures: From jazz improvisation to product innovation. Organization Studies, 22(5), 733–764.
Keil, M., Lee, H. K., & Deng, T. (2013). Understanding the most critical skills for managing IT projects: A delphi study of IT project managers. Information Management, 50(7), 398–414.
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507.
Kenny, D. A., & McCoach, D. B. (2003). Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 10(3), 333–351.
Kettinger, W. J., Zhang, C., & Chang, K.-C. (2013). Research note - the view from the top: Integrated information delivery and effective information use from the senior executive's perspective. Information Systems Research, 24(3), 842–860.
Kim, J. U., & Kishore, R. (2018). Do we fully understand information systems failure? An exploratory study of the cognitive Schema of IS professionals. Information Systems Frontiers, 1–35.
Kline, R. B. (2015). Principles and practice of structural equation modeling. New York: The Guilford Press.
Ko, D.-G., Kirsch, L. J., & King, W. R. (2005). Antecedents of knowledge transfer from consultants to clients in enterprise system implementations. MIS Quarterly, 29(1), 59–85.
Lai, V. S., & Li, H. (2005). Technology acceptance model for internet banking: An invariance analysis. Information Management, 42(2), 373–386.
Lamb, R., & Kling, R. (2003). Reconceptualizing users as social actors in information systems research. MIS Quarterly, 27(2), 197–236.
Lee, G., & Lee, W. J. (2010). Altruistic traits and organizational conditions in helping online. Computers in Human Behavior, 26(6), 1574–1580.
LePine, J. A., Erez, A., & Johnson, D. E. (2002). The nature and dimensionality of organizational citizenship behavior: A critical review and meta-analysis. Journal of Applied Psychology, 87(1), 52–65.
Li, X., Hsieh, J. J. P.-a., & Rai, A. (2013). Motivational differences across post-acceptance information system usage behaviors: An investigation in the business intelligence systems context. Information Systems Research, 24(3), 659–682.
Little, T. D. (1997). Mean and covariance structures (macs), analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32(1), 53–76.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149.
Magni, M., Proserpio, L., Hoegl, M., & Provera, B. (2009a). The role of team behavioral integration and cohesion in shaping individual improvisation. Research Policy, 38(6), 1044–1053.
Magni, M., Provera, B., & Proserpio, L. (2009b). Individual improvisation in information systems development. In Handbook of research on modern systems analysis and design technologies and applications. USA: IGI Global.
Magni, M., Provera, B., & Proserpio, L. (2010). Individual attitude toward improvisation in information systems development. Behaviour & Information Technology, 29(3), 245–255.
Maruyama, G. M. (1998). Basics of Structural Equation Modeling Thousand Oaks, Calif: Sage Publications.
Massa, S., & Testa, S. (2005). Data warehouse-in-practice: Exploring the function of expectations in organizational outcomes. Information Management, 42(5), 709–718.
McDonald, R. P., & Ho, M.-H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64–82.
Mendonca, D., & Fiedrich, F. (2006). Training for improvisation in emergency management: Opportunities and limits for information technology. International Journal of Emergency Management, 3(4), 348–363.
Mendonca, D. J., & Wallace, W. A. (2007). A cognitive model of improvisation in emergency management. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 37(4), 547–561.
Messersmith, J. (2007). Managing work-life conflict among information technology workers. Human Resource Management, 46(3), 429–451.
Miner, A. S., Bassof, P., & Moorman, C. (2001). Organizational improvisation and learning: A field study. Administrative Science Quarterly, 46(2), 304–337.
Moorman, C., & Miner, A. S. (1998). Organizational improvisation and organizational memory. Academy of Management Review, 23(4), 698–723.
Nelson, K. M., & Cooprider, J. G. (1996). The contribution of shared knowledge to IS group performance. MIS Quarterly, 20(4), 409–432.
Nisula, A.-M., & Kianto, A. (2016). The role of knowledge management practices in supporting employee capacity for improvisation. International Journal of Human Resource Management, 27(17), 1920–1937.
Nunnally, J. C., & Bernstein, I. R. (1994). Psychometric theory. New York: McGraw-Hill.
O’Connor, Y., & O’Reilly, P. (2016). Examining the infusion of mobile technology by healthcare practitioners in a hospital setting. Information Systems Frontiers, 1–21.
Organ, D. W. (1988). Organizational citizenship behavior: The good soldier syndrome. Lexington, MA: Lexington.
Orlikowski, W., & Hoffman, D. (1997). An improvisational model for change management: The case of groupware technologies. In T. Malone & R. Laubacher (Eds.), Inventing the organizations of the 21st century (pp. 265–282). Boston, MA: MIT.
Orlikowski, W. J. (1996). Improvising organizational transformation over time: A situated change perspective. Information Systems Research, 7(1), 63–92.
Orlikowski, W. J. (2000). Using technology and constituting structures: A practice lens for studying technology in organizations. Organization Science, 11(4), 404–428.
Pawlowski, S. D., & Robey, D. (2004). Bridging user organizations: Knowledge brokering and the work of information technology professionals. MIS Quarterly, 28(4), 645–672.
Petter, S., DeLone, W., & McLean, E. (2008). Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems, 17(3), 236–263.
Petter, S., & McLean, E. R. (2009). A meta-analytic assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level. Information Management, 46(3), 159–166.
Podsakoff MacKenzie, S. B., Paine, J. B., & Bachrach, D. G. (2000). Organizational citizenship behaviors: A critical review of the theoretical and empirical literature and suggestions for future research. Journal of Management, 26(3), 513–563.
Podsakoff, M., & MacKenzie, B. (1997). Impact of organizational citizenship behavior on organizational performance: A review and suggestion for future research. Human Performance, 10(2), 133–151.
Podsakoff, N. P., Whiting, S. W., Podsakoff, P. M., & Blume, B. D. (2009). Individual- and organizational-level consequences of organizational citizenship behaviors: a meta-analysis. Journal of Applied Psychology, 94(1), 122–141.
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12(4), 531–544.
Rafaeli, A., Ziklik, L., & Doucet, L. (2008). The impact of call center employees' customer orientation behaviors on service quality. Journal of Service Research, 10(3), 239–255.
Rahrovani, Y., Addas, S., & Pinsonneault, A. (2015). Exploring the long shadow of IT innovation adoption decisions on IT value. Systèmes d'information & Management, 19(4), 31–87.
Reich, B. H., & Benbasat, I. (1996). Measuring the linkage between business and information technology objectives. MIS Quarterly, 20(1), 55–81.
Reich, B. H., & Benbasat, I. (2000). Factors that influence the social dimension of alignment between business and information technology objectives. MIS Quarterly, 24(1), 81–113.
Rice, R. E., Collins-Jarvis, L., & Zydney-Walker, S. (1999). Individual and structural influences on information technology helping relationships. Journal of Applied Communication Research, 27(4), 285–309.
Rivers, L. M., & Dart, J. (1999). Sales technology applications: The acquisition and use of sales force automation by mid-sized manufacturers. Journal of Personal Selling & Sales Management, 19(2), 59–73.
Roberts, T. L., Cheney, P. H., Sweeney, P. D., & Hightower, R. T. (2004). The effects of information technology project complexity on group interaction. Journal of Management Information Systems, 21(3), 223–247.
Ross, J. W., Beath, C. M., & Goodhue, D. L. (1996). Develop long-term competitiveness through IT assets. Sloan Management Review, 38(1), 31–42.
Saeed, K. A., & Abdinnour-Helm, S. (2008). Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Information Management, 45(6), 376–386.
Saga, V. L., & Zmud, R. W. (1994). The nature and determinants of IT acceptance, routinization, and infusion. Proceedings of the IFIP TC8 Working Conference on Diffusion, Transfer and Implementation of Information Technology 1994 (pp. 67–86). Elsevier Science, Inc.
Santhanam, R., Seligman, L., & Kang, D. (2007). Post implementation knowledge transfers to users and information technology professionals. Journal of Management Information Systems, 24(1), 171–199.
Sawyer, S., Eschenfelder, K., Diekema, A., & McClure, C. (1998). IT Skills in the Context of BigCo. Proceedings of the 1998 ACM SIGCPR Conference on Computer Personnel Research, pp. 9-18. Boston, Massachusetts, USA.
Segars, A. H., & Grover, V. (1993). Re-examining perceived ease of use and usefulness: A confirmatory factor analysis. MIS Quarterly, 17(4), 517–525.
Skulmoski, G. J., & Hartman, F. T. (2010). Information systems project manager soft competencies: A project-phase investigation. Project Management Journal, 41(1), 61–80.
Sultan, N. (2010). Cloud computing for education: a new dawn? International Journal of Information Management, 30(2), 109–116.
Sundaram, S., Schwarz, A., Jones, E., & Chin, W. W. (2007). Technology use on the front line: How information technology enhances individual performance. Journal of the Academy of Marketing Science, 35(1), 101–112.
Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Harlow: Pearson Education Limited.
Tarafdar, M., & Gordon, S. R. (2007). Understanding the influence of information systems competencies on process innovation: A resource-based view. Journal of Strategic Information Systems, 16(4), 353–392.
Tarafdar, M., Qiang, T. U., Ragu-Nathan, B. S., & Ragu-Nathan, T. S. (2007). The impact of technostress on role stress and productivity. Journal of Management Information Systems, 24(1), 301–328.
Tsai, H.-Y., Compeau, D., & Haggerty, N. (2007). Of races to run and battles to be won: Technical skill updating, stress, and coping of IT professionals. Human Resource Management, 46(3), 395–409.
Urbach, N., Smolnik, S., & Riempp, G. (2009). The state of research on information systems success – A review of existing multidimensional approaches. Business & Information Systems Engineering, 1(4), 315–325.
Van Dyne, L., & Cummings, L. (1990). Extra-Role Behaviors: The need for construct and definitional clarity. Paper presented at 50th Annual Meeting of the Academy of Management, San Francisco, CA.
Venkatesh, V., & Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision Sciences, 39(2), 273–315.
Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186–204.
Venkatesh, V., Morris, M. G., Davis, F. D., & Davis, G. B. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478.
Venkatesh, V., Thong, J. Y. L., Chan, F. K. Y., Hu, P. J. H., & Brown, S. A. (2011). Extending the two-stage information systems continuance model: Incorporating UTAUT predictors and the role of context. Information Systems Journal, 21(6), 527–555.
Vera, D., & Crossan, M. (2004). Theatrical improvisation: lessons for organizations. Organization Studies, 25(5), 727–749.
Walz, D., Elam, J., & Curtis, B. (1993). Inside a software design team: knowledge acquisition, sharing, and integration. Communications of the ACM, 36(10), 63–77.
Webster, J. R., & Beehr, T. A. (2013). Antecedents and outcomes of employee perceptions of intra-organizational mobility channels. Journal of Organizational Behavior, 34(7), 919–941.
Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9(1), 1–26.
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? Journal of Applied Psychology, 74(3), 462–468.
Yen, H. R., Hu, P. J.-H., Hsu, S. H.-Y., & Li, E. Y. (2015). A multilevel approach to examine employees’ loyal use of ERP systems in organizations. Journal of Management Information Systems, 32(4), 144–178.
Yen, H. R., Li, E. Y., & Niehoff, B. P. (2008). Do organizational citizenship behaviors lead to information system success? Information Management, 45(6), 394–402.
Zuboff, S. (1988). In the age of the smart machine: The future of work and power. New York: Basic Books.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix A
Appendix B
Appendix C
Appendix D
1.1 Fit indexes
Maruyama (1998) categorized different fit indexes into the main three types: absolute, relative and adjusted indexes. The absolute fit indexes indicate the degree to which an estimated model closely fits the sample data. Some of the commonly used absolute fit indexes include root mean squared error of approximation (RMSEA), the goodness-of-fit Index (GFI), and the root mean square residual (RMR).
RMSEA is the most popular fit index and has been reported a number of times by researchers (Kenny et al. 2015). Research on RMSEA cut-off points has distinguished between different values that are indicators of how closely models with estimated parameters fit the population’s covariance matrix (Byrne 2006). Hu and Bentler (1999) recommended that good-fitting models should yield RMSEA values of less than 0.06, while MacCallum et al. (1996) categorized fit quality based on three cut-off points of 0.01, 0.05, and 0.08, indicating excellent, good, and mediocre fit, respectively. A stricter threshold suggested by (Browne and Cudeck 1992) was that RMSEA values of about 0.05 or less are indicative of a close model fit and RMSEA values of about 0.08 or less indicate reasonable error of approximation. They also do not recommend an RMSEA value of greater than 0.1.
The goodness-of-fit index (GFI) ranges from 0 to 1, where 1 indicates a close or perfect fit. Chau (1997) recommended that good-fitting models yield GFI values of at least 0.90 or greater than 0.90, while other researchers have suggested GFI values ranging from 0.80 to 0.89 as demonstrating reasonable fitting models (Lai and Li 2005; Tarafdar et al. 2007). The root mean square residual (RMR) is the third fit index and should be small for good-fitting models (Tabachnick and Fidell 2001). RMR values less than 0.1 should indicate good-fitting models (Chau 1997). As it may sometimes be difficult to interpret an unstandardized residual since the scales of the variables affect the size of the residual, a standardized root mean square residual (SRMR) can be used (Tabachnick and Fidell 2001). The SRMR has a value of 0 to 0.1, where lower values are preferred. Hu and Bentler (1999) mention that values of about 0.08 or even less are desired.
Relative fit indexes, known as comparative fit indices, include the normed fit index (NFI), the non-normed fit index (NNFI) (or the Tucker Lewis Index (TLI)), the incremental fit index (IFI), and the comparative fit index (CFI) (Maruyama 1998). Generally, the recommended range for all relative fit indices for good-fitting models is between 0.90 and 1 (Chau 1997; Hair et al. 1998; Tabachnick and Fidell 2001). In addition, rules of thumb for good-fitting models are that cut-off values for CFI and TLI should be close to 0.95 or even higher (Hu and Bentler 1999). Adjusted indexes, known as parsimonious fit indexes and labelled as adjusted goodness-of-fit index (AGFI), can be adjusted for the number of parameters estimated in a model. The most common recommended AGFI ranges for good-fitting models are greater than 0.80 (Chau 1997; Segars and Grover 1993).
In terms of which fit indices should be reported, researchers have argued that it would be better to select fit indices from different categories, and they have thus suggested a variety of optional/categorical fit indexes. The recommended cut-offs for reasonable and good-fitting models are listed in Appendix Table 12. McDonald and Ho (2002) recommend that the most common fit indexes are the CFI, GFI, NFI, and the TLI. Hu and Bentler (1999) suggested a two-index presentation, always including SRMR with TLI, RMSEA, and the CFI. Kline (2015) strongly believes in reporting the Chi-Square test, RMSEA, CFI, and the SRMR.
Our research reports χ2/df, SRMR, IFI, NNFI (TLI), CFI, and RMSEA. It is important to note that the chi-square value is sensitive to the sample size and number of variables. Studies with large sample sizes rarely report a nonsignificant chi-square value, which would indicate a perfect fit, while conversely, significant chi-square values indicate a poor fitting model) (Tabachnick and Fidell 2001). Therefore, this study uses χ2/df, where the χ2/df values of good-fitting models ranges between 1 and 3 (Kline 2015) or 1 and 2 (Tabachnick and Fidell 2001). SRMR is the index that is the most sensitive to models with misspecified factor covariance(s) or latent structure(s) (Hu and Bentler 1999). IFI and NNFI (TLI) are chosen because they are relatively unaffected by sample size, which is useful since some fit indices are high merely because of the large sample sizes (Gerbing and Anderson 1992; Hu and Bentler 1999). In addition, NNFI (TLI) is not affected by the number of parameters of the model. Finally, CFI and RMSEA are the most frequently reported fit indices (Tabachnick and Fidell 2001). RMSEA is the index that is the most sensitive to models with misspecified factor loadings and varies with the number of variables (Kenny and McCoach 2003).
Rights and permissions
About this article
Cite this article
Karimikia, H., Safari, N. & Singh, H. Being useful: How information systems professionals influence the use of information systems in enterprises. Inf Syst Front 22, 429–453 (2020). https://doi.org/10.1007/s10796-018-9870-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10796-018-9870-7