Skip to main content
SpringerLink
Log in

Insights into Human-Agent Teaming: Intelligent Agent Transparency and Uncertainty

  • Conference paper
  • First Online:
Advances in Human Factors in Robots and Unmanned Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 499))

Abstract

This paper discusses two studies testing the effects of agent transparency in joint cognitive systems involving supervisory control and decision-making. Specifically, we examine the impact of agent transparency on operator performance (decision accuracy), response time, perceived workload, perceived usability of the agent, and operator trust in the agent. Transparency has a positive impact on operator performance, usability, and trust, yet the depiction of uncertainty has potentially negative effects on usability and trust. Guidelines and considerations for displaying transparency in joint cognitive systems are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chen, J.Y.C., Barnes, M.J.: Human-agent teaming for multi-robot control: a review of human factors issues. IEEE Trans. Hum. Mach. Syst. 44, 13–29 (2014)

    Article  Google Scholar 

  2. Linegang, M.P., Stoner, H.A., Patterson, M.J., Seppelt, B.D., Hoffman, J.D., Crittendon, Z.B., Lee, J.D.: Human-automation collaboration in dynamic mission planning: a challenge requiring an ecological approach. In: Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, pp. 2482–2486. SAGE Publications, California (2006)

    Google Scholar 

  3. Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. CRC Press, Boca Raton (2005)

    Book  Google Scholar 

  4. Boy, G.A.: Cognitive Function Analysis. Ablex Publishing Corporation, Stamford (1998)

    Google Scholar 

  5. Kasdaglis, N., Newton, O., Lakhmani, S.: system state awareness: a human centered design approach to awareness in a complex world. In: Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting, pp. 305–309, SAGE Publications, California (2014)

    Google Scholar 

  6. Hollnagel, E., Woods, D., Leveson, N.: Resilience Engineering: Concepts and Precepts. Ashgate, Surrey (2006)

    Google Scholar 

  7. Boy, G.: Theories of human cognition: to better understand the co-adaptation of people and technology. In: Kiel, LD (ed.) Knowledge Management, Organizational Intelligence and Learning, and Complexity, vol. 3, Developed under the Auspices of the UNESCO, pp. 204–238. Eolss Publishers Co Ltd, Oxford (2009)

    Google Scholar 

  8. Parasuraman, R., Cosenzo, K.A.De, Visser, E.: Adaptive automation for human supervision of multiple uninhabited vehicles: effects on change detection, situation awareness, and mental workload. Mil. Psychol. 21, 270–297 (2009)

    Article  Google Scholar 

  9. Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46, 50–80 (2004)

    Article  Google Scholar 

  10. Chen, J.Y.C., Procci, K., Boyce, M., Wright, J., Garcia, A., Barnes, M.: Situation awareness-based agent transparency (ARL-TR-6905). Technical Report, US Army Research Laboratory, Aberdeen Proving Ground (2014)

    Google Scholar 

  11. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37, 32–64 (1995)

    Article  Google Scholar 

  12. Smith, K., Hancock, P.: Situation awareness is adaptive, externally directed consciousness. Hum. Factors 37, 137–148 (1995)

    Article  Google Scholar 

  13. Endsley, M.R., Jones, D.G.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2012)

    Google Scholar 

  14. Stanton, N.A., Chambers, P.R., Piggott, J.: Situational awareness and safety. Saf. Sci. 39, 189–204 (2001)

    Article  Google Scholar 

  15. Woods, D.D.: Cognitive technologies: the design of joint human-machine cognitive systems. AI Mag. 6, 86–92 (1985)

    Google Scholar 

  16. Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Patterns in Cognitive Systems Engineering. CRC Press, Boca Raton (2006)

    Google Scholar 

  17. Cook, M.B., Smallman, H.S.: Human factors of the confirmation bias in intelligence analysis: decision support from graphical evidence landscapes. Hum. Factors 50, 745–754 (2008)

    Article  Google Scholar 

  18. Neyedli, H.F., Hollands, J.G., Jamieson, G.A.: Beyond identity incorporating system reliability information into an automated combat identification system. Hum. Factors 53, 338–355 (2011)

    Article  Google Scholar 

  19. Gao, J., Lee, J.: Extending the decision field theory to model operator’s reliance on automation in supervisory control systems. IEEE Trans. Syst. Man Cybern. A. Syst. Humans 36, 943–959 (2006)

    Google Scholar 

  20. Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse. Abuse. Hum. Factors 39, 230–253 (1997)

    Article  Google Scholar 

  21. Bratman, M.: Intention, Plans, and Practical reason. CSLI Publications, Stanford (1987)

    Google Scholar 

  22. Behymer, K.J., Mersch, E.M., Ruff, H.A., Calhoun, G.L., Spriggs, S.E.: unmanned vehicle plan comparison visualization for effective human-autonomy teaming. In: Proceedings of 6th international conference on ahfe and the affiliated conference, pp. 1022–1029. Elsevier B. V, Netherlands (2015)

    Google Scholar 

  23. U.S. Department of Defense—Research & Engineering Enterprise. Autonomy Research Pilot Initiative. http://www.acq.osd.mil/chieftechnologist/arpi.html

  24. Draper, M.: Realizing autonomy via intelligent adaptive hybrid control: adaptable autonomy for achieving UxV RSTA team decision superiority—year 1 report. US Air Force Research Laboratory, Dayton (in press)

    Google Scholar 

  25. Fern, L., Shively, R.J.: A comparison of varying levels of automation on the supervisory control of multiple UASs. In: Proceedings of AUVSIs Unmanned Systems North America, pp. 10–13. Curran Associates Inc., New York (2009)

    Google Scholar 

  26. Miller, C.A., Parasuraman, R.: Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum. Factors 49, 57–75 (2007)

    Article  Google Scholar 

  27. Rowe, A., Spriggs, S., Hooper, D.: Fusion: a framework for human interaction with flexible-adaptive automation across multiple unmanned systems. In: Proceedings of 18th symposium on aviation psychology, pp. 464–469. Curran Associates Inc., New York (2015)

    Google Scholar 

  28. Mercado, J., Rupp, M., Chen, J., Barber, D., Procci, K., Barnes, M.: Intelligent agent transparency in human-agent teaming for multi-UxV management. Human Factors (in press)

    Google Scholar 

  29. Stowers, K., Chen, J.Y.C., Kasdaglis, N., Newton, O., Rupp, M., Barnes, M.: Effects of situation awareness-based agent transparency information on human agent teaming for multi-UxV management (in press)

    Google Scholar 

  30. Lyons, J.B., Havig, P.R.: Transparency in a human-machine context: approaches for fostering shared awareness/intent. In: Shumaker, R., Lackey, S. (eds.) Virtual, Augmented and Mixed Reality: Designing and Developing Virtual and Augmented Environments, pp. 181–190. Springer, Berlin (2014)

    Google Scholar 

  31. Wang, L., Jamieson, G.A., Hollands, J.G.: Trust and reliance on an automated combat identification system. Hum. Factors 51, 281–291 (2009)

    Article  Google Scholar 

  32. Merritt, S.M., Heimbaugh, H., LaChapell, J., Lee, D.: I trust it, but i don’t know why effects of implicit attitudes toward automation on trust in an automated system. Hum. Factors 55, 520–534 (2012)

    Article  Google Scholar 

  33. Stowers, K., Kasdaglis, N., Newton, O., Lakhmani, S., Wohleber, R., Chen, J.: Intelligent agent transparency: the design and evaluation of an interface to facilitate human and artificial agent collaboration. In: Proceedings of the Human Factors and Ergonomics 60th Annual Meeting (submitted)

    Google Scholar 

  34. Endsley, Mica R.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2011)

    Book  Google Scholar 

  35. Stowers, K., Oglesby, J., Leyva, K., Iwig, C., Shimono, M., Hughes, A., Salas, E.: A framework to guide the assessment of human-machine systems. Human Factors (submitted)

    Google Scholar 

Download references

Acknowledgments

This research was supported by the U.S. Department of Defense Autonomy Research Pilot Initiative, under the Intelligent Multi-UxV Planner With Adaptive Collaborative/Control Technologies (IMPACT) project. We wish to thank Joseph Mercado, Katelyn Procci, Isacc Yi, Erica Valiente, Shan Lakhmani, and Jonathan Harris for their contribution to this project. We would also like to thank Gloria Calhoun and Mark Draper for their input.

Author information

Authors and Affiliations

  1. Insitute for Simulation and Training, 3100 Technology Parkway, Orlando, FL, 32826, USA

    Kimberly Stowers, Nicholas Kasdaglis, Michael Rupp & Daniel Barber

  2. U.S. Army Research Laboratory, Orlando, FL, 32826, USA

    Jessie Chen

  3. U.S. Army Research Laboratory, Ft. Huachuca, AZ, 85613, USA

    Michael Barnes

Authors
  1. Kimberly Stowers
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicholas Kasdaglis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Rupp
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jessie Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daniel Barber
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michael Barnes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jessie Chen .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, USA

    Pamela Savage-Knepshield

  2. U.S. Army Research Laboratory, Aberdeen Proving Ground, USA

    Jessie Chen

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

Stowers, K., Kasdaglis, N., Rupp, M., Chen, J., Barber, D., Barnes, M. (2017). Insights into Human-Agent Teaming: Intelligent Agent Transparency and Uncertainty. In: Savage-Knepshield, P., Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol 499. Springer, Cham. https://doi.org/10.1007/978-3-319-41959-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41959-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41958-9

  • Online ISBN: 978-3-319-41959-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation