Skip to main content
Log in

Knowledge elicitation with multiple experts: considerations and techniques

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

The already difficult knowledge acquisition process is complicated when the expert system being developed requires interaction with multiple experts. In this tutorial for novice knowledge engineers and managers we discuss some considerations involved in using multiple experts, including (1) deciding when multiple experts may be necessary, (2) eliciting knowledge from multiple experts individually or in small groups, and (3) knowledge engineer capabilities and preparation. Next, we present three specific group-appropriate techniques to elicit knowledge during a knowledge acquisition session: brainstorming, consensus decision making, and the nominal group technique. Finally, we consider the importance and objectives of debriefing following knowledge acquisition from multiple experts

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Cragan, J. & Wright, D. (1980) Communication in Small Group Discussions: A Case Study Approach West Publishing Co., New York.

    Google Scholar 

  • Eisenson, J., Auer, J. & Irwin, J. (1963) The Psychology of Communication Appleton-Century-Crofts, New York.

    Google Scholar 

  • Frank, A. (1982) Communicating on the Job Scott, Foresman and Co., Glenview, Illinois.

    Google Scholar 

  • Hayes-Roth, F., Waterman, D. & Lenat, D. (1983) Building Expert Systems Addison Wesley Publishing Company, Inc., Reading, MA, USA.

    Google Scholar 

  • Herrod, R. & Smith, M. (1986) The Campbell Soup story: an application of AI technology in the food industry. Texas Instruments Engineering Journal 3, 16–19.

    Google Scholar 

  • Huseman, R. (1973) The role of the nominal group in small group communication. In (eds R. C.Huseman, D. M.Logue and D. L.Freshley) Readings in Interpersonal and Organizational Communication 2nd edn Hollbrook, Boston.

    Google Scholar 

  • McGraw K. & Seale M. (1987) Structured knowledge acquisition for avionics systems. NAECON Proceedings, vol. 4, pp. 1340–1347. (May, 1987), Dayton, Ohio.

  • McGraw, K. & Seale, M. (1987b) Multiple expert knowledge acquisition methodology. Presented at the Third Australian Conference on Expert Systems (May, 1987), Sydney, Australia.

  • Mittal, S. & Dym. C. (1985) Knowledge acquisition from multiple experts. AI Magazine. Summer, 32–36.

  • Osborn, A. (1953) Applied Imagination: Principles and Procedures of Creative Thinking Scribner's, New York.

    Google Scholar 

  • Ross, R. (1977) Speech Communication, Prentice-Hall, Englewood Cliffs, NJ, USA.

    Google Scholar 

  • Sattler, W. & Miller, N. (1968) Discussion and Conference, Prentice-Hall, Englewood Cliffs, NJ, USA.

    Google Scholar 

  • Shaw, M. E. (1932) A Comparison of individuals and small groups in the rational solution of complex problems. American Journal of Psychology, 44, 491–504.

    Google Scholar 

  • Shaw, M. E. (1976) Group Dynamics: The Psychology of Small Group Behavior McGraw-Hill, New York.

    Google Scholar 

  • Slater, P. (1958) Contrasting correlates of group size. Sociometry, 25, 129–139.

    Google Scholar 

  • Steiner, I. (1972) Group Process and Productivity. Academic Press, New York.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Dr K. McGraw currently heads Cognitive Technologies, a consulting firm in Alexandria, VA. She is on assignment with Falcon Microsystems at 1801 McCormick Dr., Landover, MD 20785.

Rights and permissions

Reprints and permissions

About this article

Cite this article

McGraw, K.L., Seale, M.R. Knowledge elicitation with multiple experts: considerations and techniques. Artif Intell Rev 2, 31–44 (1988). https://doi.org/10.1007/BF00139624

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00139624

Keywords

Navigation