Abstract
The already difficult knowledge acquisition process is complicated when the expert system being developed requires interaction with multiple experts. In this tutorial for novice knowledge engineers and managers we discuss some considerations involved in using multiple experts, including (1) deciding when multiple experts may be necessary, (2) eliciting knowledge from multiple experts individually or in small groups, and (3) knowledge engineer capabilities and preparation. Next, we present three specific group-appropriate techniques to elicit knowledge during a knowledge acquisition session: brainstorming, consensus decision making, and the nominal group technique. Finally, we consider the importance and objectives of debriefing following knowledge acquisition from multiple experts
Similar content being viewed by others
References
Cragan, J. & Wright, D. (1980) Communication in Small Group Discussions: A Case Study Approach West Publishing Co., New York.
Eisenson, J., Auer, J. & Irwin, J. (1963) The Psychology of Communication Appleton-Century-Crofts, New York.
Frank, A. (1982) Communicating on the Job Scott, Foresman and Co., Glenview, Illinois.
Hayes-Roth, F., Waterman, D. & Lenat, D. (1983) Building Expert Systems Addison Wesley Publishing Company, Inc., Reading, MA, USA.
Herrod, R. & Smith, M. (1986) The Campbell Soup story: an application of AI technology in the food industry. Texas Instruments Engineering Journal 3, 16–19.
Huseman, R. (1973) The role of the nominal group in small group communication. In (eds R. C.Huseman, D. M.Logue and D. L.Freshley) Readings in Interpersonal and Organizational Communication 2nd edn Hollbrook, Boston.
McGraw K. & Seale M. (1987) Structured knowledge acquisition for avionics systems. NAECON Proceedings, vol. 4, pp. 1340–1347. (May, 1987), Dayton, Ohio.
McGraw, K. & Seale, M. (1987b) Multiple expert knowledge acquisition methodology. Presented at the Third Australian Conference on Expert Systems (May, 1987), Sydney, Australia.
Mittal, S. & Dym. C. (1985) Knowledge acquisition from multiple experts. AI Magazine. Summer, 32–36.
Osborn, A. (1953) Applied Imagination: Principles and Procedures of Creative Thinking Scribner's, New York.
Ross, R. (1977) Speech Communication, Prentice-Hall, Englewood Cliffs, NJ, USA.
Sattler, W. & Miller, N. (1968) Discussion and Conference, Prentice-Hall, Englewood Cliffs, NJ, USA.
Shaw, M. E. (1932) A Comparison of individuals and small groups in the rational solution of complex problems. American Journal of Psychology, 44, 491–504.
Shaw, M. E. (1976) Group Dynamics: The Psychology of Small Group Behavior McGraw-Hill, New York.
Slater, P. (1958) Contrasting correlates of group size. Sociometry, 25, 129–139.
Steiner, I. (1972) Group Process and Productivity. Academic Press, New York.
Author information
Authors and Affiliations
Additional information
Dr K. McGraw currently heads Cognitive Technologies, a consulting firm in Alexandria, VA. She is on assignment with Falcon Microsystems at 1801 McCormick Dr., Landover, MD 20785.
Rights and permissions
About this article
Cite this article
McGraw, K.L., Seale, M.R. Knowledge elicitation with multiple experts: considerations and techniques. Artif Intell Rev 2, 31–44 (1988). https://doi.org/10.1007/BF00139624
Issue Date:
DOI: https://doi.org/10.1007/BF00139624