Critics: an emerging approach to knowledge-based human-computer interaction

doi:10.1016/S0020-7373(05)80184-1

International Journal of Man-Machine Studies

Volume 35, Issue 5, November 1991, Pages 695-721

https://doi.org/10.1016/S0020-7373(05)80184-1 Get rights and content

We describe the critiquing approach to building knowledge-based interactive systems. Critiquing supports computer users in their problem solving and learning activities. The challenges for the next generation of knowledge-based systems provide a context for the development of this paradigm. We discuss critics from the perspective of overcoming the problems of high-functionality computer systems, of providing a new class of systems to support learning, of extending applications-oriented construction kits to design environments, and of providing an alternative to traditional autonomous expert systems. One of the critiquing systems we have built—JANUS, a critic for architectural design—is used as an example for presenting the key aspects of the critiquing process. We then survey additional critiquing systems developed in our and other research groups. The paper concludes with a discussion of experiences and extensions to the paradigm.

References (56)

LanglotzC.P. et al.
Adapting a consultation system to critique user plans
International Journal of Man-Machine Studies
(1983)
SchmidtC.F. et al.
The plan-recognition problem: an intersection of psychology and artificial intelligence
Artificial Intelligence
(1978)
AaronsonA. et al.
Intelligent help in a one-shot dialog: a protocol study
AndersonJ.R. et al.
The LISP tutor
BYTE
(1985)
AtwoodM.E. et al.
Cooperative learning and cooperative problem solving: the case of Grace
BodkerS. et al.
Computer support for cooperative design
BurtonR.R. et al.
An investigation of computer coaching for informal learning activities
CarrollJ.M. et al.
Interface design issues for advice-giving expert systems
Communications of the ACM
(1987)
CarverN.F. et al.
Focusing in plan recognition

ClanceyW.J.

Qualitative student models

Annual Review of Computing Science

(1986)

CoombsM.J. et al.

Expert systems: an alternative paradigm

International Journal of Man-Machine Studies

(1984)

DewsS.

Developing an ITS in a corporate setting

DraperS.W.

The nature of expertise in UNIX

FickasS. et al.

Critiquing software specifications

IEEE Software

(1988)

FininT.W.

Providing help and advice in task oriented systems

FischerG.

A critic for LISP

FischerG.

Communications requirements for cooperative problem solving systems

The International Journal of Information Systems (Special Issue on Knowledge Engineering)

(1990)

FischerG. et al.

End-user modifiability in design environments

FischerG. et al.

Construction kits and design environments: steps toward human problem-domain communication

Human-Computer Interaction

(1988)

FischerG. et al.

Knowledge-based help systems

FischerG. et al.

Computer-based critics

FischerG. et al.

Design environments for constructive and argumentative design

FischerG. et al.

JANUS: integrating hypertext with a knowledge-based design environment

FischerG. et al.

CRACK: a critiquing approach to cooperative kitchen design

ForbusK.

FriedmanM.P.

WAND AH—a computerized writer's aid

GlaserR. et al.

Voltaville: a discovery environment to explore the laws of DC circuits

Cited by (41)

Articulation of web site design constraints: Effects of the task and designers' expertise
2007, Computers in Human Behavior
Citation Excerpt :
This study has to be replicated with professional designers. Second, a specific expert critiquing system (see, for instance, Fischer, Lemke, Mastaglio, & Morch, 1991) could be developed. This system would evaluate the current designer’s work and suggest her/him user-oriented constraints.
This paper aims at contributing to a better understanding of the cognitive activities of web site designers and, more precisely, their articulation and satisfaction of various design constraints. In this paper, we first present an experiment in which professional and novice designers have to evaluate a web site developed for reflecting usability errors identified in web sites. Then, the results obtained in this evaluation task are compared with results previously obtained in a design task, in which professional and novice designers had to create a web site. Data analyses focused on the number and nature of constraints articulated by designers in these two types of tasks (evaluation vs design). In particular, we distinguished constraints linked with the client of the site and constraints linked with the future web users. The obtained results show effects of both the level of expertise and the task. While designing, all of the designers focused mainly on constraints linked with the client. In contrast, while evaluating the web site, novices focused on constraints linked with the user, whereas professionals shared their attention between these two kinds of constraints (client vs user-oriented constraints). Based on these results, we conclude with ways for supporting designers’ activities.
Web site designs: Influences of designer's expertise and design constraints
2003, International Journal of Human Computer Studies
Citation Excerpt :
Help designers, regardless of their levels of expertise, to consider and implement ergonomic constraints in their sketches. For the first two points, we suggest developing a knowledge-based system that fits the designer's level of expertise (see Fischer et al., 1991). Specifically, the system should provide the following support:
Nowadays, much research examines both the cognitive difficulties encountered by web site users and the development of ergonomic guidelines for designers. However, few studies examine designers’ cognitive functioning while designing web sites. We defend the idea that determining the difficulties web site designers encounter is necessary to better support their design activities, especially in making web sites easier to use. We present an experimental study that demonstrates that the designers’ levels of expertise (novice and professional) as well as the design constraints that clients prescribe influences both the number and the nature of constraints designers articulate and respect in their web site designs. Based on our study findings, we suggest ways to better support web site designers.
Towards understanding and supporting creativity in design: Analogies in a constrained cognitive environment
2000, Knowledge-Based Systems
In order to show that the emergence of new ideas takes place in a “constrained cognitive environment”, we conducted two experimental studies in a creative professional area: non-routine design. The first study is focused on the role of analogical reasoning in creativity and, especially, on the nature of potential “sources” of inspiration, which facilitate the evocation process. The second study aims at understanding on which ground designers of different levels of expertise construct their own constrained cognitive environment. Based on the obtained results, we suggest ways to facilitate creative acts from designers.
Methodology and tools for applying context-specific usability guidelines to interface design
2000, Interacting with Computers
This paper presents a methodology and an associated technology to create context-specific usability guidelines. The objective is to transform usability guidelines into a proactive resource that software developers can employ early and often in the development process. The methodology ensures conformance with established guidelines, but has the flexibility to use design experiences to adapt the guidelines to meet the emergent and diverse requirements of modern user interface design. Case-based and organizational learning technology is used to support the methodology and provide valuable resources for software developers.
FAST: Future technology for today's industry
1999, Computers in Industry
The age of downsizing is upon us. As a result, industrial workers are being asked to become more efficient, productive, and flexible with fewer resources. This paper discusses one way that wearable computers and multimedia electronic performance support systems are being used to meet these challenges. Our laboratory is working on a project we call Factory Automation Support Technology (FAST). FAST utilizes the power of multimedia to improve worker performance throughout the factory. Task-oriented drawings, schematics, sounds, animations, video, procedures, checklists, and expert advice are continuously available from the FAST system. The multimedia electronic performance support system improves job performance while promoting learning as workers do their jobs. Utilizing a novel wearable computer equipped with a head-mounted display, a wireless network link, and voice recognition software, the user is able to retrieve and enter job related information without using his or her hands while roaming throughout the plant. The FAST system provides training and support when, where, and how it is most needed in a completely unrestricted manner. This paper describes this new method of multimedia-enhanced support as well as the results from initial trials.
Embedding critics in decision-making environments to reduce human errors
1998, Knowledge-Based Systems
Managers, by human nature, are not optimal decision-makers. There are several errors that hinder the decision-making process, e.g. cognitive biases, accidents, cultural motivations and missing knowledge. These errors can lead to serious consequences. This paper discusses the four errors and their impact on the decision analysis process. In addition, the paper introduces expert critiquing systems. These collaborative systems can help managers or decision-makers reduce the above-mentioned errors in an automated environment. The critiquing theory is also discussed. Finally, a critiquing example details the application of expert critiquing systems in an automated environment. The example shows how a knowledge-based system was used to reduce judgmental human errors.

View all citing articles on Scopus

View full text

Critics: an emerging approach to knowledge-based human-computer interaction

International Journal of Man-Machine Studies

Artificial Intelligence

Intelligent help in a one-shot dialog: a protocol study

The LISP tutor

BYTE

Cooperative learning and cooperative problem solving: the case of Grace

Computer support for cooperative design

An investigation of computer coaching for informal learning activities

Interface design issues for advice-giving expert systems

Communications of the ACM

Focusing in plan recognition

Qualitative student models

Annual Review of Computing Science

Expert systems: an alternative paradigm

International Journal of Man-Machine Studies

Developing an ITS in a corporate setting

The nature of expertise in UNIX

Critiquing software specifications

IEEE Software

Providing help and advice in task oriented systems

A critic for LISP

Communications requirements for cooperative problem solving systems

The International Journal of Information Systems (Special Issue on Knowledge Engineering)

End-user modifiability in design environments

Construction kits and design environments: steps toward human problem-domain communication

Human-Computer Interaction

Knowledge-based help systems

Computer-based critics

Design environments for constructive and argumentative design

JANUS: integrating hypertext with a knowledge-based design environment

CRACK: a critiquing approach to cooperative kitchen design

WAND AH—a computerized writer's aid

Voltaville: a discovery environment to explore the laws of DC circuits