The effects of representation on idea generation and design fixation: A study comparing sketches and function trees
Section snippets
Background
In the engineering design process, conceptual design is the front-end phase that relies on favorable idea generation. Idea generation can be defined as the process of generating, developing, and communicating ideas, where an idea is understood as a basic element of thought that can either be visual, concrete, or abstract (Jonson, 2005). During the conceptual design stage, engineers consider numerous possible solution concepts and ideas (Pahl & Beitz, 1996) while addressing potential feedback
Experimental overview
This paper presents an experiment designed to assess if, and to what extent, fixation occurs in engineering idea generation based on the representation of the example given. The participants were asked to solve a design problem with an example as an aid. Participants viewed a poor design example in the form of a sketch, function tree, or a combination of both, which are the designated conditions for the experiment. A control condition where participants did not receive an example was also
Experiment
This experiment was designed to assess the effectiveness of function trees on fixation to features of a design. We investigate if an example represented as a function tree reduces fixation compared to the same example represented as a sketch. We have an additional condition that includes both representations, and we check to see if there are any advantages in having a function tree presented with a sketch. Hypothesis 1: Fixation. Function trees will reduce fixation compared to sketch representations. This is
Evaluation metrics
To measure fixation, creativity, and the overall effectiveness of the solutions generated, six metrics were used: quantity of non-redundant ideas, number of repeated example features, percentage of example features used, quality of concepts, novelty of concepts, variety of concepts, and percentage of solutions using a gas engine. Four of these metrics, the quantity (non-redundant), quality, novelty, and variety of ideas are based on definitions proposed by Shah, Kulkarni, and Vargas-Hernandez
Results
Non-parametric Kruskal–Wallis tests were performed on the data in this experiment because the data does not satisfy the normality and homogeneity of variance requirements; therefore, one-way parametric analysis of variance (ANOVA) results would not be reliable. Additionally, pair-wise a-priori comparisons using Mann–Whitney tests were employed, which are equivalent to t-tests for non-parametric data. A summary of these results is given in Table 2.
Discussion
The results from this experiment provide important and interesting results concerning the role of function trees in idea generation. We see from the results in this paper that function trees do not cause fixation. The results also further support that sketch representations cause fixation, which has also been seen in other fixation studies.
The results from the quantity of non-redundant features show that function trees reduce fixation compared with sketches; this supports Hypothesis 1 which
Conclusions and future work
The experiment performed in this study investigated how the representations of an example given during idea generation affect and reflect on design fixation. In the experiment, we explored function tree and sketch representations while using a poor design example. We found that function trees are not fixation inducing, and that combining a sketch with function trees tends to reduce idea fixation, while reinforcing and increasing example feature fixation.
The results from this experiment provide
Limitations
The data for this paper were collected from students in the same course given during two consecutive semesters. The same instructor taught both classes, and the same material was taught during both semester. It is unlikely that this semester split affected the results in anyway. There were no significant differences comparing the results from both semesters with each other (after all the data had been blindly analyzed).
The students participating in the study were not calibrated with a pre-test
Acknowledgements
Partial support for this work was provided by the National Science Foundation Award Nos. CMMI-100095 and CMMI-1322335. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. We are grateful to the anonymous reviewers for providing feedback and advice that greatly strengthened this paper.
References (98)
- et al.
Expertise and the use of visual analogy: implications for design education
Design Studies
(1999) On visual design thinking: the vis kids of architecture
Design Studies
(1994)- et al.
Variances in the impact of visual stimuli on design problem solving performance
Design Studies
(2006) - et al.
Design fixation
Design Studies
(1991) Design ideation: the conceptual sketch in the digital age
Design Studies
(2005)- et al.
Sketching as mental imagery processing
Design Studies
(2001) - et al.
The structure of concurrent cognitive actions: a case study on novice and expert designers
Design Studies
(2002) - et al.
Strategic knowledge acquisition: a case study of learning through prototyping
Knowledge-Based Systems
(1998) - et al.
Mental synthesis and creativity in design: an experimental examination
Design Studies
(2000) - et al.
Why a diagram is (sometimes) worth ten thousand words
Cognitive Science
(1987)
How designers perceive sketches
Design Studies
Refined metrics for measuring ideation effectiveness
Design Studies
Effects of examples on the results of a design activity
Knowledge-Based Systems
Design and other types of fixation
Design Studies
Metrics for measuring ideation effectiveness
Design Studies
Using quantitative functional models to develop product architectures
Design Studies
What do architects and students perceive in their design sketches? A protocol analysis
Design Studies
The importance of drawing in the mechanical design process
Computers & Graphics
How sketching can affect the idea generation process in design group meetings
Design Studies
The effects of physical prototyping and group work on the reduction of design fixation
Design Studies
Speech and sketching for multimodal design
Creativity as an Exact Science: The Theory of the Solution of Inventive Problems
Cognitive changes induced by accounting changes: experimental evidence on the functional fixation hypothesis
Journal of Accounting Research
Modeling cognitive interactions during group brainstorming
Small Group Research
Validation of function pruning rules through similarity at three levels of abstraction
Journal of Mechanical Design
The influence of different pictorial representations during idea generation
The Journal of Creative Behavior
Design fixation on non-verbal stimuli: the influence of simple vs rich pictorial information on design problem solving
The relationship of analogical distance to analogical function and pre-inventive structure: the case of engineering design
Creative Cognition: Analogy and Incubation
Creativity in Design: The Role of Domain Knowledge in Designing
Creativity as a design criterion
Communication Research Journal
Design fixation: a cognitive model
Doing Quantitative Psychological Research: From Design to Report
Jock Brandis makes life better with peanuts
Computer-aided sketching as a tool to promote innovation in the new product development process
Computers in Industry
Cognitive stimulation and problem presentation in idea-generating groups
Group Dynamics: Theory, Research, and Practice
The problem of design problems
Expertise in Design
Cognitive and social comparison processes in brainstorming
Journal of Experimental Social Psychology
On problem-solving
Psychological Monographs
Engineering Design: A Project-Based Introduction
That which is not form: the practical challenges in using functional concepts in design
Artificial Intelligence for Engineering Design, Analysis and Manufacturing
Variations in functional decomposition for an existing product: experimental results
Artificial Intelligence for Engineering Design, Analysis and Manufacturing
Engineering and the Mind's Eye
Amplifying the mind's eye: sketching and visual cognition
Leonardo
Design team convergence: the influence of example solution quality
Journal of Mechanical Design
Sketches of Thought
The dialectics of sketching
Creativity Research Journal
To see eye to eye: the role of visual representations in building shared mental models in design teams
CoDesign
Conceptual Understanding and the Use of Hand-Sketching in Mechanical Engineering Design
Cited by (87)
Searching for ideas from creative Crowds: The role of examples in problem statements
2023, Journal of Business ResearchData-enabled sketch search and retrieval for visual design stimuli generation
2022, Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM