Skip to main content
SpringerLink
Log in

Which events can cause iteration in instructional design? An empirical study of the design process

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

Instructional design is not a linear process: designers have to weigh the advantages and disadvantages of alternative solutions, taking into account different kinds of conflicting and changing constraints. To make sure that they eventually choose the most optimal one, they have to keep on collecting information, reconsidering continuously whether their own decisions are still justified in the light of the latest insights. We have studied the role of iteration during instructional design. For our research, we have used an ISD-based method for the specification of training simulators. During our empirical evaluation study, we introduced five events that are likely to cause iteration. The results show that the quality of the designs is not directly related to the amount of iteration. We conclude that there are different kinds of iteration, triggered by different kinds of actions and events. We propose a list of triggers for iteration some of which originate from outside (new information, new opinions/arguments and acquisition procedures); others are caused by, or evolve from interaction with the design process itself (discovery of missing input, need to repair errors, new insights based on work later on in the design process, and new ideas of the designers).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • J. Akker Particlevan den (1999) Principles and methods of development research J. Akker Particlevan den R. Branch K.L. Gustafson N. Nieveen T. Plomp (Eds) Design approaches and tools in education and training Kluwer Academic Dordrecht, the Netherlands 1–14

    Google Scholar 

  • S.M. Alessi S.R. Trollip (2001) Multimedia for learning: Methods and development Allyn & Bacon Needham Heights, MA

    Google Scholar 

  • D.H. Andrews L.A. Goodson (1980) ArticleTitleA comparative analysis of models of instructional design Journal of Instructional Development 3 2–16 Occurrence Handle10.1007/BF02904348

    Article  Google Scholar 

  • M. Berlo Particlevan (2002) Experimental validation of instructional design guidelines supporting the analysis of team tasks TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • Blessing, L.T.M. (1994). A Process-Based Approach to Computer-Supported Engineering Design. Doctoral dissertation, University of Twente, Enschede, the Netherlands

  • K. Bosch Particlevan den Y.F. Barnard A.S. Helsdingen (1999) Taak- en trainingsanalyse beeldanalist SPERWER (Task and Training Analysis Image Interpreter SPERWER) TNO Human Factors Soesterberg, the Netherlands (in Dutch)

    Google Scholar 

  • D. Braha O. Maimon (1997) ArticleTitleThe design process: Properties, paradigms, and structure IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans 27 IssueID2 146–166 Occurrence Handle10.1109/3468.554679

    Article  Google Scholar 

  • InstitutionalAuthorNameDE 2.0. (1997) Designer’s Edge, Version 2.0 (Computer software) Allen Communication Salt Lake City, Utah

    Google Scholar 

  • Dehncke, R.W. & Brooks, D.J. (1998). Program management of a complex simulation program: Lessons learned from STOW. In Proceedings of the 20th lnterservice/industry Training, Simulation and Education Conference, pp. 33–42. Arlington, VA: National Training Systems Association (NTSA)

  • Dijkstra, S. (2001). Epistemology, psychology of learning and instructional design (Special issue). Instructional Science 29(4–5)

    Google Scholar 

  • E.W. Farmer P.G.A.M. Jorna J.B.J. Riemersma J.C.G.M. Rooij Particlevan J. Moraal (1999) Handbook of simulator-based training Ashgate London

    Google Scholar 

  • L. Gilbert (1999) ArticleTitleSome valuable lessons from the teaching and learning technology programme in the UK Journal of Interactive Learning Research 10 IssueID1 67–85

    Google Scholar 

  • V. Goel P. Pirolli (1989) ArticleTitleMotivating the notion of generic design within information-processing theory: The design problem space AI Magazine 10 IssueID1 19–36

    Google Scholar 

  • V. Goel P. Pirolli (1992) ArticleTitleThe structure of design problem spaces Cognitive Science 16 IssueID3 395–429 Occurrence Handle10.1016/0364-0213(92)90038-V

    Article  Google Scholar 

  • J.G. Greeno M.K. Korpi D.N. Jackson SuffixIII V.S. Michalchik (1990) Processes and knowledge in designing instruction Stanford University Stanford, CA

    Google Scholar 

  • K.L. Gustafson (1991) Survey of instructional development models EditionNumber(2nd edn.) Syracuse University Syracuse, NY

    Google Scholar 

  • H.M. Halff (1993) Prospects for automating instructional design J.M. Spector M.C. Polson D.J. Muraida (Eds) Automating instructional design Educational Technology Publications Englewood Cliffs, NJ 67–132

    Google Scholar 

  • Hamel, R. (1990). Over het denken van de architect: Een cognitief psychologische beschrijving van het ontwerpproces bij architecten (On Designing by Architects: A Cognitive Psychological Description of the Architectural Design Process). Doctoral dissertation, University of Amsterdam, the Netherlands (in Dutch)

  • C. Holcomb J.F. Wedman M. Tessmer (1996) ArticleTitleID activities and project success: Perceptions of practitioners Performance Improvement Quarterly 9 IssueID1 49–61 Occurrence Handle10.1111/j.1937-8327.1996.tb00711.x

    Article  Google Scholar 

  • A.W.M. Hoogveld F. Paas W.M.G. Jochems J.J.G. Merriënboer Particlevan (2001) ArticleTitleThe effects of a web-based training in an instructional systems design approach on teachers’ instructional design behavior Computers in Human Behavior 17 363–371 Occurrence Handle10.1016/S0747-5632(01)00013-9

    Article  Google Scholar 

  • A.H. Hulst Particlevan der R. Hoog Particlede J. Wielemaker (1999) BOOT: Decision support for the selection of facilities for education and training TNO Physics and Electronic Laboratory The Hague the Netherlands

    Google Scholar 

  • Jong A.J.M. de (1986). Kennis en het oplossen van vakinhoudelijke problemen.: Een voorbeeld uit een natuurkundig domein (Knowledge Based Problem Solving: An Example from a Physics Domain). Doctoral dissertation, Technical University of Eindhoven, the Netherlands (in Dutch)

  • Kearsley, G. (2003). Explorations in learning and instruction: The theory into practice (TIP) database. Retrieved September 20, 2003, from http://tip.psychology.org

  • S.T. Kerr (1983) ArticleTitleInside the black box: Making design decisions for instruction British Journal of Educational Technology 14 IssueID1 45–58

    Google Scholar 

  • Kessels, J.W.M. (1993). Towards Design Standards for Curriculum Consistency in Corporate Education. Doctoral dissertation, University of Twente, Enschede, the Netherlands

  • B. Kincaid (1997) A Dinosaur in Whitehall: The true cost of defence procurement bureaucracy Brassey’s London

    Google Scholar 

  • K. Maistre ParticleLe C. Weston (1996) ArticleTitleThe priorities established among data sources when instructional designers revise written materials Educational Technology Research and Development 44 IssueID1 61–70 Occurrence Handle10.1007/BF02300326

    Article  Google Scholar 

  • J.J.G. Merriënboer Particlevan (1997) Training complex cognitive skills Educational Technology Publications Englewood Cliffs, NJ

    Google Scholar 

  • M.D. Merrill InstitutionalAuthorNameThe ID2 Research Group (1996) ArticleTitleInstructional transaction theory: Instructional design based on knowledge objects Educational Technology 36 IssueID3 30–37

    Google Scholar 

  • C.T.C.W. Mettes A. Pilot H.J. Roossink (1981) ArticleTitleLinking factual and procedural knowledge in solving science problems: A case study in a thermodynamics course Instructional Science 10 333–361 Occurrence Handle10.1007/BF00162732

    Article  Google Scholar 

  • Microsoft NetMeeting, version 2.1. (Computer software) (1997). Microsoft Corporation

  • W.A. Nelson S. Magliaro T.M. Sherman (1988) ArticleTitleThe intellectual content of instructional design Journal of Instructional Development 11 IssueID1 29–35

    Google Scholar 

  • L. Odenthal W. Kuiper J. Voogt S. Terwindt (2000) ArticleTitleBalanceren tussen ruimte en structuur: Lerarenopleiders van de Educatieve Faculteit Amsterdam als curriculumontwikkelaars (Balancing between space and structure: Teacher-trainers of the␣Educational Faculty of Amsterdam as curriculum developers) HRD Thema 1 22–32

    Google Scholar 

  • J. Pena-Shaff W. Martin G. Gay (2001) ArticleTitleAn epistemological framework for analyzing student interactions in computer-mediated communication environments Journal of Interactive Learning Research 12 41–68

    Google Scholar 

  • R.S. Perez J. Fleming-Johnson C.D. Emery (1995) ArticleTitleInstructional design expertise: A cognitive model of design Instructional Science 23 321–349 Occurrence Handle10.1007/BF00896877

    Article  Google Scholar 

  • R.S. Perez E.C. Neiderman (1993) Modelling the expert training developer R.J. Seidel P.R. Chatelier (Eds) Advanced technologies applied to training design Plenum Press New York 261–280

    Google Scholar 

  • J.M. Pieters R. Bergman (1995) ArticleTitleThe empirical basis of designing instruction Performance Improvement Quarterly 8 IssueID3 118–129 Occurrence Handle10.1111/j.1937-8327.1995.tb00691.x

    Article  Google Scholar 

  • Reigeluth, C.M. (1983). Instructional design: What is it and why is it? In C.M. Reigeluth (Ed.), Instructional design theories and models: An overview of their current status (pp. 3–36). Hillsdale, NJ: Erlbaum

  • C.M. Reigeluth (1999) Instructional design theories and models: Vol. 2. A new paradigm of instructional theory Erlbaum Hillsdale, NJ

    Google Scholar 

  • Reigeluth, C.M. & Frick, T.W. (1999). In C.M. Reigeluth, ed., Instructional design theories and models: Vol. 2. A new paradigm of instructional theory, pp. 633–651. Hillsdale, NJ: Erlbaum

  • J.B.J. Riemersma J.C.G.M. Rooij Particlevan J. Just E. Farmer Ph. Paris M. Fuchs R. Reinschlüssel P.G.A.M. Jorna J. Bermejo Muñoz (1994) Reference Framework TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • van Rooij, J.C.G.M. (1997). Onderwijskundige richtlijnen ten behoeve van de specificatie van simulatoreisen (Didactic guidelines for the specification of simulator requirements). Report No. TM-97-A077, TNO Human Factors, Soesterberg, the Netherlands (in Dutch)

  • J.C.G.M. Rooij Particlevan (2002 May) ArticleTitle Digitalisatie van het trainingsveld (Digitalisation in the field of training) Opleiding and Training 2002 IssueID17 4–8

    Google Scholar 

  • Rowland, G. (1991). Problem Solving in Instructional Design. Doctoral dissertation, Indiana University, Indiana

  • G. Rowland (1992) ArticleTitleWhat do instructional designers actually do? An initial investigation of expert practice Performance Improvement Quarterly 5 IssueID2 65–86

    Google Scholar 

  • G. Rowland (1993) ArticleTitleDesigning and instructional design Educational Technology Research and Development 41 IssueID1 79–91 Occurrence Handle10.1007/BF02297094

    Article  Google Scholar 

  • G. Rowland A. Adams (1999) Systems thinking in instructional design J. Akker Particlevan den R. Branch K.L. Gustafson N. Nieveen T. Plomp (Eds) Design approaches and tools in education and training Kluwer Academic Dordrecht, the Netherlands 29–44

    Google Scholar 

  • Ryder, M. (2003). Instructional design models (d.d. 16–9-2003). Retrieved September 20, 2003, from http://carbon.cudenver.edu/~mryder/itc/idmodels.html

  • A. Saroyan (1993) ArticleTitleDifferences in expert practice: A case from formative evaluation Instructional Science 21 451–472 Occurrence Handle10.1007/BF00118558

    Article  Google Scholar 

  • N.M. Seel L.D. Eichenwald N.F.N. Penterman (1995) Automating decision support in instructional system development: The case of delivery systems R.D. Tennyson A.E. Barron (Eds) Automating instructional design: Computer-based development and delivery tools Springer-Verlag Berlin Germany 177–216

    Google Scholar 

  • S.D. Tripp B. Bichelmeyer (1990) ArticleTitleRapid prototyping: An instructional design strategy Educational Technology Research & Development 38 IssueID1 31–44 Occurrence Handle10.1007/BF02298246

    Article  Google Scholar 

  • Verstegen, D.M.L. (2003). Iteration in Instructional Design: An Empirical Study on the Specification of Training Simulators. Doctoral dissertation, Utrecht University, the Netherlands. Can be retrieved from: http://www.library.uu.nl/digiarchief/dip/diss/2004-0130-092005/inhoud.htm

  • D.M.L. Verstegen Y.F. Barnard A. Pilot (2002) Do training simulators support instruction and practice? Results of field visits to 44 simulators TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • D.M.L. Verstegen Y.F. Barnard A. Pilot (2003) Iterative design of training programs: Results of an evaluation study TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • D.M.L. Verstegen Y.F. Barnard A. Pilot (2004) Second evaluation of iterative design of training programs TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • Verstegen, D.M.L. & van der Hulst, A.H. (2000). Standardized development of a needs statement for advanced training means. In Proceedings of the 22th Interservice/Industry Training, Simulation and Education Conference, pp. 1136–1144. Arlington, VA: National Training Systems Association, (NTSA)

  • D.M.L. Verstegen S. Steutel Y.F. Barnard (2000) Support for iteration in training program design TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • D.M.L. Verstegen G.J. Veldhuis J. Staalstra M. Hendriks (2001) Report on the use of training material in scenarios and organisational learning, final feedback RNLAF TNO Human Factors Soesterberg, the Netherlands

    Google Scholar 

  • Visscher-Voerman, I. (1999). Design Approaches in Training and Education: A Reconstructive Study. Doctoral dissertation, University of Twente, Enschede, the Netherlands

  • I. Visscher-Voerman (2000) ArticleTitleOntwerpbenaderingen in opleidingspraktijken (Design Approaches in Training) HRD Thema 1 5–15

    Google Scholar 

  • I. Visscher-Voerman K.L. Gustafson T. Plomp (1999) Educational design and development: An overview of paradigms J. Akker Particlevan den R. Branch K.L. Gustafson N. Nieveen T. Plomp (Eds) Design approaches and tools in education and training Kluwer Academic Dordrecht, the Netherlands 15–28

    Google Scholar 

  • van Wagenberg, M.J.G.M. (1992). Gericht CAD-ondersteund ontwerpen en organiseren (Goaloriented CAD-Supported Designing and Organising). Doctoral dissertation, Delft University of Technology, the Netherlands (in Dutch)

  • J.F. Wedman M. Tessmer (1993) ArticleTitleInstructional designers’ decisions and priorities: A survey of design practice Performance Improvement Quarterly 6 IssueID2 43–57 Occurrence Handle10.1111/j.1937-8327.1993.tb00583.x

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Rotterdam Institute for Social Policy Research (RISBO), Erasmus University Rotterdam, P.O. Box 1738, 3800 DR, Rotterdam, The Netherlands

    D. M. L. Verstegen

  2. EURISCO International, Toulouse, France

    Y. F. Barnard

  3. IVLOS, Utrecht University, Utrecht, The Netherlands

    A. Pilot

Authors
  1. D. M. L. Verstegen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. F. Barnard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Pilot
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to D. M. L. Verstegen.

Additional information

in final form: 4 August 2005

Rights and permissions

Reprints and permissions

About this article

Cite this article

Verstegen, D.M.L., Barnard, Y.F. & Pilot, A. Which events can cause iteration in instructional design? An empirical study of the design process. Instr Sci 34, 481–517 (2006). https://doi.org/10.1007/s11251-005-3346-0

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11251-005-3346-0

Keywords

Search

Navigation