Alan Dix
Masitah Ghazali
Skip Abstract Section
Abstract
Abstract
This paper explores the formal specification of the physical behaviour of devices ‘unplugged’ from their digital effects. By doing this we seek to better understand the nature of physical interaction and the way this can be exploited to improve the design of hybrid devices with both physical and digital features. We use modified state transition networks of the physical behaviour, which we call physiograms, and link these to parallel diagrams of the digital state. These are used to describe a number of features of physical interaction exposed by previous work and relevant properties expressed using a formal semantics of the diagrams. As well as being an analytic tool, the physigrams have been used in a case study where product designers used and adapted them as part of the design process.
- Ans92 The device model of interactionSIGGRAPH Comput Graph199216310711410.1145/965145.801269Google Scholar
Digital Library
- AvH02 Avrahami D, Hudson S (2002) Forming interactivity: a tool for rapid prototyping of physical interactive products. In: Proc. of the 4th Conf. on Designing interactive Systems: Processes, Practices, Methods, and Techniques (DIS ’02). ACM, New York, pp 141–146. http://doi.acm.org/10.1145/778712.778735Google Scholar
- BSK03 Benford S, Schnadelbach H, Koleva B, Gaver B, Schmidt A, Boucher A, Steed A, Anastasi R, Greenhalgh C, Rodden T, Gellersen H (2003) Sensible, sensable and desirable: a framework for designing physical interfaces, Technical Report Equator-03-003, Equator, 2003. http://www.equator.ac.uk/Google Scholar
- BoV90 Designing the whole-product user interfaceThe art of computer interface design1990ReadingAddison-Wesley5763Google Scholar
- Bux86 There’s more to interaction than meets the eye: some issues in manual inputUser centered system design: new perspectives on human–computer interaction1986HillsdaleLawrence Erlbaum Associates319337Google ScholarDigital Library
- Bux90 Buxton W (1990) A three-state model of graphical input. In: Proc. of human–computer interaction—INTERACT ’90. Elsevier, Amsterdam, pp 449–456Google Scholar
- CMR90 Card S, Mackinlay J, Robertson G (1990) The design space of input devices. In: Proc. of CHI’90. ACM Press, New York, pp 117–124Google Scholar
- CMR91 A morphological analysis of the design space of input devicesACM Trans Inf Syst1991929912210.1145/123078.128726Google ScholarDigital Library
- Car94 Carr D (1994) Specification of interface interaction objects. In: Proc. of CHI ’94. ACM, New York, pp 372–378Google Scholar
- CoN06 Coutrix C, Nigay L (2006) Mixed reality: a model of mixed interaction. In: Proc. of AVI’06. ACM Press, New York, pp 43–50Google Scholar
- CoN08 Coutrix C, Nigay L (2008) Balancing physical and digital properties in mixed objects. In: Proc. of AVI’08, the Working Conf. on Advanced Visual interfaces. ACM Press, New York, pp 305–308Google Scholar
- CuR07 An approach to formal verification of human-computer interactionFormal Aspects Comput20071945135501129.6850110.1007/s00165-007-0035-6Google ScholarDigital Library
- Deg04 Taming HAL: designing interfaces beyond 20012004New YorkPalgrave MacmillanGoogle Scholar
- DiR85 Abstract models of interactive systems. People and computers: designing the interface1985CambridgeCambridge University Press1322Google Scholar
- Dix91 Dix A (1991) Formal methods for interactive systems. Academic Press, New York. http://www.hiraeth.com/books/formal/Google Scholar
- Dix91b Dix A (1991) Status and events: static and dynamic properties of interactive systems. In: Proc. of the Eurographics Seminar: Formal Methods in Computer Graphics. http://www.hcibook.com/alan/papers/euro91/Google Scholar
- DiA96 Dix A, Abowd G (1996) Modelling status and event behaviour of interactive systems. Softw Eng J 11(6):334–346 (1996). http://www.hcibook.com/alan/papers/SEJ96-s+e/Google Scholar
- DiA96b Delays and temporal incoherence due to the mediated status–status mappingsSIGCHI Bull1996282474910.1145/226650.226667Google ScholarDigital Library
- Dix03 Dix A (2003) Getting physical, keynote at: OZCHI 2003, Brisbane, Australia. http://www.hcibook.com/alan/talks/ozchi2003-keynote/Google Scholar
- DFA04 Dix A, Finlay J, Abowd G, Beale R (2004) Human–computer interaction, 3rd edn. Prentice Hall, Englewood Cliffs. http://www.hcibook.com/e3/Google Scholar
- Dix07 Dix A (2007) Designing for appropriation. In: Procedings of BCS HCI 2007, People and Computers XXI, vol 2, BCS eWiC. http://www.bcs.org/server.php?show=ConWebDoc.13347Google Scholar
- DGR07 Dix A, Ghazali M, Ramduny-Ellis D (2007) Modelling devices for natural interaction. In: Proc. of Second Intnl. Workshop on Formal Methods for Interactive Systems, FMIS2007, ENTCS. Elsevier, AmsterdamGoogle Scholar
- DLF07 Dix A, Leite J, Friday A (2008) XSED—XML-based description of status–event components and systems. In: Proc. of Engineering Interactive Systems 2007 (EIS 2007). Lecture notes in computer science, vol 4940. Springer, BerlinGoogle Scholar
- DSG02 Dubois E, Silva P, Gray P (2002) Notational support for the design of augmented reality systems. In: Proc. of the 9th International Workshop on interactive Systems. Design, Specification, and Verification, DSVIS2002. Lecture notes in computer science, vol 2545. Springer, Berlin, pp 74–88Google Scholar
- DuG07a Dubois E, Gray P (2008) A design-oriented information-flow refinement of the ASUR interaction model. In: Engineering interactive systems (incorporating EHCI, HCSE, DSV-IS). Lecture notes in computer science, vol 4940. Springer, BerlinGoogle Scholar
- DGR07b Dubois E, Gray P, Ramsay A (2007) A model-based approach to describing and reasoning about the physicality of interaction. In: Proc. of Physicality 2007. UWIC Press, Cardiff, pp 77–82Google Scholar
- E06 Eslambolchilar P (2006) Making sense of interaction using a model-based approach. Ph D thesis, Hamilton Institute, National University of Ireland, NUIM, IrelandGoogle Scholar
- EvG06 Evans M, Gill S (2006) Rapid development of information appliances. In: Proc. of International Design Conf. Design 2006, (Croatia, 15–18 May 2006)Google Scholar
- Gav91 Gaver W (1991) Technology affordances. In: Proc. of CHI ’91. ACM Press, New York, pp 79–84Google Scholar
- GhD03 Ghazali M, Dix A (2003) Aladdin’s lamp: understanding new from old. In: Proc. of 1st UK-UbiNet Workshop, Imperial College London. http://www.hcibook.com/alan/papers/ubinet-2003/Google Scholar
- GhD05 Ghazali M, Dix A (2005) Visceral interaction. In: Proc. of the 10th British HCI Conf., vol 2, pp 68–72. http://www.hcibook.com/alan/papers/visceral-2005/Google Scholar
- GhD06 Ghazali M, Dix A (2006) Natural inverse: physicality, interaction & meaning. In: Let’s Get Physical: Tangible Interaction and Rapid Prototyping in, for, and about Design Workshop at 2nd International Conf. on Design Computing & Cognition 2006Google Scholar
- Gib86 The ecological approach to visual perception1986USAHoughton MifflinGoogle Scholar
- GLH05 Gill S, Loudon G, Hewett B, Barham G (2005) How to design and prototype an information appliance in 24 hours—integrating product & interface design processes. In: Proc. of the 6th International Conf. on Computer Aided Industrial Design and Concept Design, University of Delft, The NetherlandsGoogle Scholar
- GrP96 Usability analysis of visual programming environments: a ‘cognitive dimensions’ frameworkJ Vis Languages Comput1996713117410.1006/jvlc.1996.0009Google ScholarCross Ref
- GrF01 Greenberg S, Fitchett C (2001) Phidgets: easy development of physical interfaces through physical widgets. In: Proc. of the 14th Annual ACM Symposium on User interface Software and Technology (UIST ’01), pp 209–218. http://doi.acm.org/10.1145/502348.502388Google Scholar
- Har87 Statecharts: a visual formalism for complex systemsSci Comput Program1987832312740637.6801010.1016/0167-6423(87)90035-9896004Google ScholarDigital Library
- HKC07 Harrison M, Kray C, Campos J (2007/2008) Exploring an option space to engineer a ubiquitous computing system. In: 2nd International Workshop on Formal Methods for Interactive Systems (FMIS 2007), Electronic Notes in Theorectical Computer Science, vol 208. Elsevier, Amsterdam, pp 41–55Google Scholar
- HKB05 Hartman B, Klemmer S, Bernstein M, Mehta N (2005) d.tools: Visually Prototyping Physical UIs through Statecharts. In: Extended Abstracts of UIST 2005. ACM, New YorkGoogle Scholar
- Har03 Cognitive, physical, sensory, and functional affordances in interaction designBehav Inform Technol200322531533810.1080/01449290310001592587Google ScholarCross Ref
- Ish08 Tangible user interfacesThe human–computer interaction handbook fundamentals, evolving technologies, and emerging applications, Chapter 2420082LondonLaurence Earlbaum469487Google Scholar
- JDM99 A software model and specification language for non-WIMP user interfacesACM Trans Comput Hum Interact19996114610.1145/310641.310642Google ScholarDigital Library
- Joh96 Johnson C (1996) The evaluation of user interface design notations. In: Proc. of Design, Specification and Verification of Interactive Systems ’96. Springer, Berlin, pp 188–206. http://www.dcs.gla.ac.uk/~johnson/papers/chris_jarle/Google Scholar
- LaM95 Landay J, Myers B (1995) Interactive sketching for the early stages of user interface design. In: Proc. of CHI’95. ACM Press/Addison-Wesley, New York, pp 43–50. http://doi.acm.org/10.1145/223904.223910Google Scholar
- LoH02 Loer K, Harrison M (2002) Towards usable and relevant model checking techniques for the analysis of dependable interactive systems. In: Proc. 17th International Conf. on Automated Software Engineering. IEEE Computer Society, New York, pp 223–226Google Scholar
- MDS99 Massink M, Duke D, Smith S (1999) Towards hybrid interface specification for virtual environments. In: DSV-IS 1999 Design, Specification and Verification of Interactive Systems. Springer, Berlin, pp 30–51Google Scholar
- Mil88 Milner N (1988) A review of human performance and preferences with different input devices to computer systems. In: Proc. of HCI88, People and Computers IV. Cambridge University Press, Cambridge, pp 341–362Google Scholar
- MDB96 Moher T, Dirda V, Bastide R, Palanque P (1996) Monolingual, articulated modelling of users, devices and interfaces. In: 3rd EUROGRAPHICS workshop on design, specification and verification of Interactive systems. Springer, Berlin, pp 312–329Google Scholar
- Mon86 Mode errors: a user-centered analysis and some preventative measures using keying-contingent soundInt J Man Mach Stud198624431332710.1016/S0020-7373(86)80049-9Google ScholarDigital Library
- NiM94 Usability inspection methods1994New YorkWileyGoogle ScholarDigital Library
- NCo91 Nigay L, Coutaz J (1991) Building user interfaces: organizing software agents. In: ESPRIT ‘91 Conf., pp 707–719Google Scholar
- NCo95 Nigay L, Coutaz J (1995) A generic platform for addressing the multimodal challenge. In: Proc. of CHI’95. ACM, New York, pp 98–105Google Scholar
- Nor99 Affordance, conventions, and designInteractions199963384310.1145/301153.301168Google ScholarDigital Library
- PaP97 Palanque P, Paterno F (1997) (eds) Formal methods in human–computer interaction. Springer, BerlinGoogle Scholar
- Pa69 Parnas D (1969) On the use of transition diagrams in the design of a user interface for an interactive computer system. In: Proc. of the 1969 24th National Conf.. ACM, New York, pp 379–385Google Scholar
- PaG86 Task–action grammars: a model of mental representation of task languages.Hum Comput Interact1986229313310.1207/s15327051hci0202_1Google ScholarDigital Library
- PfH85 Pfaff G, Hagen P (1985) (eds) Seeheim workshop on user interface management systems. Springer, BerlinGoogle Scholar
- Phi08 Phidgets Inc., 2008. http://www.phidgets.com/Google Scholar
- PSP99 Pierce J, Stearns B, Pausch R (1999) Voodoo dolls: seamless interaction at multiple scales in virtual environments. In: Proc. of the 1999 Symposium on Interactive 3D Graphics, pp 141–145Google Scholar
- RDR05 Artefacts as designed, Artefacts as used: resources for uncovering activity dynamicsCogn Technol Work200572768710.1007/s10111-005-0179-1Google ScholarDigital Library
- Rei81 Formal grammar and human factors design of an interactive graphics systemIEEE Trans Softw Eng SE1981-72229240Google Scholar
- Shn83 Direct manipulation: a step beyond programming languagesIEEE Comput19831685769Google ScholarDigital Library
- Shn84 Response time and display rate in human performance with computersACM Comput Surv198416326528510.1145/2514.2517Google ScholarDigital Library
- Smi06 Smith S (2007) Exploring the specification of haptic interaction. In: Interactive systems: design, specification and verification (DSVIS 2006). Lecture notes in computer science, vol 4323. Springer, Berlin, pp 171–184Google Scholar
- Suf82 Formal specification of a display editorSci Comput Program198211572020479.6803010.1016/0167-6423(82)90014-4Google ScholarCross Ref
- ThH90 Formal methods in human–computer interaction1990CambridgeCambridge University PressGoogle Scholar
- Thi07 Press On: principles of interaction programming2007CambridgeMIT PressGoogle ScholarDigital Library
- Thi07 Thimbleby H (2007) Using the Fitts law with state transition systems to find optimal task timings. In: Pre-Proc. of Second Intnl. Workshop on Formal Methods for Interactive Systems, FMIS2007. http://www.dcs.qmul.ac.uk/research/imc/hum/fmis2007/preproceedings/FMIS2007preproceedings.pdfGoogle Scholar
- UIM92 A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshopSIGCHI Bull1992241323710.1145/142394.142401Google ScholarDigital Library
- UIJ05 Token+constraint systems for tangible interaction with digital informationACM Trans Comput Hum Interact20051218111810.1145/1057237.1057242Google ScholarDigital Library
- WDO04 Wensveen S, Djajadiningrat J, Overbeeke C (2004) Interaction frogger: a design framework to couple action and function. In: Proc. of the DIS’04. ACM, New York, pp 177–184Google Scholar
- WiH00 Verifying the behaviour of virtual world objectsProc. of DSV-IS’20002001BerlinSpringer6577Google Scholar
- Wüt99 Wüthrich C (1999) An analysis and model of 3D interaction methods and devices for virtual reality. In: Proc. of DSV-IS’99. Springer, Berlin, pp 18–29Google Scholar
- YGS89 Young R, Green T, Simon T (1989) Programmable user models for predictive evaluation of interface design. In: Proc. of CHI’89: Human Factors in Computing Systems. ACM Press, New YorkGoogle Scholar
Index Terms
- Physigrams: modelling devices for natural interaction
Index terms have been assigned to the content through auto-classification.
Recommendations
Modelling Devices for Natural Interaction
We do not interact with systems without first performing some physical action on a physical device. This paper shows how formal notations and formal models can be developed to account for the relationship between the physical devices that we actually ...
Natural interaction on tabletops
We present two different Computer Vision based systems that enable multiple users to concurrently manipulate graphic objects presented over tabletop displays. The two solutions have different hardware layouts and use two different algorithms for gesture ...
A physical approach to tangible interaction design
TEI '07: Proceedings of the 1st international conference on Tangible and embedded interactionThe field of tangible interaction is growing in rich and diverse directions calling for new forms of understanding. In this paper I will present a view on tangible interaction that has a strong focus on movement and interaction qualities. I will ...
Comments