ABSTRACT
We report on a method for utilising corpora collected in natural settings. It is based on distilling (re-writing) natural dialogues to elicit the type of dialogue that would occur if one the dialogue participants was a computer instead of a human. The method is a complement to other means such as Wizard of Oz-studies and un-distilled natural dialogues. We present the distilling method and guidelines for distillation. We also illustrate how the method affects a corpus of dialogues and discuss the pros and cons of three approaches in different phases of dialogue systems development.
- Lars Ahrenberg, Nils Dahlbäck, Arne Jönsson, and ÅRke Thurée. 1996. Customizing interaction for natural language interfaces. Linkööping Electronic articles in Computer and Information Science, also in Notes from Workshop on Pragmatics in Dialogue, The XIV:th Scandinavian Conference of Linguistics and the VIII.th Conference of Nordic and General Linguistics, Göteborg, Sweden, 1993, 1(1), October, 1. http://www.ep.liu.se/ea/cis/1996/001/.Google Scholar
- Sue Atkins, Jeremy Clear, and Nicholas Ostler. 1992. Corpus design criteria. Literary and Linguistic Computing, 7(1):1--16.Google ScholarCross Ref
- Douglas Biber. 1993. Representativeness in corpus design. Literary and Linguistic Computing, 8(4):244--257.Google ScholarCross Ref
- Jean Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2):249--254. Google ScholarDigital Library
- Steve Crowdy. 1993. Spoken corpus design. Literary and Linguistic Computing, 8(4):259--265.Google ScholarCross Ref
- Nils Dahlbäck and Arne Jönsson. 1999. Knowledge sources in spoken dialogue systems. In Proceedings of Eurospeech'99, Budapest, Hungary.Google Scholar
- Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1998. Wizard of oz studies - why and how. In Mark Maybury & Wolfgang Wahlster, editor, Readings in Intelligent User Interfaces. Morgan Kaufmann. Google ScholarDigital Library
- Nils Dahlbäck, Annika Flycht-Eriksson, Arne Jönsson, and Pernilla Qvarfordt. 1999. An architecture for multi-modal natural dialogue systems. In Proceedings of ESCA Tutorial and Research Workshop (ETRW) on Interactive Dialogue in Multi-Modal Systems, Germany.Google Scholar
- Nils Dahlbäck. 1991. Representations of Discourse, Cognitive and Computational Aspects. Ph.D. thesis, Linköping University.Google Scholar
- Maxine Eskenazi, Alexander Rudnicki, Karin Gregory, Paul Constantinides, Robert Brennan, Christina Bennett, and Jwan Allen. 1999. Data collection and processing in the carnegie mellon communicator. In Proceedings of Eurospeech'99, Budapest, Hungary.Google Scholar
- Annika Flycht-Eriksson and Arne Jönsson. 1998. A spoken dialogue system utilizing spatial information. In Proceedings of ICSLP'98, Sydney, Australia.Google Scholar
- Annika Flycht-Eriksson. 1999. A survey of knowledge sources in dialogue systems. In Proceedings of IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, August, Stockholm.Google Scholar
- Roger Garside, Geoffrey Leech, and Anthony McEnery. 1997. Corpus Annotation. Longman.Google Scholar
- Arne Jönsson and Nils Dahlbäck. 1988. Talking to a computer is not like talking to your best friend. In Proceedings of the First Scandinavian Conference on Artificial Interlligence, Troms&oS.Google Scholar
- Arne Jösson. 1996. Natural language generation without intentions. In Proceedings of ECAI'96 Workshop Gaps and Bridges: New Directions in Planning and Natural Language Generation, pages 102--104.Google Scholar
- Pernilla Qvarfordt and Arne Jönsson. 1998. Effects of using speech in timetable information systems for www. In Proceedings of ICSLP'98, Sydney, Australia.Google Scholar
- Pernilla Qvarfordt. 1998. Usability of multimodal timetables: Effects of different levels of domain knowledge on usability. Master's thesis, Linköping University.Google Scholar
- Karen Sparck Jones and Julia R. Galliers. 1996. Evaluating Natural Language Processing Systems. Springer Verlag.Google Scholar
- Marilyn A. Walker, Diane J. Litman, Candace A. Kamm, and Alicia Abella. 1998. Paradise: A framework for evaluating spoken dialogue agents. In Mark Maybury & Wolfgang Wahlster, editor, Readings in Intelligent User Interfaces. Morgan Kaufmann. Google ScholarDigital Library
- Distilling dialogues: a method using natural dialogue corpora for dialogue systems development
Recommendations
(Semi-)Automatic Analysis of Dialogues
ICAART 2014: Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1We study human-human dialogues and human-computer dialogues with the aim to determine which dialogue acts and communicative strategies do the participants of interaction use, and which structural parts does a dialogue include. In order to simplify the ...
Acoustic-Prosodic Entrainment and Rapport in Collaborative Learning Dialogues
MLA '14: Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand ChallengeIn spoken dialogue analysis, the speech signal is a rich source of information. We explore in this paper how low level features of the speech signal, such as pitch, loudness, and speaking rate, can inform a model of student interaction in collaborative ...
Wizard of Oz experiments and companion dialogues
BCS '10: Proceedings of the 24th BCS Interaction Specialist Group ConferenceNovel speech systems such as the conversational agents being developed by the Companions Project (www.companions-project.org) can be simulated using the Wizard of Oz methodology. In this approach technologies that are not yet ready for testing by people ...
Comments