Nicholas Davis
Chih-PIn Hsiao
ABSTRACT
This paper reports on the design and evaluation of a co-creative drawing partner called the Drawing Apprentice, which was designed to improvise and collaborate on abstract sketches with users in real time. The system qualifies as a new genre of creative technologies termed "casual creators" that are meant to creatively engage users and provide enjoyable creative experiences rather than necessarily helping users make a higher quality creative product. We introduce the conceptual framework of participatory sense-making and describe how it can help model and understand open-ended collaboration. We report the results of a user study comparing human-human collaboration to human-computer collaboration using the Drawing Apprentice system. Based on insights from the user study, we present a set of design recommendations for co-creative agents.
Supplemental Material
- Baylor, A. L. Promoting motivation with virtual agents and avatars: role of visual presence and appearance. Philosophical Transactions of the Royal Society of London B: Biological Sciences 364, (2009) 1535: 3559--3565.Google Scholar
Cross Ref
- Biles, A. J. GenJam: A genetic algorithm for generating jazz solos. Proceedings of the International Computer Music Conference, Citeseer, (1994), 131--131.Google Scholar
- Boden, M. A. The Creative Mind: Myths and Mechanisms. Weidenfeld & Nicolson, London. 1990. Google ScholarDigital Library
- Charman, T., Swettenham, J., Baron-Cohen, S., Cox, A., Baird, G. and Drew, A. Infants with autism: an investigation of empathy, pretend play, joint attention, and imitation. Developmental psychology 33, 5 (1997), 781.Google Scholar
- Colton, S., Wiggins, G. A. Computational creativity: The final frontier? ECAI, (2012) 21--26.Google Scholar
- Compton, K. and Mateas, M. Casual Creators. Proceedings of the Sixth International Conference on Computational Creativity June, 228. 2015.Google Scholar
- Davis, N., Comerford, M., Jacob, M. Hsiao, C.-P. and Magerko, B. An Enactive Characterization of Pretend Play. Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition, (2015), 275--284. Google ScholarDigital Library
- Davis, N., Do, E. Y.-L. Gupta, P. and Gupta, S. Computing harmony with PerLogicArt: perceptual logic inspired collaborative art. Proceedings of the 8th ACM conference on Creativity and cognition, (2011) 185--194. Google ScholarDigital Library
- Davis, N., Hsiao, C.-P., Popova, Y. and Magerko, B. An Enactive Model of Creativity for Computational Collaboration and Co-creation. In Creativity in the Digital Age. Springer, (2015), 109--133.Google ScholarCross Ref
- Davis, N., Hsiao, C.-P., Singh, K. Y., Li, L, Moningi, S. and Magerko, B. Drawing Apprentice: An Enactive Co-Creative Agent for Artistic Collaboration. Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition, (2015), 185--186. Google ScholarDigital Library
- Dixon, D., Prasad, M. and Hammond, T. iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. Proceedings of the 28th international conference on Human factors in computing systems, (2010), 897--906. Google ScholarDigital Library
- Edmonds, E. and Candy, L. Computer support for creativity. International Journal of HumanComputer Studies 63, ( 2005), 4--5: Google ScholarDigital Library
- Fantasia, V., De Jaegher, H. and Fasulo, A. We can work it out: an enactive look at cooperation. Frontiers in psychology 5. 2014.Google Scholar
- Flagg, M. and Rehg, J. M. Projector-guided painting. Proceedings of the 19th annual ACM symposium on User interface software and technology, ACM Press, (2006), 235--244. Google ScholarDigital Library
- Fuchs, T. and De Jaegher, H. Enactive intersubjectivity: Participatory sense-making and mutual incorporation. Phenomenology and the Cognitive Sciences 8, 4 (2009), 465--486.Google ScholarCross Ref
- Gulz, A. and Haake, M. Design of animated pedagogical agents--A look at their look. International Journal of Human-Computer Studies 64, 4 (2006), 322--339. Google ScholarDigital Library
- Hodhod, R., Piplica, A. and Magerko, B. A formal model of shared mental models for computational improvisational agents. Proceedings of the 12th Annual Conference on Intelligent Virtual Agents. 2012. Google ScholarDigital Library
- Hodhod, R., Magerko, B. and Gawish, M. Pharaoh: Context-Based Structural Retrieval of Cognitive Scripts. International Journal of Information Retrieval Research (IJIRR), 2, 3 (2012), 58--71. Google ScholarDigital Library
- Hodhod, R. and Magerko, B. Pharaoh: Conceptual Blending of Cognitive Scripts for Computationally Creative Agents. The Twenty-Seventh International Flairs Conference. 2014.Google Scholar
- Hodhod, R. and Magerko, B. Closing the Cognitive Gap between Humans and Interactive Narrative Agents Using Shared Mental Models. 21st Annual Intelligent User Interfaces Conference. 2016. Google ScholarDigital Library
- Hoffman, G. and Weinberg, G. Shimon: an interactive improvisational robotic marimba player. CHI'10 Extended Abstracts on Human Factors in Computing Systems, (2010), 3097--3102. Google ScholarDigital Library
- Jacob, M., Coisne, G., Gupta, A, Sysoev, I., Gav Verma, G., and Magerko, B. Viewpoints AI. AIIDE. 2013.Google Scholar
- Jacob, M., Zook, A. and Magerko, B. Viewpoints AI: Procedurally Representing and Reasoning about Gestures. Proceedings of DiGRA. 2013.Google Scholar
- De Jaegher, H. and Di Paolo, E. Participatory sensemaking. Phenomenology and the cognitive sciences, 6, 4 (2007), 485--507.Google Scholar
- Lee, Y. J., Zitnick, C. L. and Cohen, M. F. ShadowDraw: real-time user guidance for freehand drawing. ACM Transactions on Graphics (TOG), 27. 2011. Google ScholarDigital Library
- Lubart, T. How can computers be partners in the creative process: Classification and commentary on the Special Issue. International Journal of HumanComputer Studies 63, 4--5 (2005), 365--369. Google ScholarDigital Library
- Magerko, B., Dohogne, P and DeLeon, C. Employing Fuzzy Concept for Digital Improvisational Theatre. AIIDE. 2011.Google Scholar
- O'Neill, B., Piplica, A., Fuller, D. and Magerko, B. A Knowledge-Based Framework for the Collaborative Improvisation of Scene Introductions. In Interactive Storytelling SE - 10, Mei Si, David Thue, Elisabeth André, JamesC. Lester, Joshua Tanenbaum and Veronica Zammitto (eds.). Springer Berlin Heidelberg, (2011), 85--96. Google ScholarDigital Library
- Piplica, A., DeLeon, C. and Magerko, B. Full-body gesture interaction with improvisational narrative agents. Intelligent Virtual Agents, (2012), 514--516. Google ScholarDigital Library
- Sawyer, R. K. and DeZutter, S. Distributed creativity: How collective creations emerge from collaboration. Psychology of Aesthetics, Creativity, and the Arts 3, 2 (2009), 81.Google Scholar
- Schertz, H. H. and Odom, S. L. Promoting joint attention in toddlers with autism: A parent-mediated developmental model. Journal of autism and developmental disorders 37, 8 (2007), 1562--1575.Google Scholar
- Schneiderman, B. Accelerating Discovery and Innovation. Communications of the ACM 50, 12. 2007. Google ScholarDigital Library
- Shneiderman, B., Fischer, G., Czerwinski, M. et al. Creativity Support Tools: Report From a U.S. National Science Foundation Sponsored Workshop. International Journal of Human-Computer Interaction, 20, 2 (2006), 61--77.Google ScholarCross Ref
- Stewart, J. R., Gapenne, O. and Di Paolo, E. Enaction: Toward a new paradigm for cognitive science. MIT Press. 2010.Google Scholar
- Voigt, M., Niehaves, B. and Becker, J. Towards a Unified Design Theory for Creativity Support Systems. GroupSystems (2011), 152--173. Google ScholarDigital Library
- Wardrip-Fruin, N. Expressive Processing: Digital fictions, computer games, and software studies. MIT press. 2009. Google ScholarDigital Library
- Weizenbaum, J. ELIZA--a computer program for the study of natural language communication between man and machine. Communications of the ACM 9, (1966), 36--45. Google ScholarDigital Library
- Wiggins, G. A. Searching for computational creativity. New Generation Computing 24, 3, (2006), 209--222.Google ScholarCross Ref
- Wiggins, G. A. A preliminary framework for description, analysis and comparison of creative systems. Knowledge-Based Systems 19, 7 (2006), 449--458. Google ScholarDigital Library
Index Terms
- Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent
Recommendations
Drawing Apprentice: An Enactive Co-Creative Agent for Artistic Collaboration
C&C '15: Proceedings of the 2015 ACM SIGCHI Conference on Creativity and CognitionThis paper describes a co-creative web-based drawing application called the Drawing Apprentice. This system collaborates with users in real time abstract drawing. We describe the theory, interaction design, and user experience of the Drawing Apprentice ...
Digital tools in collaborative creative work
NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer InteractionThe aim of the workshop is to examine and discuss the role and functions of digital tools in collaborative creative work. While advancements in Human-Computer Interaction (HCI) research offer considerable potential for supporting creative work practices,...
An Enactive Approach to Facilitate Interactive Machine Learning for Co-Creative Agents
C&C '15: Proceedings of the 2015 ACM SIGCHI Conference on Creativity and CognitionThis paper introduces a novel approach to developing co-creative agents that collaborate in real time creative contexts, such as art and pretend play. Our approach builds upon recent work in computational creativity called interactive machine learning (...
Comments