Jonathan Hook
ABSTRACT
We live in a society that is increasingly data rich, with an unprecedented amount of information being captured, stored and analysed about our lives and the people we share them with. We explore the relationship between this new data and emergent forms of interactive video storytelling. In particular we ask: i) how can interactive video storytelling techniques be employed to provide accessible, informative and pleasurable ways for people to engage with data; and ii) how can data be used by the creators of interactive video stories to meet expressive goals and support new forms of experience? We present an analysis of 43 interactive videos that use data in a noteworthy fashion. This analysis reveals a design space comprising key techniques for telling engaging interactive video stories with and about data. To conclude, we discuss challenges relating to the production and consumption of such content and make recommendations for future research.
- Accenture. 2014. The Internet of Things: The Future of Consumer Adoption.Google Scholar
- Fereshteh Amini, Nathalie Henry Riche, Bongshin Lee, Christophe Hurter, and Pourang Irani. 2015. Understanding Data Videos: Looking at Narrative Visualization through the Cinematography Lens. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, 1459--1468. Google ScholarDigital Library
- Swamy Ananthanarayan, Nathan Lapinski, Katie Siek, and Michael Eisenberg. 2014. Towards the crafting of personal health technologies. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). ACM, 587--596. Google ScholarDigital Library
- Mike Armstrong, Matthew Brooks, Anthony Churnside, Michael Evans Frank Melchior, and Matthew Shotton. 2014. Object-based broadcasting - curation, responsiveness and user experience. In Proceedings of the 2014 International Broadcasting Convention (IBC '14). IET, 12.2--12.2.Google Scholar
- Paul Ashton. 2011. The Calling Card Script: A Writer's Toolbox for Screen, Stage and Radio. A & C Black Publishers Ltd.Google Scholar
- Florian Block, Michael Horn, Brenda Caldwell Phillips, Judy Diamond, Margaret Evans, and Chia Shen. 2012. The DeepTree Exhibit: Visualizing the tree of life to facilitate informal learning. IEEE Transactions on Visualization and Computer Graphics, 18, 12, 2789--2798. Google ScholarDigital Library
- Amir Chaudhry, Jon Crowcroft, Heidi Howard, Anil Madhavapeddy, Richard Mortier, Hamed Haddadi, and Derek McAuley. 2015. Personal data: thinking inside the box. In Proceedings of The Fifth Decennial Aarhus Conference on Critical Alternatives (AA '15). Aarhus University Press, 29--32. Google ScholarDigital Library
- Eun Kyoung Choe, Nicole Lee, Bongshin Lee, Wanda Pratt, and Julie Kientz. 2014. Understanding quantified-selfers' practices in collecting and exploring personal data. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, 1143--1152. Google ScholarDigital Library
- Seth Flaxman, Sharad Goel and Justin M. Rao. 2016. Filter Bubbles, Echo Chambers, and Online News Consumption. Public Opinion Quarterly, 80, S1, 298--320.Google ScholarCross Ref
- Mirta Galesic, and Rocio Garcia-Retamero. 2011. Graph literacy: A Cross-Cultural Comparison. Medical Decision Making, 31, 3, 444--457.Google ScholarCross Ref
- Adrian Gradinar, Daniel Burnett, Paul Coulton, Ian Forrester, Matt Watkins, Tom Scutt, and Emma Murphy. 2015. Perceptive Media -- Adaptive Storytelling for Digital Broadcast. In Proceedings of the INTERACT 2015 Conference on Human-Computer Interaction (INTERACT '15). Springer, 586--589.Google ScholarDigital Library
- Alvaro Graves and James Hendler. 2013. Visualization tools for open government data. 2013. In Proceedings of the 14th Annual International Conference on Digital Government Research (dg.o '13). ACM, 136--145. Google ScholarDigital Library
- Harry M. Geduld, and Ronald Gottesman. 1973. An illustrated glossary of film terms. Holt, Rinehart and Winston.Google Scholar
- Jonathan Gray, Lucy Chambers, Liliana Bounegru. 2012. The Data Journalism Handbook: How Journalists Can Use Data to Improve the News. O'Reilly Media.Google Scholar
- David Green, Simon Bowen, Jonathan Hook, and Peter Wright. 2017 . Enabling Polyvocality in Interactive Documentaries through "Structural Participation". In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, 6317--6329. Google ScholarDigital Library
- Michael Gurstein. 2011. Open data: Empowering the empowered or effective data use for everyone? First Monday, 16, 2.Google ScholarCross Ref
- Tiffany Holmes. 2007. Eco-visualization: combining art and technology to reduce energy consumption. In Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition (C&C '07). ACM, 153--162. Google ScholarDigital Library
- Jessica Hullman, and Nick Diakopoulos. 2011. Visualization Rhetoric: Framing Effects in Narrative Visualization. IEEE transactions on Visualization and Computer Graphics, 17, 12, 2231--2240. Google ScholarDigital Library
- Marijn Janssen, Yannis Charalabidis, and Anneke Zuiderwijk. 2012. Benefits, adoption barriers and myths of open data and open government. Information Systems Management, 29, 4.Google ScholarCross Ref
- Maxat Kassen. 2013. A promising phenomenon of open data: A case study of the Chicago open data project. Government Information Quarterly, 30, 4, 508--513.Google ScholarCross Ref
- Robert Kosara and Jock Mackinlay. 2013. Storytelling: The Next Step for Visualization. IEEE Computer, 46, 5, 44--50. Google ScholarDigital Library
- Xuan Nhat Lam, Thuc Vu, Trong Duc Le, and Anh Duc Duong. 2008. Addressing cold-start problem in recommendation systems. In Proceedings of the 2nd international conference on Ubiquitous information management and communication (ICUIMC '08). ACM, 208--211. Google ScholarDigital Library
- Ian Li. 2011. Personal informatics and context: Using context to reveal factors that affect behavior. PhD Thesis, Carnegie Mellon University. Google ScholarDigital Library
- Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, 557--566. Google ScholarDigital Library
- Ian Li, Yevgeniy Medynskiy, Jon Froehlich, and Jakob Larsen. 2012. Personal informatics in practice: improving quality of life through data. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, 2799--2802. Google ScholarDigital Library
- Joseph Lindley and Robert Potts. 2014. A Machine Learning: An Example of HCI Prototyping with Design Fiction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction (NordiCHI '14). ACM. 1081--1084. Google ScholarDigital Library
- Steven N. Lipkin. 2002. Real emotional logic: Film and television docudrama as persuasive practice. Southern Illinois University Press.Google Scholar
- Ewen Macaskill, and Gabriel Dance. 2013. NSA Files Decoded: What the Revelations Mean for You. The Guardian. Retrieved October 25, 2017 from https://www.theguardian.com/world/interactive/2013/nov/01/snowden-nsa-files-surveillance-revelations-decodedGoogle Scholar
- Kate Nash. 2012. Goa Hippy Tribe: Theorising Documentary Content on a Social Network Site. Media International Australia, 142, 1, 30--40.Google ScholarCross Ref
- Bettina Nissen, John Bowers, Peter Wright, Jonathan Hook, and Christopher Newell. 2014. Volvelles, domes and wristbands: embedding digital fabrication within a visitor's trajectory of engagement. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). ACM, 825--834. Google ScholarDigital Library
- Jeungmin Oh, and Uichin Lee. 2015. Exploring UX issues in Quantified Self Technologies. In Proceedings of the Eighth International Conference on Mobile Computing and Ubiquitous Networking (ICarnegie Mellon University '15). IEEE, 53--59.Google Scholar
- John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, 1163--1172. Google ScholarDigital Library
- UK Government, Cabinet Office. 2012. Open Data: Unleashing the PotentialGoogle Scholar
- UK Government, Cabinet Office. 2013. Policy paper: G8 Open Data Charter and Technical Annex.Google Scholar
- Ofcom. 2016. The Communication Market Report, Aug 2016. Retrieved October 30, 2017 from https://www.ofcom.org.uk/research-and-data/multi-sector-research/cmr/cmr16Google Scholar
- Open Data Institute. 2016. Data as Culture. Retrieved October 25, 2017 from https://theodi.org/cultureGoogle Scholar
- Stephen Poole. 2007. Unspeak: Words Are Weapons. Abacus.Google Scholar
- Byron Reeves, James Cummings, James Scarborough, June Flora, and Dante Anderson. Leveraging the Engagement of Games to Change Energy Behavior. 2012. In Proceedings of the International Conference on Collaboration Technologies and Systems (CTS '12). IEEE, 354--358.Google Scholar
- Edward Segel, and Jeffrey Heer. 2010. Narrative Visualization: Telling Stories with Data. IEEE Trans. Vis. Comput. Graph., 16, 6, 1139--1148. Google ScholarDigital Library
- Ben Shneiderman, Catherine Plaisant, and Bradford Hesse. 2013. Improving Healthcare with Interactive Visualization. IEEE Computer, 46, 5, 58--66. Google ScholarDigital Library
- Bruce Sterling. 2009. Design fiction. Interactions 16, 3, 20--24. Google ScholarDigital Library
- Marian Ursu, Maureen Thomas, Ian Kegel, Doug Williams, Mika Tuomola, Inger Lindstedt, Terence Wright, Andra Leurdijk, Vilmos Zsombori, Julia Sussner, Ulf Myrestam, and Nina Hall. 2008. Interactive TV narratives: Opportunities, progress, and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 4, 4, 39 pages. Google ScholarDigital Library
- We Are Social & Hootsuite. 2017. Digital in 2017 Global Overview Report.Google Scholar
- Gerard Wilkinson, Tom Bartindale, Tom Nappey, Michael Evans, Pete Wright, and Patrick Olivier. 2018. Media of Things: Supporting The Production of Metadata Rich Media Through IoT Sensing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '18), ACM. Google ScholarDigital Library
- World Heritage Encyclopedia. 2018. List of Narrative Techniques. Retrieved March 30, 2018 from http://self .gutenberg.org/articles/eng/Literary_techniqueGoogle Scholar
- John Yorke. 2014. Into The Woods: How Stories Work and Why We Tell Them. Penguin.Google Scholar
Index Terms
- Facts, Interactivity and Videotape: Exploring the Design Space of Data in Interactive Video Storytelling
Recommendations
Interactive documentaries: A Golden Age
SPECIAL ISSUE: TV and Video Entertainment EnvironmentsThis article is motivated by the opportunity presented by recent advances in information and communication technology—particularly by faster broadband connections and faster digital media processing capabilities—for interactive television to extend and ...
Workshop Transmedia Journalism and Interactive Documentary in Dialogue
Interactive StorytellingAbstractThis half-day workshop promotes a hands-on approach to recent developments in transmedia storytelling and its application to journalism and interactive documentary (iDoc). Transmedia journalism, as well as any other application of transmedia ...
The Potential of Interactive Digital Narratives. Agency and Multiple Perspectives in Last Hijack Interactive
Interactive StorytellingAbstractInteractive Digital Narratives (IDN) have the capacity to represent multiple, even competing perspectives and to allow audiences to change between them. Such meaningful changes have been defined as agency by Murray [1] transforming the audience ...
Comments