Abstract
This chapter reports on three research projects concerned with websites. All three have adopted a social-semiotic, multimodal approach (cf. Halliday, M. A. K. (1978). Language as Social Semiotic. London: Arnold; Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Oxon: Routledge; Kress G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London: Arnold, Kress, G., & Van Leeuwen, T. (2006 [1996]) Reading images: The grammar of visual design (2nd edn). London: Routledge) and developed new tools for understanding the complexity of website design and its implications for educational contexts. They have focused, however, on different challenges and types of hypermedia: (i) user orientation within websites for children, (ii) knowledge construction in online educational interactives for children, and (iii) news design in online newspapers and the literacy demands online newspapers present for TESOL and applied linguistics students. This paper opens by outlining the common starting point of all three projects in relation to the data – treating websites as meaningful texts. It then proceeds to consider differences in the questions and types of websites explored in each study, and how these differences have influenced the way social-semiotic multimodal tools for analysing the data have been developed in each study and complemented with other tools for collecting and analysing data (e.g. interviews with website users, designers and media practitioners). The paper concludes with a brief discussion of challenges that websites continue to present for educational research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Australian Broadcasting Corporation. (1998–2004). The playground. Retrieved 8 September 2004, from http://www.abc.net.au/children.
Baldry, A., & Thibault, P. J. (2006). Multimodal transcription and text analysis. London: Equinox.
Bateman, J. A. (2008). Multimodality and genre: A foundation for the systematic analysis of multimodal documents. Hampshire: Palgrave Macmillan.
Bateman, J. A. (2011). The decomposability of semiotic modes. In K. O’Halloran & B. Smith (Eds.), Multimodal studies: Exploring issues and domains (pp. 17–38). London: Routledge.
Bell, A. (1991). The language of news media. Oxford: Blackwell.
Bernstein, B. B. (1971). Class, codes and control. London: Routledge and K. Paul.
Bernstein, B. B. (1974). Class, codes and control (2nd ed.). London: Routledge & K. Paul.
Bernstein, B. B. (1975). Class, codes, and control: Theoretical studies towards a sociology of language. New York: Schocken Books.
Bernstein, B. B. (1990). The structuring of pedagogic discourse. London/New York: Routledge.
Bernstein, B. B. (2000 [1996]). Pedagogy, symbolic control, and identity: Theory, research, critique (Rev. ed.). London: Rowman & Littlefield Publisher.
Bernstein, B. B. (2001). Towards a sociology of pedagogy: The contribution of Basil Bernstein to research. New York: Peter Lang.
Bigum, C. (2002). Design sensibilities, schools and the new computing and education technologies. In I. Snyder (Ed.), Silicon literacies: Communication, innovation and education in the electronic age (pp. 130–139). London/New York: Routledge.
Boczkowski, P. J. (2004). Digitizing the news: Innovation in online newspapers. Cambridge: MIT Press.
Bolter, J. D., & Grusin, R. A. (1999). Remediation: Understanding new media. Cambridge: MIT Press.
British Broadcasting Corporation. (2001–2004). CBBC newsround. Retrieved 30 October 2004, from http://news.bbc.co.uk/cbbcnews/default.stm.
Burbules, N. C. (2002). The web as a rhetorical place. In I. Snyder (Ed.), Silicon literacies: Communication, innovation and education in the electronic age (pp. 75–84). London/New York: Routledge.
Caple, H. (2013). Photojournalism: A multisemiotic approach. Basingstoke: Palgrave Macmillan.
Caple, H., & Knox, J. (2012). Online news galleries, photojournalism and the photo essay. Visual Communication, 11(2), 207–236.
Christie, F. (2000). The language of classroom interaction. In L. Unsworth (Ed.), Researching language in schools and functional linguistic perspectives (pp. 184–203). London: Cassell.
Christie, F. (2002). Classroom discourse analysis: A functional perspective. New York/London: Continuum.
Coffin, C. (2000). History as discourse: Construals of time, cause and appraisal. PhD thesis. University of New South Wales, Sydney.
Coffin, C. (2006). Historical discourse: The language of time, cause and evaluation. London: Continuum.
de Vries, J. (2008). Newspaper design as cultural change. Visual Communication, 7(1), 5–25.
Djonov, E. (2005). Analysing the organisation of information in websites: From hypermedia design to systemic functional hypermedia discourse analysis. PhD Thesis, University of New South Wales, Sydney. Retrieved 20 April 2012, from http://handle.unsw.edu.au/1959.4/23915.
Djonov, E. (2007). Website hierarchy and the interaction between content organization, webpage and navigation design: A systemic functional hypermedia discourse analysis perspective. Information Design Journal, 15(2), 144–162.
Djonov, E. (2008). Children’s website structure and navigation. In L. Unsworth (Ed.), Multimodal semiotics: Functional analysis in contexts of education (pp. 216–236). London: Continuum.
Downes, T., & Fatouros, C. (1995). Learning in an electronic world: Computers in the classroom. Newtown: Primary English Teaching Association.
Edwards, D. M., & Hardman, L. (1989). ‘Lost in Hyperspace’: Cognitive mapping and navigation in a hypertext environment. In R. McAleese (Ed.), Hypertext: Theory into practice (pp. 105–125). Oxford: Intellect Books.
Fairclough, N. (1995). Media discourse. Arnold: London/New York.
Feez, S., Iedema, R., & White, P. R. R. (2008). Media literacy (2nd ed.). Sydney: NSW Adult Migrant Education Service.
Fowler, R. (1991). Language in the news: Discourse and ideology in the press. London: Routledge.
Freebody, P. (2005). Does the use of online curriculum content enhance motivation, engagement and learning? The Le@rning Federation Trial Review: The Le@rning Federation. Retrieved 20 April 2012, from http://www.ndlrn.edu.au/verve/_resources/freebody2005_report__final.pdf.
Garrett, J. J. (2003). The elements of user experience: User-centred design for the web. Indianapolis: New Riders Publishing.
Gauntlett, D. (2000). Web studies: A user’s guide. In D. Gauntlett (Ed.), Web studies: Rewiring media studies for the digital age (pp. 2–18). London: Arnold.
Greer, J., & Mensing, D. (2004). U.S. news web sites better, but small papers still lag. Newspaper Research Journal, 25(2), 98–112.
Hall, S. (1982). The rediscovery of ‘ideology’: Return of the repressed in media studies. In M. Gurivetch, T. Bennett, J. Curran, & J. Woollacott (Eds.), Culture, society and the media (pp. 56–90). London: Routledge.
Halliday, M. A. K. (1978). Language as social semiotic. London: Arnold.
Halliday, M. A. K. (1985). Part A. In M. A. K. Halliday & R. Hasan (Eds.), Language, context, and text: Aspects of language in a social-semiotic perspective (pp. 1–49). Geelong: Deakin University Press.
Halliday, M. A. K., & Hasan, R. (1976). Cohesion in English. London: Longman.
Halliday, M. A. K., & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar (3rd ed.). London: Arnold.
Hallin, D. C. (1997). Sound bite news: Television coverage of elections. In S. Iyengar & R. Reeves (Eds.), Do the media govern? Politicians, voters, and reporters in America (pp. 57–98). Thousand Oaks: Sage.
Hasan, R. (2009). Semantic variation: Meaning in society and in sociolinguistics. London: Equinox.
Herman, E. S., & Chomsky, N. (1988). Manufacturing consent: The political economy of the mass media. New York: Pantheon Books.
Hodge, R., & Kress, G. (1988). Social semiotics. Cambridge: Polity Press.
Humphrey, S. (1996). Exploring literacy in school geography (Metropolitan East disadvantaged schools program). Sydney: NSW Department of School Education.
Iyengar, S., & Reeves, R. (Eds.). (1997). Do the media govern?: Politicians, voters, and reporters in America. Thousand Oaks: Sage.
Knox, J. S. (2007). Visual-verbal communication on online newspaper home pages. Visual Communication, 6(1), 19–53.
Knox, J. S. (2008). Online newspapers and TESOL classrooms: A multimodal perspective. In L. Unsworth (Ed.), Multimodal semiotics: Functional analysis in contexts of education (pp. 139–158). London: Continuum.
Knox, J. S. (2009a). Multimodal discourse on online newspaper home pages: A social-semiotic perspective. PhD thesis. University of Sydney, Sydney.
Knox, J. S. (2009b). Punctuating the home page: Image as language in an online newspaper. Discourse & Communication, 3(2), 145–172.
Knox, J. S. (2009c). Visual minimalism in hard news: Thumbnail faces on the smh online home page. Social Semiotics, 19(2), 165–189.
Knox, J. S. (2010). Online newspapers: Evolving genres, evolving theory. In C. Coffin, T. Lillis, & K. O’Halloran (Eds.), Applied linguistics methods: A reader (pp. 33–51). London: Routledge.
Kok, A. K. C. (2004). Multisemiotic mediation in hypertext. In K. O’Halloran (Ed.), Multimodal discourse analysis (pp. 131–159). London/New York: Continuum.
Kress, G. (2009). What is mode? In C. Jewitt (Ed.), The routledge handbook of multimodal analysis (pp. 54–68). Oxon/New York: Routledge.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Oxon/ New York: Routledge.
Kress, G., & Van Leeuwen, T. (1998). Front pages: (The critical) analysis of newspaper layout. In A. Bell & P. Garrett (Eds.), Approaches to media discourse (pp. 186–219). Oxford/Malden: Blackwell.
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London: Arnold.
Kress, G., & Van Leeuwen, T. (2006 [1996]). Reading images: The grammar of visual design (2nd edn.). London: Routledge.
Krug, S. (2006 [2000]). Don’t make me think!: A common sense approach to web usability (2nd edn.). Berkeley: New Riders.
Lankshear, C., & Knobel, M. (2008). Digital literacies: Concepts, policies and practices. New York: Peter Lang.
Large, A., & Beheshti, J. (2000). The web as a classroom resource: Reactions from the users. Journal of the American Society for Information Science, 51(12), 1069–1080.
Lemke, J. L. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In J. R. Martin & R. Veel (Eds.), Reading science: Critical and functional perspectives on discourses of science (pp. 87–113). London: Routledge.
Lemke, J. L. (2002a). Multimedia semiotics: Genres for science education and scientific literacy. In M. J. Schleppegrel & M. C. Colombi (Eds.), Developing advanced literacy in first and second languages: Meaning with power (pp. 21–44). London/Mahwah: Lawrence Erlbaum Associates.
Lemke, J. L. (2002b). Travels in hypermodality. Visual Communication, 1(3), 299–325.
Li, X. (2002). Web page design affects news retrieval efficiency. Newspaper Research Journal, 23(1), 38–49.
Lin, C. A., & Jeffres, L. W. (2001). Comparing distinctions across websites of newspapers, radio stations, and television stations. Journalism and Mass Communication Quarterly, 78(3), 555–573.
Luke, C. (2000). Cyber-schooling and technological change: Multiliteracies for new times. In B. Cope & M. Kalantzis (Eds.), Multiliteracies: Literacy learning and the design of social futures (pp. 69–91). South Yarra: Macmillan Publishers Australia Pty Ltd.
Machin, D., & Niblock, S. (2006). News production: Theory and practice. London: Routledge.
Martin, J. R. (1992). English text: System and structure. Amsterdam: John Benjamins Publishing Company.
Martin, J. R. (2002a). Fair trade: Negotiating meaning in multimodal texts. In P. Coppock (Ed.), The semiotics of writing: Transdisciplinary perspectives on the technology of writing (pp. 311–338). Turnhout: Brepols.
Martin, J. R. (2002b). From little things big things grow: Ecogenesis in school geography. In R. Coe, L. Lingard, & T. Teslenco (Eds.), The rhetoric and ideology of genre (pp. 243–271). Cresskill: Hampton Press.
Martin, J. R., & Rose, D. (2007). Working with discourse: Meaning beyond the clause (2nd ed.). London: Continuum.
Martin, J. R., & Rose, D. (2008). Genre relations: Mapping culture. London: Equinox.
Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge: Cambridge University Press.
Moore, P. (1996). Reading and writing the internet. The Australian Journal of Language and Literacy, 19(4), 317–329.
National Geographic Society. (1996–2005). National Geographic Kids. Retrieved 8 September 2005, from http://www.nationalgeographic.com/kids.
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66, 60–92.
New York Hall of Science. (1999–2005). TryScience. Retrieved 20 April 2005, from http://www.tryscience.org.
Nielsen, J., & Tahir, M. (2002). Homepage usability: 50 websites deconstructed. Indianapolis: New Riders.
Painter, C. (2001). Learning through language in early childhood. London: Continuum.
Paterson, C., & Domingo, D. (Eds.). (2008). Making online news: The ethnography of new media production. New York/Bern/Berlin/Bruxelles/Frankfurt am Main/Oxford/Vienna: Peter Lang.
Prensky, M. (2001a). Digital natives, digital immigrants. On the Horizon, 9(5), 1–6.
Prensky, M. (2001b). Digital natives, digital immigrants, part II. On the horizon, 9(6), 1–6.
Rader, H. (2003). Information literacy: A global perspective. In A. Martin & H. Rader (Eds.), Information and IT literacy: Enabling learning in the 21st century (pp. 24–42). London: Facet.
Ramapo Catskill Library. (1995–2005). Kidsclick!: Websearch for kids by librarians. Retrieved 20 April 2005, from http://www.kidsclick.org.
Riffe, D., Aust, C. F., & Lacy, S. R. (1993). The effectiveness of random, consecutive day and constructed week sampling in newspaper content analysis. Journalism Quarterly, 7(1), 133–139.
Sanford Ink Corporation. (1998–2005). Sanford – a lifetime of color. Retrieved 20 April 2005, from http://www.sanford-artedventures.com.
State Rail Authority of New South Wales. (2000–2002). Tracking trains. Retrieved 30 November 2002, from http://www.trackingtrains.com.au.
Stenglin, M., & Djonov, E. (2010). Unpacking narrative in a hypermedia ‘artedventure’ for children. In C. R. Hoffmann (Ed.), Narrative revisited. Telling a story in the age of new media (pp. 185–212). Amsterdam/Philadelphia: John Benjamins.
Stern, C. (2003). Measuring students’ information literacy competency. In A. Martin & H. Rader (Eds.), Information and IT literacy: Enabling learning in the 21st century (pp. 112–119). London: Facet.
Thibault, P. (2001). Multimodality and the school science textbook. In C. T. Torsello, G. Brunetti, & N. Penello (Eds.), Corpora Testuali per Ricerca, Traduzione e Apprendimento Linguistico (pp. 293–335). Padova: Unipress.
Tosca, S. P. (2000). A pragmatics of links. Proceedings of the ACM Hypertext’00 Conference, 77–84.
Unsworth, L. (2004). Comparing school science explanations in books and computer-based formats. International Journal of Instructional Media, 31(3), 283–301.
Utt, S. H., & Pasternack, S. (2003). Front page design: Some trends continue. Newspaper Research Journal, 24(3), 48–61.
Van Leeuwen, T. (1999). Speech, music, sound. London: Macmillan Press Ltd.
Van Leeuwen, T. (2005a). Introducing social semiotics. London/New York: Routledge.
Van Leeuwen, T. (2005b). Multimodality, genre and design. In S. Norris & R. H. Jones (Eds.), Discourse in action: Introducing mediated discourse analysis (pp. 73–94). London: Routledge.
Whalley, P. (1990). Models of hypertext structure and learning. In D. H. Jonassen & H. Mandl (Eds.), Designing hypermedia for learning (pp. 61–67). Berlin/Heidelberg: Springer Verlag.
Yahoo! Inc. (1996–2005). Yahooligans: The web guide for kids. Retrieved 20 April 2005, from http://www.yahooligans.com.
Zhao, S. (2008). From her world to our world: Making history on a children’s website. Literacy Learning: The Middle Years, 16(2), 44–52.
Zhao, S. (2010). Intersemiotic relations as logogenetic patterns: Towards the restoration of the time dimension in hypertext description. In M. Bednarek & J. R. Martin (Eds.), New discourse on language: Functional perspectives on multimodality, identity, and affiliation (pp. 195–218). London: Continuum.
Zhao, S. (2011). Learning through multimedia interaction: The construal of primary social science knowledge on web-based E-texts. PhD thesis, University of Sydney.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Djonov, E., Knox, J.S., Zhao, S. (2015). 2.2 Interpreting Websites in Educational Contexts: A Social-Semiotic, Multimodal Approach. In: Smeyers, P., Bridges, D., Burbules, N., Griffiths, M. (eds) International Handbook of Interpretation in Educational Research. Springer International Handbooks of Education. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9282-0_16
Download citation
DOI: https://doi.org/10.1007/978-94-017-9282-0_16
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-017-9281-3
Online ISBN: 978-94-017-9282-0
eBook Packages: Humanities, Social Sciences and LawEducation (R0)