Skip to main content

2.2 Interpreting Websites in Educational Contexts: A Social-Semiotic, Multimodal Approach

  • Chapter
  • First Online:
International Handbook of Interpretation in Educational Research

Abstract

This chapter reports on three research projects concerned with websites. All three have adopted a social-semiotic, multimodal approach (cf. Halliday, M. A. K. (1978). Language as Social Semiotic. London: Arnold; Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Oxon: Routledge; Kress G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London: Arnold, Kress, G., & Van Leeuwen, T. (2006 [1996]) Reading images: The grammar of visual design (2nd edn). London: Routledge) and developed new tools for understanding the complexity of website design and its implications for educational contexts. They have focused, however, on different challenges and types of hypermedia: (i) user orientation within websites for children, (ii) knowledge construction in online educational interactives for children, and (iii) news design in online newspapers and the literacy demands online newspapers present for TESOL and applied linguistics students. This paper opens by outlining the common starting point of all three projects in relation to the data – treating websites as meaningful texts. It then proceeds to consider differences in the questions and types of websites explored in each study, and how these differences have influenced the way social-semiotic multimodal tools for analysing the data have been developed in each study and complemented with other tools for collecting and analysing data (e.g. interviews with website users, designers and media practitioners). The paper concludes with a brief discussion of challenges that websites continue to present for educational research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 429.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 549.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Australian Broadcasting Corporation. (1998–2004). The playground. Retrieved 8 September 2004, from http://www.abc.net.au/children.

  • Baldry, A., & Thibault, P. J. (2006). Multimodal transcription and text analysis. London: Equinox.

    Google Scholar 

  • Bateman, J. A. (2008). Multimodality and genre: A foundation for the systematic analysis of multimodal documents. Hampshire: Palgrave Macmillan.

    Book  Google Scholar 

  • Bateman, J. A. (2011). The decomposability of semiotic modes. In K. O’Halloran & B. Smith (Eds.), Multimodal studies: Exploring issues and domains (pp. 17–38). London: Routledge.

    Google Scholar 

  • Bell, A. (1991). The language of news media. Oxford: Blackwell.

    Google Scholar 

  • Bernstein, B. B. (1971). Class, codes and control. London: Routledge and K. Paul.

    Book  Google Scholar 

  • Bernstein, B. B. (1974). Class, codes and control (2nd ed.). London: Routledge & K. Paul.

    Google Scholar 

  • Bernstein, B. B. (1975). Class, codes, and control: Theoretical studies towards a sociology of language. New York: Schocken Books.

    Book  Google Scholar 

  • Bernstein, B. B. (1990). The structuring of pedagogic discourse. London/New York: Routledge.

    Book  Google Scholar 

  • Bernstein, B. B. (2000 [1996]). Pedagogy, symbolic control, and identity: Theory, research, critique (Rev. ed.). London: Rowman & Littlefield Publisher.

    Google Scholar 

  • Bernstein, B. B. (2001). Towards a sociology of pedagogy: The contribution of Basil Bernstein to research. New York: Peter Lang.

    Google Scholar 

  • Bigum, C. (2002). Design sensibilities, schools and the new computing and education technologies. In I. Snyder (Ed.), Silicon literacies: Communication, innovation and education in the electronic age (pp. 130–139). London/New York: Routledge.

    Google Scholar 

  • Boczkowski, P. J. (2004). Digitizing the news: Innovation in online newspapers. Cambridge: MIT Press.

    Google Scholar 

  • Bolter, J. D., & Grusin, R. A. (1999). Remediation: Understanding new media. Cambridge: MIT Press.

    Google Scholar 

  • British Broadcasting Corporation. (2001–2004). CBBC newsround. Retrieved 30 October 2004, from http://news.bbc.co.uk/cbbcnews/default.stm.

  • Burbules, N. C. (2002). The web as a rhetorical place. In I. Snyder (Ed.), Silicon literacies: Communication, innovation and education in the electronic age (pp. 75–84). London/New York: Routledge.

    Google Scholar 

  • Caple, H. (2013). Photojournalism: A multisemiotic approach. Basingstoke: Palgrave Macmillan.

    Google Scholar 

  • Caple, H., & Knox, J. (2012). Online news galleries, photojournalism and the photo essay. Visual Communication, 11(2), 207–236.

    Google Scholar 

  • Christie, F. (2000). The language of classroom interaction. In L. Unsworth (Ed.), Researching language in schools and functional linguistic perspectives (pp. 184–203). London: Cassell.

    Google Scholar 

  • Christie, F. (2002). Classroom discourse analysis: A functional perspective. New York/London: Continuum.

    Google Scholar 

  • Coffin, C. (2000). History as discourse: Construals of time, cause and appraisal. PhD thesis. University of New South Wales, Sydney.

    Google Scholar 

  • Coffin, C. (2006). Historical discourse: The language of time, cause and evaluation. London: Continuum.

    Google Scholar 

  • de Vries, J. (2008). Newspaper design as cultural change. Visual Communication, 7(1), 5–25.

    Article  Google Scholar 

  • Djonov, E. (2005). Analysing the organisation of information in websites: From hypermedia design to systemic functional hypermedia discourse analysis. PhD Thesis, University of New South Wales, Sydney. Retrieved 20 April 2012, from http://handle.unsw.edu.au/1959.4/23915.

  • Djonov, E. (2007). Website hierarchy and the interaction between content organization, webpage and navigation design: A systemic functional hypermedia discourse analysis perspective. Information Design Journal, 15(2), 144–162.

    Google Scholar 

  • Djonov, E. (2008). Children’s website structure and navigation. In L. Unsworth (Ed.), Multimodal semiotics: Functional analysis in contexts of education (pp. 216–236). London: Continuum.

    Google Scholar 

  • Downes, T., & Fatouros, C. (1995). Learning in an electronic world: Computers in the classroom. Newtown: Primary English Teaching Association.

    Google Scholar 

  • Edwards, D. M., & Hardman, L. (1989). ‘Lost in Hyperspace’: Cognitive mapping and navigation in a hypertext environment. In R. McAleese (Ed.), Hypertext: Theory into practice (pp. 105–125). Oxford: Intellect Books.

    Google Scholar 

  • Fairclough, N. (1995). Media discourse. Arnold: London/New York.

    Google Scholar 

  • Feez, S., Iedema, R., & White, P. R. R. (2008). Media literacy (2nd ed.). Sydney: NSW Adult Migrant Education Service.

    Google Scholar 

  • Fowler, R. (1991). Language in the news: Discourse and ideology in the press. London: Routledge.

    Google Scholar 

  • Freebody, P. (2005). Does the use of online curriculum content enhance motivation, engagement and learning? The Le@rning Federation Trial Review: The Le@rning Federation. Retrieved 20 April 2012, from http://www.ndlrn.edu.au/verve/_resources/freebody2005_report__final.pdf.

  • Garrett, J. J. (2003). The elements of user experience: User-centred design for the web. Indianapolis: New Riders Publishing.

    Google Scholar 

  • Gauntlett, D. (2000). Web studies: A user’s guide. In D. Gauntlett (Ed.), Web studies: Rewiring media studies for the digital age (pp. 2–18). London: Arnold.

    Google Scholar 

  • Greer, J., & Mensing, D. (2004). U.S. news web sites better, but small papers still lag. Newspaper Research Journal, 25(2), 98–112.

    Google Scholar 

  • Hall, S. (1982). The rediscovery of ‘ideology’: Return of the repressed in media studies. In M. Gurivetch, T. Bennett, J. Curran, & J. Woollacott (Eds.), Culture, society and the media (pp. 56–90). London: Routledge.

    Google Scholar 

  • Halliday, M. A. K. (1978). Language as social semiotic. London: Arnold.

    Google Scholar 

  • Halliday, M. A. K. (1985). Part A. In M. A. K. Halliday & R. Hasan (Eds.), Language, context, and text: Aspects of language in a social-semiotic perspective (pp. 1–49). Geelong: Deakin University Press.

    Google Scholar 

  • Halliday, M. A. K., & Hasan, R. (1976). Cohesion in English. London: Longman.

    Google Scholar 

  • Halliday, M. A. K., & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar (3rd ed.). London: Arnold.

    Google Scholar 

  • Hallin, D. C. (1997). Sound bite news: Television coverage of elections. In S. Iyengar & R. Reeves (Eds.), Do the media govern? Politicians, voters, and reporters in America (pp. 57–98). Thousand Oaks: Sage.

    Google Scholar 

  • Hasan, R. (2009). Semantic variation: Meaning in society and in sociolinguistics. London: Equinox.

    Google Scholar 

  • Herman, E. S., & Chomsky, N. (1988). Manufacturing consent: The political economy of the mass media. New York: Pantheon Books.

    Google Scholar 

  • Hodge, R., & Kress, G. (1988). Social semiotics. Cambridge: Polity Press.

    Google Scholar 

  • Humphrey, S. (1996). Exploring literacy in school geography (Metropolitan East disadvantaged schools program). Sydney: NSW Department of School Education.

    Google Scholar 

  • Iyengar, S., & Reeves, R. (Eds.). (1997). Do the media govern?: Politicians, voters, and reporters in America. Thousand Oaks: Sage.

    Google Scholar 

  • Knox, J. S. (2007). Visual-verbal communication on online newspaper home pages. Visual Communication, 6(1), 19–53.

    Article  Google Scholar 

  • Knox, J. S. (2008). Online newspapers and TESOL classrooms: A multimodal perspective. In L. Unsworth (Ed.), Multimodal semiotics: Functional analysis in contexts of education (pp. 139–158). London: Continuum.

    Google Scholar 

  • Knox, J. S. (2009a). Multimodal discourse on online newspaper home pages: A social-semiotic perspective. PhD thesis. University of Sydney, Sydney.

    Google Scholar 

  • Knox, J. S. (2009b). Punctuating the home page: Image as language in an online newspaper. Discourse & Communication, 3(2), 145–172.

    Article  Google Scholar 

  • Knox, J. S. (2009c). Visual minimalism in hard news: Thumbnail faces on the smh online home page. Social Semiotics, 19(2), 165–189.

    Article  Google Scholar 

  • Knox, J. S. (2010). Online newspapers: Evolving genres, evolving theory. In C. Coffin, T. Lillis, & K. O’Halloran (Eds.), Applied linguistics methods: A reader (pp. 33–51). London: Routledge.

    Google Scholar 

  • Kok, A. K. C. (2004). Multisemiotic mediation in hypertext. In K. O’Halloran (Ed.), Multimodal discourse analysis (pp. 131–159). London/New York: Continuum.

    Google Scholar 

  • Kress, G. (2009). What is mode? In C. Jewitt (Ed.), The routledge handbook of multimodal analysis (pp. 54–68). Oxon/New York: Routledge.

    Google Scholar 

  • Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Oxon/ New York: Routledge.

    Google Scholar 

  • Kress, G., & Van Leeuwen, T. (1998). Front pages: (The critical) analysis of newspaper layout. In A. Bell & P. Garrett (Eds.), Approaches to media discourse (pp. 186–219). Oxford/Malden: Blackwell.

    Google Scholar 

  • Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London: Arnold.

    Google Scholar 

  • Kress, G., & Van Leeuwen, T. (2006 [1996]). Reading images: The grammar of visual design (2nd edn.). London: Routledge.

    Google Scholar 

  • Krug, S. (2006 [2000]). Don’t make me think!: A common sense approach to web usability (2nd edn.). Berkeley: New Riders.

    Google Scholar 

  • Lankshear, C., & Knobel, M. (2008). Digital literacies: Concepts, policies and practices. New York: Peter Lang.

    Google Scholar 

  • Large, A., & Beheshti, J. (2000). The web as a classroom resource: Reactions from the users. Journal of the American Society for Information Science, 51(12), 1069–1080.

    Article  Google Scholar 

  • Lemke, J. L. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In J. R. Martin & R. Veel (Eds.), Reading science: Critical and functional perspectives on discourses of science (pp. 87–113). London: Routledge.

    Google Scholar 

  • Lemke, J. L. (2002a). Multimedia semiotics: Genres for science education and scientific literacy. In M. J. Schleppegrel & M. C. Colombi (Eds.), Developing advanced literacy in first and second languages: Meaning with power (pp. 21–44). London/Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Lemke, J. L. (2002b). Travels in hypermodality. Visual Communication, 1(3), 299–325.

    Article  Google Scholar 

  • Li, X. (2002). Web page design affects news retrieval efficiency. Newspaper Research Journal, 23(1), 38–49.

    Google Scholar 

  • Lin, C. A., & Jeffres, L. W. (2001). Comparing distinctions across websites of newspapers, radio stations, and television stations. Journalism and Mass Communication Quarterly, 78(3), 555–573.

    Article  Google Scholar 

  • Luke, C. (2000). Cyber-schooling and technological change: Multiliteracies for new times. In B. Cope & M. Kalantzis (Eds.), Multiliteracies: Literacy learning and the design of social futures (pp. 69–91). South Yarra: Macmillan Publishers Australia Pty Ltd.

    Google Scholar 

  • Machin, D., & Niblock, S. (2006). News production: Theory and practice. London: Routledge.

    Google Scholar 

  • Martin, J. R. (1992). English text: System and structure. Amsterdam: John Benjamins Publishing Company.

    Book  Google Scholar 

  • Martin, J. R. (2002a). Fair trade: Negotiating meaning in multimodal texts. In P. Coppock (Ed.), The semiotics of writing: Transdisciplinary perspectives on the technology of writing (pp. 311–338). Turnhout: Brepols.

    Google Scholar 

  • Martin, J. R. (2002b). From little things big things grow: Ecogenesis in school geography. In R. Coe, L. Lingard, & T. Teslenco (Eds.), The rhetoric and ideology of genre (pp. 243–271). Cresskill: Hampton Press.

    Google Scholar 

  • Martin, J. R., & Rose, D. (2007). Working with discourse: Meaning beyond the clause (2nd ed.). London: Continuum.

    Google Scholar 

  • Martin, J. R., & Rose, D. (2008). Genre relations: Mapping culture. London: Equinox.

    Google Scholar 

  • Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Moore, P. (1996). Reading and writing the internet. The Australian Journal of Language and Literacy, 19(4), 317–329.

    Google Scholar 

  • National Geographic Society. (1996–2005). National Geographic Kids. Retrieved 8 September 2005, from http://www.nationalgeographic.com/kids.

  • New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66, 60–92.

    Google Scholar 

  • New York Hall of Science. (1999–2005). TryScience. Retrieved 20 April 2005, from http://www.tryscience.org.

  • Nielsen, J., & Tahir, M. (2002). Homepage usability: 50 websites deconstructed. Indianapolis: New Riders.

    Google Scholar 

  • Painter, C. (2001). Learning through language in early childhood. London: Continuum.

    Google Scholar 

  • Paterson, C., & Domingo, D. (Eds.). (2008). Making online news: The ethnography of new media production. New York/Bern/Berlin/Bruxelles/Frankfurt am Main/Oxford/Vienna: Peter Lang.

    Google Scholar 

  • Prensky, M. (2001a). Digital natives, digital immigrants. On the Horizon, 9(5), 1–6.

    Article  Google Scholar 

  • Prensky, M. (2001b). Digital natives, digital immigrants, part II. On the horizon, 9(6), 1–6.

    Article  Google Scholar 

  • Rader, H. (2003). Information literacy: A global perspective. In A. Martin & H. Rader (Eds.), Information and IT literacy: Enabling learning in the 21st century (pp. 24–42). London: Facet.

    Google Scholar 

  • Ramapo Catskill Library. (1995–2005). Kidsclick!: Websearch for kids by librarians. Retrieved 20 April 2005, from http://www.kidsclick.org.

  • Riffe, D., Aust, C. F., & Lacy, S. R. (1993). The effectiveness of random, consecutive day and constructed week sampling in newspaper content analysis. Journalism Quarterly, 7(1), 133–139.

    Article  Google Scholar 

  • Sanford Ink Corporation. (1998–2005). Sanford – a lifetime of color. Retrieved 20 April 2005, from http://www.sanford-artedventures.com.

  • State Rail Authority of New South Wales. (2000–2002). Tracking trains. Retrieved 30 November 2002, from http://www.trackingtrains.com.au.

  • Stenglin, M., & Djonov, E. (2010). Unpacking narrative in a hypermedia ‘artedventure’ for children. In C. R. Hoffmann (Ed.), Narrative revisited. Telling a story in the age of new media (pp. 185–212). Amsterdam/Philadelphia: John Benjamins.

    Chapter  Google Scholar 

  • Stern, C. (2003). Measuring students’ information literacy competency. In A. Martin & H. Rader (Eds.), Information and IT literacy: Enabling learning in the 21st century (pp. 112–119). London: Facet.

    Google Scholar 

  • Thibault, P. (2001). Multimodality and the school science textbook. In C. T. Torsello, G. Brunetti, & N. Penello (Eds.), Corpora Testuali per Ricerca, Traduzione e Apprendimento Linguistico (pp. 293–335). Padova: Unipress.

    Google Scholar 

  • Tosca, S. P. (2000). A pragmatics of links. Proceedings of the ACM Hypertext’00 Conference, 77–84.

    Google Scholar 

  • Unsworth, L. (2004). Comparing school science explanations in books and computer-based formats. International Journal of Instructional Media, 31(3), 283–301.

    Google Scholar 

  • Utt, S. H., & Pasternack, S. (2003). Front page design: Some trends continue. Newspaper Research Journal, 24(3), 48–61.

    Google Scholar 

  • Van Leeuwen, T. (1999). Speech, music, sound. London: Macmillan Press Ltd.

    Google Scholar 

  • Van Leeuwen, T. (2005a). Introducing social semiotics. London/New York: Routledge.

    Google Scholar 

  • Van Leeuwen, T. (2005b). Multimodality, genre and design. In S. Norris & R. H. Jones (Eds.), Discourse in action: Introducing mediated discourse analysis (pp. 73–94). London: Routledge.

    Google Scholar 

  • Whalley, P. (1990). Models of hypertext structure and learning. In D. H. Jonassen & H. Mandl (Eds.), Designing hypermedia for learning (pp. 61–67). Berlin/Heidelberg: Springer Verlag.

    Chapter  Google Scholar 

  • Yahoo! Inc. (1996–2005). Yahooligans: The web guide for kids. Retrieved 20 April 2005, from http://www.yahooligans.com.

  • Zhao, S. (2008). From her world to our world: Making history on a children’s website. Literacy Learning: The Middle Years, 16(2), 44–52.

    Google Scholar 

  • Zhao, S. (2010). Intersemiotic relations as logogenetic patterns: Towards the restoration of the time dimension in hypertext description. In M. Bednarek & J. R. Martin (Eds.), New discourse on language: Functional perspectives on multimodality, identity, and affiliation (pp. 195–218). London: Continuum.

    Google Scholar 

  • Zhao, S. (2011). Learning through multimedia interaction: The construal of primary social science knowledge on web-based E-texts. PhD thesis, University of Sydney.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Emilia Djonov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Djonov, E., Knox, J.S., Zhao, S. (2015). 2.2 Interpreting Websites in Educational Contexts: A Social-Semiotic, Multimodal Approach. In: Smeyers, P., Bridges, D., Burbules, N., Griffiths, M. (eds) International Handbook of Interpretation in Educational Research. Springer International Handbooks of Education. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9282-0_16

Download citation

Publish with us

Policies and ethics