Reading gamefully: videogamification as multimodal pedagogy for high school setworks

Abstract

This paper draws from multiple publications in the Literacy Studies, Game Studies and Multimodal fields to foreground the affordances of using modern video game aesthetics – particularly their user interfaces or screens – as learning scaffolds in the under-resourced English classroom context. Though this may be seen as a well-worn terrain for research today (nearly 30 years after the advent of Game Studies), it is argued that video games remain somewhat underrepresented in literacy education, with the Covid-19 pandemic and recurrent lockdowns even further cementing games technologies from learners’ home domains as the new frontier in teaching and learning. The benefits of importing such technologies into the classroom is nothing new to the field. Yet, this study innovates by optimising the most accessible of graphological media (pencils, pens, paints and paper) during participants’ transmodalisations of prescribed English literature – particularly Shakespeare’s plays – into a range of video game screenshots, including character menus, maps, and heads-up-displays. The research site is a public high school in Johannesburg, South Africa, with five Grade 10-12 learners drawing the screenshots in response to an extracurricular, multimodal enrichment programme. The author contends that this programme (or similar pedagogies) may encourage future groups to delve further into the complexities of their school setworks, which may then be connected meaningfully to their own, increasingly digital life-worlds. Recognising game-making as an extraordinarily complex undertaking, the researcher then offers a fine-grained analysis of each participant’s text-to-game re-genrefication. In this way, the powerful representational properties of the video game medium can come to light, reaffirming its importance as a semiotic resource and pedagogic tool.