Loading...
Virtual reality and embodiment in multimodal meaning making
Mills, Kathy A. Scholes, Laura Brown, A.
Mills, Kathy A.
Scholes, Laura
Brown, A.
Abstract
Immersive virtual reality (VR) technology is becoming widespread in education, yet research of VR technologies for students’ multimodal communication is an emerging area of research in writing and literacies scholarship. Likewise, the significance of new ways of embodied meaning making in VR environments is undertheorized—a gap that requires attention given the potential for broadened use of the sensorium in multimodal language and literacy learning. This classroom research investigated multimodal composition using the virtual paint program Google Tilt Brush™ with 47 elementary school students (ages 10–11 years) using a head-mounted display and motion sensors. Multimodal analysis of video, screen capture, and think-aloud data attended to sensory-motor affordances and constraints for embodiment. Modal constraints were the immateriality of the virtual text, virtual disembodiment, and somatosensory mismatch between the virtual and physical worlds. Potentials for new forms of embodied multimodal representation in VR involved extensive bodily, haptic, and locomotive movement. The findings are significant given that research of embodied cognition points to sensorimotor action as the basis for language and communication.
Keywords
composition, digital media, embodiment, multimodal design, virtual reality
Date
2022
Type
Journal article
Journal
Written Communication
Book
Volume
39
Issue
3
Page Range
335-369
Article Number
ACU Department
Institute for Learning Sciences and Teacher Education (ILSTE)
Faculty of Education and Arts
Faculty of Education and Arts
Relation URI
Source URL
Event URL
Open Access Status
Published as ‘gold’ (paid) open access
License
CC BY-NC 4.0
File Access
Open