Touch design and narrative interpretation: a social semiotic approach to picture book apps
Zhao, Sumin and Unsworth, L.. (2017). Touch design and narrative interpretation: a social semiotic approach to picture book apps. In In N. Kucirkova and G. Falloon (Ed.). Apps, Technology and Younger Learners: International evidence for teaching pp. 89 - 101 Routledge.
|Authors||Zhao, Sumin and Unsworth, L.|
|Editors||N. Kucirkova and G. Falloon|
Interactivity is often considered as the defining feature of a book app. However, what constitutes interactivity in the context of apps is not always clear. We postulate in this chapter a multimodal social semiotic theory of interactivity, which considers interactivity as not simply a function of technology, but also a resource for meaning-making. We distinguish two basic types of interactivity-intra-text and extra-text-incorporated in the touch design, and explore the different functions they perform in a broad range of picture book apps. In particular, we look at the app version of The Heart and the Bottle in depth, and illustrate how interactive design elements help to create an interpretative possibility of the story. We suggest that a better understanding of interactive touch design would promote more effective adult-child interactions around mobile applications.
|Keywords||Interactivity; multimodal; e-book; literacy; semiotic; meaning-making|
|Page range||89 - 101|
|Book title||Apps, Technology and Younger Learners: International evidence for teaching|
|Place of publication||United Kingdom|
|Research Group||Institute for Learning Sciences and Teacher Education (ILSTE)|
File Access Level
3views this month
0downloads this month