Touch design and narrative interpretation: a social semiotic approach to picture book apps

Book chapter


Zhao, Sumin and Unsworth, Len 2017. Touch design and narrative interpretation: a social semiotic approach to picture book apps. in: N. Kucirkova and G. Falloon (ed.) Apps, Technology and Younger Learners: International evidence for teaching United Kingdom: Routledge. pp. 89 - 101
AuthorsZhao, Sumin and Unsworth, Len
EditorsN. Kucirkova and G. Falloon
Abstract

Interactivity is often considered as the defining feature of a book app. However, what constitutes interactivity in the context of apps is not always clear. We postulate in this chapter a multimodal social semiotic theory of interactivity, which considers interactivity as not simply a function of technology, but also a resource for meaning-making. We distinguish two basic types of interactivity-intra-text and extra-text-incorporated in the touch design, and explore the different functions they perform in a broad range of picture book apps. In particular, we look at the app version of The Heart and the Bottle in depth, and illustrate how interactive design elements help to create an interpretative possibility of the story. We suggest that a better understanding of interactive touch design would promote more effective adult-child interactions around mobile applications.

KeywordsInteractivity; multimodal; e-book; literacy; semiotic; meaning-making
Page range89 - 101
Year2017
Book titleApps, Technology and Younger Learners: International evidence for teaching
PublisherRoutledge
Place of publicationUnited Kingdom
ISBN9781138927872
Research GroupInstitute for Learning Sciences and Teacher Education (ILSTE)
Permalink -

https://acuresearchbank.acu.edu.au/item/873qx/touch-design-and-narrative-interpretation-a-social-semiotic-approach-to-picture-book-apps

Restricted files

Publisher's version

  • 1
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as