That’s good news ☹ : Semantic congruency effects in emoji processing

Journal article


Beyersmann, Elisabeth, Wegener, Signy and Kemp, Nenagh. (2023). That’s good news ☹ : Semantic congruency effects in emoji processing. Journal of Media Psychology. 35(1), pp. 17-27. https://doi.org/10.1027/1864-1105/a000342
AuthorsBeyersmann, Elisabeth, Wegener, Signy and Kemp, Nenagh
Abstract

The use of emojis in digital communication has become increasingly popular, but how emojis are processed and integrated in reading processes remains underexplored. This study used eye-tracking to monitor university students’ (n = 47) eye movements while reading single-line text messages with a face emoji embedded medially. Messages contained a semantically congruent emoji (e.g., That’s good news 😊 tell me more), a semantically incongruent emoji (e.g., That’s good news ☹ tell me more), or a dash (e.g., That’s good news – tell me more). Results revealed that emoji congruency did not influence early fixation measures (first fixation duration and gaze duration), nor the probability of regressions. However, there was a significant congruency effect in total reading time and trial dwell time, showing that incongruence incurred a processing cost. The present results extend previously reported semantic congruency effects in sentence reading to the processing of emojis. This result suggests that the semantic content conveyed by face emojis is integrated with sentence context late in processing. We further found that the use of congruent emojis improved the relationship between sender and receiver: Ratings collected separately suggested that message senders were liked better if they included congruent than incongruent emojis. Overall, emojis attracted attention: Participants were twice as likely to fixate on emojis than on dashes, and to fixate on emojis for longer.

Keywordsemoji processing; eye-tracking; semantic congruency; digital communication; text messaging
Year2023
JournalJournal of Media Psychology
Journal citation35 (1), pp. 17-27
PublisherHogrefe Publishing
ISSN1864-1105
2151-2388
Digital Object Identifier (DOI)https://doi.org/10.1027/1864-1105/a000342
Scopus EID2-s2.0-85128569144
Page range17-27
FunderAustralian Research Council (ARC)
Publisher's version
License
All rights reserved
File Access Level
Controlled
Output statusPublished
Publication dates
Online06 Apr 2022
Publication process dates
Deposited12 Oct 2023
ARC Funded ResearchThis output has been funded, wholly or partially, under the Australian Research Council Act 2001
Grant IDDE190100850
Permalink -

https://acuresearchbank.acu.edu.au/item/8zv9w/that-s-good-news-semantic-congruency-effects-in-emoji-processing

Restricted files

Publisher's version

  • 40
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

The effect of spacing versus massing on orthographic learning
Wegener, Signy, Wang, Hua-Chen, Beyersmann, Elisabeth, Reichle, Erik D., Nation, Kate and Castles, Anne. (2023). The effect of spacing versus massing on orthographic learning. Reading Research Quarterly. 58(3), pp. 361-372. https://doi.org/10.1002/rrq.492
Eye movements during reading
Wegener, Signy, Yu, Lili, Reichle, Erik D., Beyersmann, Elisabeth, Parrila, Rauno and Castles, Anne. (2023). Eye movements during reading. Frontiers for Young Minds. 11, p. Article 769381. https://doi.org/10.3389/frym.2023.769381
The role of oral vocabulary when L2 speakers read novel words : A complex word training study
Behzadnia, Ali, Wegener, Signy, Bürki, Audrey and Beyersmann, Elisabeth. (2023). The role of oral vocabulary when L2 speakers read novel words : A complex word training study. Bilingualism: Language and Cognition. pp. 1-12. https://doi.org/10.1017/S1366728923000627
Orthographic expectancies in the absence of contextual support
Wegener, Signy, Wang, Hua-Chen, Beyersmann, Elisabeth, Nation, Kate, Colenbrander, Danielle and Castles, Anne. (2023). Orthographic expectancies in the absence of contextual support. Scientific Studies of Reading. 27(2), pp. 187-197. https://doi.org/10.1080/10888438.2022.2127356
The effect of oral vocabulary training on reading novel complex words
Beyersmann, Elisabeth, Wegener, Signy, Pescuma, Valentina N., Nation, Kate, Colenbrander, Danielle and Castles, Anne. (2023). The effect of oral vocabulary training on reading novel complex words. Quarterly Journal of Experimental Psychology. 76(6), pp. 1321-1332. https://doi.org/10.1177/17470218221113949
Acquisition of orthographic forms via complex spoken word training
Beyersmann, Elisabeth, Wegener, Signy, Spencer, Jasmine and Castles, Anne. (2023). Acquisition of orthographic forms via complex spoken word training. Psychonomic Bulletin and Review. 30, pp. 739-750. https://doi.org/10.3758/s13423-022-02185-y
Teaching children to read irregular words : A comparison of three instructional methods
Colenbrander, Danielle, Kohnen, Saskia, Beyersmann, Elisabeth, Robidoux, Serje, Wegener, Signy, Arrow, Tara, Nation, Kate and Castles, Anne. (2022). Teaching children to read irregular words : A comparison of three instructional methods. Scientific Studies of Reading. 26(6), pp. 545-564. https://doi.org/10.1080/10888438.2022.2077653
Oral vocabulary and learning to read new words : A theoretical review
Wegener, Signy, Wang, Hua-Chen, Beyersmann, Elisabeth and Castles, Anne. (2022). Oral vocabulary and learning to read new words : A theoretical review. Australian Journal of Learning Difficulties. 27(2), pp. 253-278. https://doi.org/10.1080/19404158.2022.2097717
The effects of spacing and massing on children's orthographic learning
Wegener, Signy, Wang, Hua-Chen, Beyersmann, Elisabeth, Nation, Kate, Colenbrander, Danielle and Castles, Anne. (2022). The effects of spacing and massing on children's orthographic learning. Journal of Experimental Child Psychology. 214, p. Article 105309. https://doi.org/10.1016/j.jecp.2021.105309
Linking spoken and written word knowledge
Wegener, Signy. (2022). Linking spoken and written word knowledge. Nature Reviews Psychology. 1(7), pp. 374-374. https://doi.org/10.1038/s44159-022-00076-6
Children processing novel irregular and regular words during reading : An eye tracking study
Murray, Lyndall, Wegener, Signy, Wang, Hua-Chen, Parrila, Rauno and Castles, Anne. (2022). Children processing novel irregular and regular words during reading : An eye tracking study. Scientific Studies of Reading. 26(5), pp. 417-431. https://doi.org/10.1080/10888438.2022.2030744
Learning morphologically complex spoken words : Orthographic expectations of embedded stems are formed prior to print exposure
Beyersmann, Elisabeth, Wegener, Signy, Nation, Kate, Prokupzcuk, Ayako, Wang, Hua-Chen and Castles, Anne. (2021). Learning morphologically complex spoken words : Orthographic expectations of embedded stems are formed prior to print exposure. Journal of Experimental Psychology : Learning, Memory and Cognition. 47(1), pp. 87-98. https://doi.org/10.1037/xlm0000808
Tracking the evolution of orthographic expectancies over building visual experience.
Wegener, Signy, Wang, Hua-Chen, Nation, Kate and Castles, Anne. (2020). Tracking the evolution of orthographic expectancies over building visual experience. Journal of Experimental Child Psychology. 199, p. Article 104912. https://doi.org/10.1016/j.jecp.2020.104912
Children reading spoken words : Interactions between vocabulary and orthographic expectancy
Wegener, Signy, Wang, Hua-Chen, de Lissa, Peter, Robidoux, Serje, Nation, Kate and Castles, Anne. (2018). Children reading spoken words : Interactions between vocabulary and orthographic expectancy. Developmental Science. 21(3), p. Article e12577. https://doi.org/10.1111/desc.12577