It’s all about time : Precision and accuracy of Emotiv event-marking for ERPD research

Journal article


Williams, Nikolas S., McArthur, Genevieve M. and Badcock, Nicholas A.. (2021). It’s all about time : Precision and accuracy of Emotiv event-marking for ERPD research. PeerJ. 9, p. Article e10700. https://doi.org/10.7717/peerj.10700
AuthorsWilliams, Nikolas S., McArthur, Genevieve M. and Badcock, Nicholas A.
Abstract

Background
The use of consumer-grade electroencephalography (EEG) systems for research purposes has become more prevalent. In event-related potential (ERP) research, it is critical that these systems have precise and accurate timing. The aim of the current study was to investigate the timing reliability of event-marking solutions used with Emotiv commercial EEG systems.

Method
We conducted three experiments. In Experiment 1 we established a jitter threshold (i.e. the point at which jitter made an event-marking method unreliable). To do this, we introduced statistical noise to the temporal position of event-marks of a pre-existing ERP dataset (recorded with a research-grade system, Neuroscan SynAmps2 at 1,000 Hz using parallel-port event-marking) and calculated the level at which the waveform peaks differed statistically from the original waveform. In Experiment 2 we established a method to identify ‘true’ events (i.e. when an event should appear in the EEG data). We did this by inserting 1,000 events into Neuroscan data using a custom-built event-marking system, the ‘Airmarker’, which marks events by triggering voltage spikes in two EEG channels. We used the lag between Airmarker events and events generated by Neuroscan as a reference for comparisons in Experiment 3. In Experiment 3 we measured the precision and accuracy of three types of Emotiv event-marking by generating 1,000 events, 1 s apart. We measured precision as the variability (standard deviation in ms) of Emotiv events and accuracy as the mean difference between Emotiv events and true events. The three triggering methods we tested were: (1) Parallel-port-generated TTL triggers; (2) Arduino-generated TTL triggers; and (3) Serial-port triggers. In Methods 1 and 2 we used an auxiliary device, Emotiv Extender, to incorporate triggers into the EEG data. We tested these event-marking methods across three configurations of Emotiv EEG systems: (1) Emotiv EPOC+ sampling at 128 Hz; (2) Emotiv EPOC+ sampling at 256 Hz; and (3) Emotiv EPOC Flex sampling at 128 Hz.

Results
In Experiment 1 we found that the smaller P1 and N1 peaks were attenuated at lower levels of jitter relative to the larger P2 peak (21 ms, 16 ms, and 45 ms for P1, N1, and P2, respectively). In Experiment 2, we found an average lag of 30.96 ms for Airmarker events relative to Neuroscan events. In Experiment 3, we found some lag in all configurations. However, all configurations exhibited precision of less than a single sample, with serial-port-marking the most precise when paired with EPOC+ sampling at 256 Hz.

Conclusion
All Emotiv event-marking methods and configurations that we tested were precise enough for ERP research as the precision of each method would provide ERP waveforms statistically equivalent to a research-standard system. Though all systems exhibited some level of inaccuracy, researchers could easily account for these during data processing.

KeywordsEEG; ERP; Emotiv; EPOC; flex; jitter; timing; accuracy; trigger
Year2021
JournalPeerJ
Journal citation9, p. Article e10700
PublisherPeerJ Ltd.
ISSN2167-8359
Digital Object Identifier (DOI)https://doi.org/10.7717/peerj.10700
PubMed ID33614271
Scopus EID2-s2.0-85100954938
PubMed Central IDPMC7879951
Open accessPublished as ‘gold’ (paid) open access
Page range1-17
FunderMacquarie University
Emotiv Pty Ltd
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online09 Feb 2021
Publication process dates
Accepted14 Dec 2020
Deposited20 Nov 2023
Grant ID83673928
Permalink -

https://acuresearchbank.acu.edu.au/item/8zz61/it-s-all-about-time-precision-and-accuracy-of-emotiv-event-marking-for-erpd-research

Download files


Publisher's version
OA_Williams_2021_Its_all_about_time_Precision_and.pdf
License: CC BY 4.0
File access level: Open

  • 21
    total views
  • 7
    total downloads
  • 1
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

An interdisciplinary approach to enhance children’s listening, learning, and wellbeing in the classroom : The Listen to Learn for Life (L3) Assessment Framework
Mealings, Kiri, Miles, Kelly, Parrila, Rauno, Holt, Rebecca, Cox, Felicity, Dillon, Harvey, Sharma, Mridula, Demuth, Katherine, Leigh, Greg, McMahon, Catherine, McArthur, Genevieve and Buchholz, Joerg M.. (2023). An interdisciplinary approach to enhance children’s listening, learning, and wellbeing in the classroom : The Listen to Learn for Life (L3) Assessment Framework. Frontiers in Education. 8, p. Article 1185167. https://doi.org/10.3389/feduc.2023.1185167
Scanpath regularity as an index of reading comprehension
Mézière, Diane C., Yu, Lili, McArthur, Genevieve, Reichle, Erik D. and von der Malsburg, Titus. (2023). Scanpath regularity as an index of reading comprehension. Scientific Studies of Reading. pp. 1-22. https://doi.org/10.1080/10888438.2023.2232063
Poor reading and anxiety (PRAX) : Building a theory and practice
McArthur, Genevieve. (2022). Poor reading and anxiety (PRAX) : Building a theory and practice. Australian Journal of Learning Difficulties. 27(1), pp. 169-180. https://doi.org/10.1080/19404158.2022.2054834
Are different reading problems associated with different anxiety types?
Francis, Deanna A., Hudson, Jennifer L., Robidoux, Serje and McArthur, Genevieve M.. (2022). Are different reading problems associated with different anxiety types? Applied Cognitive Psychology. 36(4), pp. 793-804. https://doi.org/10.1002/acp.3970
Tracking the relations between children’s reading and emotional health across time : Evidence from four large longitudinal studies
McArthur, Genevieve, Badcock, Nicholas, Castles, Anne and Robidoux, Serje. (2022). Tracking the relations between children’s reading and emotional health across time : Evidence from four large longitudinal studies. Reading Research Quarterly. 57(2), pp. 555-585. https://doi.org/10.1002/rrq.426
The effect of an integrated reading and anxiety intervention for poor readers with anxiety
Francis, Deanna, Hudson, Jennifer L., Kohnen, Saskia, Mobach, Lynn and McArthur, Genevieve M.. (2021). The effect of an integrated reading and anxiety intervention for poor readers with anxiety. PeerJ. 9, p. Article e10987. https://doi.org/10.7717/peerj.10987
Videoconferencing interventions for children with reading and spelling difficulties : A pilot study
Kohnen, Saskia, Banales, Erin and McArthur, Genevieve. (2021). Videoconferencing interventions for children with reading and spelling difficulties : A pilot study. Telemedicine and e-health. 27(5), pp. 537-543. https://doi.org/10.1089/tmj.2020.0061
Profiling the word reading abilities of school-age children with neurofibromatosis type 1
Arnold, Shelley, Payne, Jonathan, McArthur, Genevieve, North, Kathryn and Barton, Belinda. (2021). Profiling the word reading abilities of school-age children with neurofibromatosis type 1. Journal of the International Neuropsychological Society. 27(5), pp. 484-496. https://doi.org/10.1017/S135561772000106X
A validation of Emotiv EPOC Flex saline for EEG and ERP research
Williams, Nikolas S., McArthur, Genevieve, de Wit, Bianca, Ibrahim, George and Badcock, N. A.. (2020). A validation of Emotiv EPOC Flex saline for EEG and ERP research. PeerJ. 8, p. Article e9713. https://doi.org/10.7717/peerj.9713
Self-concept in poor readers : A systematic review and meta-analysis
McArthur, Genevieve M., Filardi, Nicola, Francis, Deanna A., Boyes, Mark E. and Badcock, Nicholas A.. (2020). Self-concept in poor readers : A systematic review and meta-analysis. PeerJ. 8, p. Article e8772. https://doi.org/10.7717/peerj.8772
Children's knowledge of single- and multiple-letter grapheme-phoneme correspondences : An exploratory study
Larsen, Linda, Schauber, Stefan Kilian, Kohnen, Saskia, Nickels, Lyndsey and McArthur, Genevieve. (2020). Children's knowledge of single- and multiple-letter grapheme-phoneme correspondences : An exploratory study. Early Childhood Research Quarterly. 51, pp. 379-391. https://doi.org/10.1016/j.ecresq.2019.12.001
The effect of non-communicative eye movements on joint attention
Caruana, Nathan, Alhasan, Ayeh, Wagner, Kirilee, Kaplan, David M., Woolgar, Alexandra and McArthur, Genevieve. (2020). The effect of non-communicative eye movements on joint attention. Quarterly Journal of Experimental Psychology. 73(12), pp. 2389-2402. https://doi.org/10.1177/1747021820945604
The mind minds minds : The effect of intentional stance on the neural encoding of joint attention
Caruana, Nathan and McArthur, Genevieve. (2019). The mind minds minds : The effect of intentional stance on the neural encoding of joint attention. Cognitive, Affective and Behavioral Neuroscience. 19(6), pp. 1479-1491. https://doi.org/10.3758/s13415-019-00734-y
Peripheral preview abolishes N170 face-sensitivity at fixation : Using fixation-related potentials to investigate dynamic face processing
de Lissa, Peter, McArthur, Genevieve, Hawelka, Stefan, Palermo, Romina, Mahajan, Yatin, Degno, Federica and Hutzler, Florian. (2019). Peripheral preview abolishes N170 face-sensitivity at fixation : Using fixation-related potentials to investigate dynamic face processing. Visual Cognition. 27(9-10), pp. 740-759. https://doi.org/10.1080/13506285.2019.1676855
The association between poor reading and internalising problems : A systematic review and meta-analysis
Francis, Deanna A., Caruana, Nathan, Hudson, Jennifer L. and McArthur, Genevieve M.. (2019). The association between poor reading and internalising problems : A systematic review and meta-analysis. Clinical Psychology Review. 67, pp. 45-60. https://doi.org/10.1016/j.cpr.2018.09.002
Syntactic processing in music and language : Effects of interrupting auditory streams with alternating timbres
Fiveash, Anna, Thompson, William Forde, Badcock, Nicholas A. and McArthur, Genevieve. (2018). Syntactic processing in music and language : Effects of interrupting auditory streams with alternating timbres. International Journal of Psychophysiology. 129, pp. 31-40. https://doi.org/10.1016/j.ijpsycho.2018.05.003
Syntactic and non-syntactic sources of interference by music on language processing
Fiveash, Anna, McArthur, Genevieve and Thompson, William Forde. (2018). Syntactic and non-syntactic sources of interference by music on language processing. Scientific Reports. 8(1), p. Article 17918. https://doi.org/10.1038/s41598-018-36076-x
Joint attention difficulties in autistic adults : An interactive eye-tracking study
Caruana, Nathan, Stieglitz Ham, Heidi, Brock, Jon, Woolgar, Alexandra, Kloth, Nadine, Palermo, Romina and McArthur, Genevieve. (2018). Joint attention difficulties in autistic adults : An interactive eye-tracking study. Autism. 22(4), pp. 502-512. https://doi.org/10.1177/1362361316676204
Phonics training for English-speaking poor readers (Review)
McArthur, Genevieve, Eve, Phillipa, Jones, Kristy, Banales, Erin, Kohnen, Saskia, Anandakumar, Thushara, Larsen, Linda, Marinus, Eva, Wang, Hua-Chen and Castles, Anne. (2018). Phonics training for English-speaking poor readers (Review). Cochrane Database of Systematic Reviews. 2018(11), p. Article CD009115. https://doi.org/10.1002/14651858.CD009115.pub3
Variations within a subtype : Developmental surface dyslexias in English
Kohnen, Saskia, Nickels, Lyndsey, Geigis, Leonie, Coltheart, Max, McArthur, Genevieve and Castles, Anne. (2018). Variations within a subtype : Developmental surface dyslexias in English. Cortex. 106, pp. 151-163. https://doi.org/10.1016/j.cortex.2018.04.008
An investigation of grapheme parsing and grapheme-phoneme knowledge in two children with dyslexia
Larsen, Linda, Kohnen, Saskia, McArthur, Genevieve and Nickels, Lyndsey. (2018). An investigation of grapheme parsing and grapheme-phoneme knowledge in two children with dyslexia. Reading and Writing. 31(4), pp. 991-1015. https://doi.org/10.1007/s11145-018-9823-z
No meditation-related changes in the auditory N1 during first-time meditation
Barnes, L. J., McArthur, G. M., Biedermann, B. A., de Lissa, P., Polito, V. and Badcock, N. A.. (2018). No meditation-related changes in the auditory N1 during first-time meditation. International Journal of Psychophysiology. 127, pp. 26-37. https://doi.org/10.1016/j.ijpsycho.2018.03.003
Detecting communicative intent in a computerised test of joint attention
Caruana, Nathan, McArthur, Genevieve, Woolgar, Alexandra and Brock, Jon. (2017). Detecting communicative intent in a computerised test of joint attention. PeerJ. 2017(1), pp. 1-16. https://doi.org/10.7717/peerj.2899
Helping children with reading difficulties : Some things we have learned so far
McArthur, Genevieve and Castles, Anne. (2017). Helping children with reading difficulties : Some things we have learned so far. npj Science of Learning. 2(1), p. Article 7. https://doi.org/10.1038/s41539-017-0008-3
Beliefs about human agency influence the neural processing of gaze during joint attention
Caruana, Nathan, de Lissa, Peter and McArthur, Genevieve. (2017). Beliefs about human agency influence the neural processing of gaze during joint attention. Social Neuroscience. 12(2), pp. 194-206. https://doi.org/10.1080/17470919.2016.1160953
Simulating social interactions for the experimental investigation of joint attention
Caruana, Nathan, McArthur, Genevieve, Woolgar, Alexandra and Brock, Jon. (2017). Simulating social interactions for the experimental investigation of joint attention. Neuroscience and Biobehavioral Reviews. 74, pp. 115-125. https://doi.org/10.1016/j.neubiorev.2016.12.022
Low self-concept in poor readers : Prevalence, heterogeneity, and risk
McArthur, Genevieve, Castles, Anne, Kohnen, Saskia and Banales, Erin. (2016). Low self-concept in poor readers : Prevalence, heterogeneity, and risk. PeerJ. 2016(11), p. Article e2669. https://doi.org/10.7717/peerj.2669
Phonics training improves reading in children with neurofibromatosis type 1 : A prospective intervention trial
Arnold, Shelley S., Barton, Belinda, McArthur, Genevieve, North, Kathryn N. and Payne, Jonathan M.. (2016). Phonics training improves reading in children with neurofibromatosis type 1 : A prospective intervention trial. Journal of Pediatrics. 177, pp. 219-226. https://doi.org/10.1016/j.jpeds.2016.06.037
Meditation and auditory attention : An ERP study of meditators and non-meditators
Biedermann, Britta, de Lissa, Peter, Mahajan, Yatin, Polito, Vince, Badcock, Nicolas, Connors, Michael H., Quinto, Lena, Larsen, Linda and McArthur, Genevieve. (2016). Meditation and auditory attention : An ERP study of meditators and non-meditators. International Journal of Psychophysiology. 109, pp. 63-70. https://doi.org/10.1016/j.ijpsycho.2016.09.016
The relationship between spoken language and speech and nonspeech processing in children with autism : A magnetic event-related field study
Yau, Shu Hui, Brock, Jon and McArthur, Genevieve. (2016). The relationship between spoken language and speech and nonspeech processing in children with autism : A magnetic event-related field study. Developmental Science. 19(5), pp. 834-852. https://doi.org/10.1111/desc.12328