The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals

Skinner, IW; Hübscher, M; Moseley, GL; Lee, H; Wand, BM; Traeger, AC; Gustin, SM; McAuley, JH

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals

Skinner, IW

Hübscher, M Moseley, GL Lee, H Wand, BM Traeger, AC Gustin, SM McAuley, JH

Permalink

Publication Type:: Journal Article
Citation:: Behavior Research Methods, 2018, 50 (5), pp. 1778 - 1792
Issue Date:: 2018-10-01

Closed Access

	Filename	Description	Size
	Skinner-2017-The reliability of eyetracking to.pdf	Published Version	780.77 kB	Adobe PDF	View/Open
	Green Copy.pdf	Accepted Manuscript Version	297.19 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Skinner, IW https://orcid.org/0000-0003-3288-0519	en_US
dc.contributor.author	Hübscher, M	en_US
dc.contributor.author	Moseley, GL	en_US
dc.contributor.author	Lee, H	en_US
dc.contributor.author	Wand, BM	en_US
dc.contributor.author	Traeger, AC	en_US
dc.contributor.author	Gustin, SM	en_US
dc.contributor.author	McAuley, JH	en_US
dc.date.issued	2018-10-01	en_US
dc.identifier.citation	Behavior Research Methods, 2018, 50 (5), pp. 1778 - 1792	en_US
dc.identifier.issn	1554-351X	en_US
dc.identifier.uri	http://hdl.handle.net/10453/115831
dc.description.abstract	© 2017, Psychonomic Society, Inc. Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test–retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test–retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability (ICC >.70 indicates adequate reliability). The ICCs(2, 1) ranged from –.31 to.71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test–retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α >.93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.	en_US
dc.relation.ispartof	Behavior Research Methods	en_US
dc.relation.isbasedon	10.3758/s13428-017-0946-y	en_US
dc.subject.classification	Experimental Psychology	en_US
dc.subject.mesh	Humans	en_US
dc.subject.mesh	Reproducibility of Results	en_US
dc.subject.mesh	Attention	en_US
dc.subject.mesh	Behavioral Research	en_US
dc.subject.mesh	Reading	en_US
dc.subject.mesh	Vocabulary	en_US
dc.subject.mesh	Adult	en_US
dc.subject.mesh	Female	en_US
dc.subject.mesh	Male	en_US
dc.subject.mesh	Eye Movement Measurements	en_US
dc.subject.mesh	Signal Detection, Psychological	en_US
dc.subject.mesh	Attentional Bias	en_US
dc.title	The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals	en_US
dc.type	Journal Article
utslib.citation.volume	5	en_US
utslib.citation.volume	50	en_US
utslib.for	0801 Artificial Intelligence and Image Processing	en_US
utslib.for	1702 Cognitive Sciences	en_US
utslib.for	1701 Psychology	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Graduate School of Health
utslib.copyright.status	closed_access
pubs.issue	5	en_US
pubs.publication-status	Published	en_US
pubs.volume	50	en_US

Abstract:

© 2017, Psychonomic Society, Inc. Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test–retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test–retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability (ICC >.70 indicates adequate reliability). The ICCs(2, 1) ranged from –.31 to.71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test–retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α >.93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/115831