Friday, 11 September 2020
Neatly avoiding the very real conflict and the differing facts of comprehension when captions are in use, both by learners and monoglot signers.
A recent study has shown that readers' eye gaze behaviors are strong indicators of words that are unexpected, new, or difficult to understand. The study by Rain Bosworth, an assistant professor and researcher in the Center for Sensory, Perceptual, and Cognitive Ecology (SPaCE Center) at Rochester Institute of Technology's National Technical Institute for the Deaf, explores the unknown qualities of gaze behavior for "sign watching" and how these are affected by a user's language expertise and intelligibility of the sign input.
According to Bosworth's study, published in the Journal of Deaf Studies and Deaf Education, with NTID graduate Adam Stone, gaze behaviors can provide an index of cognitive effort and knowledge in signers. This study provides the first evidence that novice and fluent signers have different eye gaze behaviors. Bosworth and her team recorded gaze behaviors in 52 deaf and hearing adults while they watched signed narratives. Highly fluent signers primarily kept a steady gaze on the face and used peripheral vision to perceive the signers' moving hands. The researchers then showed the participants videos of signed stories played backwards.
Bosworth said that people who learned American Sign Language earlier in life are better equipped to understand difficult video-reversed narratives. Fluent signers tended to focus strongly on the face when sign watching, even for low intelligibility conditions. "These low intelligibility conditions simulate what happens in real-world settings when trying to watch live signers on phones with small displays or with weak internet signals," explained Bosworth. Novice signers, who scored lower on measures of story comprehension, showed a very different gaze pattern.