Congruency between semiotic systems: A study on words and graphs with the use of eye tracker

Cristóbal Julio; Giovanni Parodi; Óscar Loureda

Keywords: eye tracking, multimodality, multimodalidad, Monetary Policy Report, comprensi?n multisemi?tica, Informe de Pol?tica Monetaria, gr?ficos de l?neas, multisemiotic comprehension, line charts

Abstract

In the present study we seek to determine if the congruence/non-congruence between two semiotic systems is a factor that affects the reading patterns of a group of students in the area of economics. Specifically, we are interested in identifying reading routes that reveal whether readers identify the incongruence between two semiotic systems: the verbal system and the graph system. To achieve this objective, eye movements were recorded from 16 students in the economics area of a Chilean university, employing an eye tracker. The texts read by the students were constructed from specific rhetorical textual segments of the discourse genre Monetary Policy Report (IPoM). The general results indicate that: 1) readers process all texts with equal attention without the factor congruence between semiotic systems revealing statistically significant differences, 2) no differences were observed in the integrative transitions between congruency and non-congruency, and 3) the verbal system of the texts is processed mainly, both in the dependent variables time of the first reading (first pass) and time of the second reading (second pass). These findings can be explained in terms of certain logocentrism or preeminence of the words, even though, as students of the economics area, the students have received instruction in the reading of graphs.

Más información

Título según WOS: Congruency between semiotic systems: A study on words and graphs with the use of eye tracker
Título según SCOPUS: Congruency between semiotic systems: A study on words and graphs with the use of eye tracker [Congruencia entre sistemas semióticos: Estudio de palabras y gráficos con el uso de eye tracker]
Título según SCIELO: Congruencia entre sistemas semi�ticos: estudio de palabras y gr�ficos con el uso de eye tracker
Título de la Revista: ESTUDIOS FILOLOGICOS
Número: 63
Editorial: UNIV AUSTRAL CHILE
Fecha de publicación: 2019
Página de inicio: 237
Página final: 259
Idioma: Spanish
DOI:

10.4067/S0071-17132019000100237

Notas: ISI, SCIELO, SCOPUS