Does the Response Options Placement Provide Clues to the Correct Answers in Multiple-choice Tests? A Systematic Review

Lions, Severin; Monsalve, Carlos; Dartnell, Pablo; Blanco, Maria Paz; Ortega, Gabriel; Lemarie, Julie

Abstract

Multiple-choice tests are widely used in education, often for high-stakes assessment purposes. Consequently, these tests should be constructed following the highest standards. Many efforts have been undertaken to advance item-writing guidelines intended to improve tests. One important issue is the unwanted effects of the options' position on test outcomes. Any possible effects should be controlled through an adequate response options placement strategy. However, literature is not straightforward about how test developers arrange options. Therefore, this research synthesis systematically reviewed studies examining adherence to options placement guidelines. Relevant item features, such as the item source (standardized or teacher-made tests) and the number of options were considered. Results show that answer keys' distribution across tests is often biased, which might provide examinees with clues to select correct options. Findings also show that options are not always arranged in a "logical" fashion (numerically, alphabetically horizontal ellipsis ) despite being suited to be so arranged. The reasons underlying non-adherence to options placement guidelines are discussed, as is the appropriateness of observed response options placement strategies. Suggestions are provided to help developers better arrange items options.

Más información

Título según WOS: Does the Response Options Placement Provide Clues to the Correct Answers in Multiple-choice Tests? A Systematic Review
Título de la Revista: APPLIED MEASUREMENT IN EDUCATION
Volumen: 35
Número: 2
Editorial: ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD
Fecha de publicación: 2022
Página de inicio: 133
Página final: 152
DOI:

10.1080/08957347.2022.2067539

Notas: ISI