Validation of a Bebras-Based Test to Assess Computational Thinking Abilities in First-Year College Students

Meza, Federico; Vásquez, Andrea; San Martin, Daniel

Keywords: validation, assessment, computational thinking, bebras

Abstract

The lack of clarity about the definition of Computational Thinking (CT) undermines its assessment and the formulation of effective learning strategies for its development. We propose an assessment tool in Spanish, designed by carefully selecting Bebras tasks, to measure four specific CT skills in first-year university students with no prior programming experience. The test was validated with a sample of 980 students from a Latin American university. We found a high, positive correlation between test results and Math test results from the National University Selection System, and a medium, positive correlation between test results and grades from the midterm exam in a Programming course. An acceptable level of internal consistency was found (Cronbach's alpha=0.70). We examined the validity of the test using Classical Test Theory. One question showed poor discrimination potential. Its elimination from the test increased the internal consistency, so we propose to replace it.

Más información

Título según SCOPUS: ID SCOPUS_ID:85189157650 Not found in local SCOPUS DB
Título de la Revista: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2
Editorial: ACM
Fecha de publicación: 2024
Página de inicio: 1750
Página final: 1751
Idioma: English
DOI:

10.1145/3626253.3635523

Notas: SCOPUS - SCOPUS