Human-in-the-loop assessment with AI: implications for teacher education in Ibero-American universities
Keywords: educational technology, teacher training, Digital Competence, pedagogical innovation, ICT integration, artificial intelligence in education
Abstract
This scoping review examines how artificial intelligence (AI) reshapes assessment in Ibero-American higher education and specifies the teacher-training capacities and ethical safeguards needed for responsible adoption. Guided by PRISMA procedures and an eligibility scheme based on PPCDO (PopulationâPhenomenonâContextâDesignâOutcomes), we searched Scopus and screened records (2015â2025; English/Spanish/Portuguese), yielding 76 peer-reviewed studies. Synthesis combined qualitative thematic analysis with quantitative descriptors and an exploratory correlational look at toolâoutcome pairings. Rather than listing generic ICT, we propose a function-by-purpose taxonomy of assessment technologies that distinguishes pre-AI baselines from AI-specific mechanismsâgenerativity, adaptivity, and algorithmic feedback/analytics. Read through this lens, AIâs value emerges when benefits are paired with conditions of use: explainability practices, data stewardship, audit trails, and clearly communicated assistance limits. The review translates these insights into a decision-oriented agenda for teacher education, specifying five competency clusters: (1) feedback literacy with AI (criterion-anchored prompting, sampling and audits, revision-based workflows); (2) rubric/item validation and traceability; (3) data interpretation and fairness; (4) integrity and transparency in AI-involved assessment; and (5) orchestration of platforms and moderation/double-marking when AI assists scoring. Exploratory correlations reinforce these priorities, signaling where training should concentrate. We conclude that Ibero-American systems are technically ready yet pedagogically under-specified: progress depends less on adding tools and more on professionalizing human-in-the-loop assessment within robust governance. The article offers a replicable taxonomy, actionable training targets, and a research agenda on enabling conditions for trustworthy, AI-enhanced assessment. Copyright © 2025 Fajardo-Ramos, Chiappe and Mella-Norambuena.
Más información
| Título según WOS: | Human-in-the-loop assessment with AI: implications for teacher education in Ibero-American universities |
| Título de la Revista: | Frontiers in Education |
| Volumen: | 10 |
| Editorial: | FRONTIERS MEDIA SA |
| Fecha de publicación: | 2025 |
| Idioma: | English |
| DOI: |
10.3389/feduc.2025.1710992 |
| Notas: | ISI |