Scholarlink

<p>This study presents a novel approach to improving quality assurance in the Trends in International Mathematics and Science Study (TIMSS). It utilizes a combination of neural networks and regression analysis to validate country-level achievement scores. Concerns over the integrity of TIMSS test scores necessitate robust quality control methods. The research described here developed and piloted new statistical indicators to identify countries with apparently unusual results, aiming to enhance the efficacy of the TIMSS quality assurance process. The methodology leverages the unique design of TIMSS, which assesses 4th and 8th graders every 4&#xa0;years, to generate model-based predictions for country-level average scores in math and science. The comparison of these predictions against actual results supported the feasibility of this approach. This study also investigated the correlation between large positive residuals and substantial changes in sample quality or population definition. While no strong correlations were found, this investigation contributes valuable insights for future TIMSS assessments.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Rethinking TIMSS quality assurance: utilizing neural network models with regression-based bias mitigation strategies for validating country-level math and science achievement scores

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年8月14日

查看全文
  • Henry Isaiah Braun,
  • Matthias von Davier,
  • Jihang Chen

摘要

This study presents a novel approach to improving quality assurance in the Trends in International Mathematics and Science Study (TIMSS). It utilizes a combination of neural networks and regression analysis to validate country-level achievement scores. Concerns over the integrity of TIMSS test scores necessitate robust quality control methods. The research described here developed and piloted new statistical indicators to identify countries with apparently unusual results, aiming to enhance the efficacy of the TIMSS quality assurance process. The methodology leverages the unique design of TIMSS, which assesses 4th and 8th graders every 4 years, to generate model-based predictions for country-level average scores in math and science. The comparison of these predictions against actual results supported the feasibility of this approach. This study also investigated the correlation between large positive residuals and substantial changes in sample quality or population definition. While no strong correlations were found, this investigation contributes valuable insights for future TIMSS assessments.