Background <p>Assessment plays a crucial role in medical education providing both measures of student performance and feedback for curriculum improvement. This study evaluates the quality of A-type (single-best-answer) multiple-choice questions (MCQs) used in the Fixed Prosthodontics exams over three academic years (2020–2022) at a Sudanese dental school, using psychometric item analysis.</p> Methods <p>This cross-sectional study (February–April 2023) retrospectively analyzed 155 MCQs administered between 2020 and 2022. Each item was assessed for item-writing flaws (IWFs), difficulty index (DIF: percentage of correct responses), discrimination index (DIS: ability to differentiate between highest and lowest 27% of examinees), and reliability (Cronbach’s alpha). The normality of DIF and DIS data was tested; Spearman’s or Pearson’s correlation was used as appropriate.</p> Results <p>The percentage of items with IWFs was 48% (2020), 42% (2021), and 33% (2022). Mean ± SD of the DIF index values were (75.51 ± 8.47), (72.25 ± 7.93), and (60 ± 11.63). While Mean ± SD of the DIS index values were (0.18 ± 0.17), (0.13 ± 0.16), and (0.21 ± 0.13) respectively. Cronbach’s alpha, coefficients (α) increased from 0.69 (2020) and 0.64 (2021) to 0.76 (2022). There were no significant correlations between DIF and DIS across the three years (<i>p</i> &gt; 0.05).</p> Conclusion <p>Item-writing quality improved from 2020 to 2022, with the proportion of flawed items decreasing and reliability increasing. Most items were easy in 2020 and 2021, with more excellent difficulty in 2022. Discrimination improved but remained suboptimal. There was no significant correlation between difficulty and discrimination indices. Routine psychometric analysis and enhanced faculty training are recommended to maintain assessment standards in dental education.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Psychometric item/question analysis of multiple-choice questions in fixed prosthodontics exam

  • Shaza Mustafa,
  • Omer Eladil Hamid

摘要

Background

Assessment plays a crucial role in medical education providing both measures of student performance and feedback for curriculum improvement. This study evaluates the quality of A-type (single-best-answer) multiple-choice questions (MCQs) used in the Fixed Prosthodontics exams over three academic years (2020–2022) at a Sudanese dental school, using psychometric item analysis.

Methods

This cross-sectional study (February–April 2023) retrospectively analyzed 155 MCQs administered between 2020 and 2022. Each item was assessed for item-writing flaws (IWFs), difficulty index (DIF: percentage of correct responses), discrimination index (DIS: ability to differentiate between highest and lowest 27% of examinees), and reliability (Cronbach’s alpha). The normality of DIF and DIS data was tested; Spearman’s or Pearson’s correlation was used as appropriate.

Results

The percentage of items with IWFs was 48% (2020), 42% (2021), and 33% (2022). Mean ± SD of the DIF index values were (75.51 ± 8.47), (72.25 ± 7.93), and (60 ± 11.63). While Mean ± SD of the DIS index values were (0.18 ± 0.17), (0.13 ± 0.16), and (0.21 ± 0.13) respectively. Cronbach’s alpha, coefficients (α) increased from 0.69 (2020) and 0.64 (2021) to 0.76 (2022). There were no significant correlations between DIF and DIS across the three years (p > 0.05).

Conclusion

Item-writing quality improved from 2020 to 2022, with the proportion of flawed items decreasing and reliability increasing. Most items were easy in 2020 and 2021, with more excellent difficulty in 2022. Discrimination improved but remained suboptimal. There was no significant correlation between difficulty and discrimination indices. Routine psychometric analysis and enhanced faculty training are recommended to maintain assessment standards in dental education.