This study proposes an interpretable machine learning framework using eXplainable AI techniques, specifically LIME and SHAP, to predict and explain code submission outcomes in an online judge system. The framework utilizes the Random Forest, XGBoost, and LightGBM models, achieving a top prediction accuracy of 91.23% with XGBoost. The identified influential factors include memory usage, CPU time, code size, and completion rate. Successful submissions were characterized by efficient memory usage, low CPU time, concise code size, and high completion rates of 80% or above. The integration of LIME and SHAP provides a comprehensive and interpretable approach for optimizing code submissions in online judge systems. This study underscores the importance of interpretability in machine learning applications in educational and software development contexts, offering actionable insights to support users of online judge systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Interpretable Machine Learning for Predicting and Explaining Code Submission Outcomes in an Online Judge System

  • Leonard Chukwualuka Nnadi,
  • Dake Ding,
  • Daniel M. Muepu,
  • Md Faizul Ibne Amin,
  • Raihan Kabir

摘要

This study proposes an interpretable machine learning framework using eXplainable AI techniques, specifically LIME and SHAP, to predict and explain code submission outcomes in an online judge system. The framework utilizes the Random Forest, XGBoost, and LightGBM models, achieving a top prediction accuracy of 91.23% with XGBoost. The identified influential factors include memory usage, CPU time, code size, and completion rate. Successful submissions were characterized by efficient memory usage, low CPU time, concise code size, and high completion rates of 80% or above. The integration of LIME and SHAP provides a comprehensive and interpretable approach for optimizing code submissions in online judge systems. This study underscores the importance of interpretability in machine learning applications in educational and software development contexts, offering actionable insights to support users of online judge systems.