Background <p>This study aimed to systematically compare the predictive performance and methodological quality of logistic regression (LR) and machine learning (ML) models for intravenous immunoglobulin (IVIG) resistance in Kawasaki disease (KD) using the PROBAST + AI framework.</p> Methods <p>We searched PubMed, Embase, and Web of Science to identify studies on prediction models for IVIG resistance in KD published between January 1, 2006, and July 31, 2025. We assessed methodological rigour, risk of bias, and applicability using PROBAST + AI. A meta-analysis was performed using random-effects models with logit-transformed area under the receiver operating characteristic curve (AUC) values. Subgroup, sensitivity, and publication bias analyses were additionally conducted.</p> Results <p>We identified 52 eligible studies (40 LR and 12 ML). In external validation, pooled AUCs were similar between ML and LR models (0.76 [95% CI 0.64–0.86] vs. 0.75 [95% CI 0.68–0.81]). In internal validation, ML showed a slightly higher pooled AUC than LR (0.86 [95% CI 0.78–0.92] vs. 0.76 [95% CI 0.72–0.79]), although no statistically significant differences were observed. All studies were judged to be at high risk of bias, mainly due to retrospective single-centre designs, inadequate handling of missing data and continuous predictors, and poor reporting of calibration and clinical utility. No study reported sample size calculations.</p> Conclusions <p>Given the limited external validation and substantial heterogeneity across studies, ML does not consistently outperform LR in predicting IVIG resistance in KD. Future studies should prioritise rigorous external validation and adherence to TRIPOD + AI and PROBAST + AI.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Quality and performance of machine learning versus logistic regression for predicting IVIG resistance in Kawasaki disease: a PROBAST+AI systematic comparison

  • Jiaying Zhang,
  • Difan Wang,
  • Jinfeng Dong,
  • Ying He,
  • Ying Liu,
  • Tingjiao You,
  • Jing Li,
  • Lizhi Li,
  • Xiaodan Wu,
  • Qiuyu Tang,
  • Shurong Ma,
  • Panpan Liu,
  • Haitao Lv,
  • Hongbiao Huang

摘要

Background

This study aimed to systematically compare the predictive performance and methodological quality of logistic regression (LR) and machine learning (ML) models for intravenous immunoglobulin (IVIG) resistance in Kawasaki disease (KD) using the PROBAST + AI framework.

Methods

We searched PubMed, Embase, and Web of Science to identify studies on prediction models for IVIG resistance in KD published between January 1, 2006, and July 31, 2025. We assessed methodological rigour, risk of bias, and applicability using PROBAST + AI. A meta-analysis was performed using random-effects models with logit-transformed area under the receiver operating characteristic curve (AUC) values. Subgroup, sensitivity, and publication bias analyses were additionally conducted.

Results

We identified 52 eligible studies (40 LR and 12 ML). In external validation, pooled AUCs were similar between ML and LR models (0.76 [95% CI 0.64–0.86] vs. 0.75 [95% CI 0.68–0.81]). In internal validation, ML showed a slightly higher pooled AUC than LR (0.86 [95% CI 0.78–0.92] vs. 0.76 [95% CI 0.72–0.79]), although no statistically significant differences were observed. All studies were judged to be at high risk of bias, mainly due to retrospective single-centre designs, inadequate handling of missing data and continuous predictors, and poor reporting of calibration and clinical utility. No study reported sample size calculations.

Conclusions

Given the limited external validation and substantial heterogeneity across studies, ML does not consistently outperform LR in predicting IVIG resistance in KD. Future studies should prioritise rigorous external validation and adherence to TRIPOD + AI and PROBAST + AI.