Transformer-Based Models for Predicting High-Risk Diabetes in Women Using Tabular Data
摘要
Diabetes can lead to several long-term severe health complications; more than 199 million women are affected by diabetes, with projections indicating a rise to 313 million by 2040. Feature Tokenizer Transformer (FT-Transformer) is proposed to predict diabetes in 1858 women and evaluate its performance with Tabnet, XGboost, RF, and LR. SHAP and LIME methods are used for interpreting FT-Transformer’s performance. FT - Transformer achieved 93.54%, RF (97.31%), XGboost and Tabnet (96.5%), LR (77.42%). FT - Transformer costs more computationally than others; however, it can potentially apply for disease prediction and classification with features containing (text, image, and tabular data) in the medical field. Through SHAP and LIMEthod, an interactive relationship between glucose and pregnancy features in contributing to diabetes prediction was found; glucose is the most predictor of diabetes.