<p>Multilingual Neural Machine Translation (MNMT) plays a vital role in extending language technologies to underrepresented and linguistically diverse regions. However, existing MNMT systems remain largely opaque, particularly when applied to structurally diverse and low-resource languages such as those of Northeast India. In this study, we propose an explainable MNMT framework tailored for bidirectional translation between English and six low-resource Indic languages—Assamese, Bodo, Khasi, Manipuri, Mizo, and Nepali—spanning Indo-Aryan, Tibeto-Burman, and Austroasiatic families. Our architecture employs a Transformer backbone augmented with language-conditioned adapter modules and sparsely activated Mixture-of-Experts (MoE) layers, enabling parameter sharing across languages while preserving family-specific specialization. The model was trained on curated parallel corpora with back-translation augmentation, achieving strong BLEU scores of 29.1 for Assamese and 26.1 for Nepali. To improve transparency, we integrated complementary post-hoc interpretability techniques—attention visualization, SHAP, and LIME—providing token-level and layer-wise explanations of translation decisions. Both quantitative and qualitative analyses show that these interpretability tools effectively diagnose translation challenges, reveal systematic biases, and elucidate failure modes, particularly for data-scarce languages such as Khasi and Mizo. Our results demonstrate that combining adapters, MoE-based specialization, and explainability can advance both the performance and trustworthiness of MNMT for low-resource Indic languages.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Explainable multilingual NMT with adapters and mixture-of-experts: a study on low-resource Indic languages

  • Basab Nath

摘要

Multilingual Neural Machine Translation (MNMT) plays a vital role in extending language technologies to underrepresented and linguistically diverse regions. However, existing MNMT systems remain largely opaque, particularly when applied to structurally diverse and low-resource languages such as those of Northeast India. In this study, we propose an explainable MNMT framework tailored for bidirectional translation between English and six low-resource Indic languages—Assamese, Bodo, Khasi, Manipuri, Mizo, and Nepali—spanning Indo-Aryan, Tibeto-Burman, and Austroasiatic families. Our architecture employs a Transformer backbone augmented with language-conditioned adapter modules and sparsely activated Mixture-of-Experts (MoE) layers, enabling parameter sharing across languages while preserving family-specific specialization. The model was trained on curated parallel corpora with back-translation augmentation, achieving strong BLEU scores of 29.1 for Assamese and 26.1 for Nepali. To improve transparency, we integrated complementary post-hoc interpretability techniques—attention visualization, SHAP, and LIME—providing token-level and layer-wise explanations of translation decisions. Both quantitative and qualitative analyses show that these interpretability tools effectively diagnose translation challenges, reveal systematic biases, and elucidate failure modes, particularly for data-scarce languages such as Khasi and Mizo. Our results demonstrate that combining adapters, MoE-based specialization, and explainability can advance both the performance and trustworthiness of MNMT for low-resource Indic languages.