This study explores paraphrase identification for the Tamil language across various domains, including medicine, agriculture, and education, using SBert-based models. A unique dataset was compiled from Tamil standard newspapers, with sentence pairs manually labeled as paraphrase (1) or non-paraphrase (0) to ensure precise and domain-specific classification. Fine-tuning the SBert models on this dataset demonstrated enhanced performance, achieving accuracy levels between 70% and 80%. This research highlights the efficiency of transformer-based models and human-annotated datasets in paraphrase identification for Tamil, a highly agglutinative language. The findings contribute to advancing the understanding of natural languages, particularly complex forms such as Tamil.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Domain-Specific Paraphrase Identification for Tamil Using SBert Models

  • S. Mahalakshmi,
  • J. Felicia Lilian

摘要

This study explores paraphrase identification for the Tamil language across various domains, including medicine, agriculture, and education, using SBert-based models. A unique dataset was compiled from Tamil standard newspapers, with sentence pairs manually labeled as paraphrase (1) or non-paraphrase (0) to ensure precise and domain-specific classification. Fine-tuning the SBert models on this dataset demonstrated enhanced performance, achieving accuracy levels between 70% and 80%. This research highlights the efficiency of transformer-based models and human-annotated datasets in paraphrase identification for Tamil, a highly agglutinative language. The findings contribute to advancing the understanding of natural languages, particularly complex forms such as Tamil.