Sanskrit, Kannada, and Hindi, as morphologically rich Indian languages, present a significant challenge in NLP due to their complexity and the limited available resources. A critical step in many NLP processes is POS tagging, where each word in a sentence is automatically categorized based on its grammatical function. This work introduces a Hybrid POS tagger specifically designed for Sanskrit, Kannada, and Hindi. The system combines Conditional Random Field (CRF) with the Hidden Markov Model (HMM), allowing it to handle linguistic features that are beyond the capabilities of a traditional HMM-based POS tagger. The assessment of the Hybrid POS tagger has shown high accuracies across the three languages, thus proving to be a reliable tagger for higher level NLP tasks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hybrid Parts of Speech Tagger For Morphologically Rich Languages

  • N. Anitha,
  • S. N. Shreyas,
  • Tejas Kodoor,
  • S. Vishnu

摘要

Sanskrit, Kannada, and Hindi, as morphologically rich Indian languages, present a significant challenge in NLP due to their complexity and the limited available resources. A critical step in many NLP processes is POS tagging, where each word in a sentence is automatically categorized based on its grammatical function. This work introduces a Hybrid POS tagger specifically designed for Sanskrit, Kannada, and Hindi. The system combines Conditional Random Field (CRF) with the Hidden Markov Model (HMM), allowing it to handle linguistic features that are beyond the capabilities of a traditional HMM-based POS tagger. The assessment of the Hybrid POS tagger has shown high accuracies across the three languages, thus proving to be a reliable tagger for higher level NLP tasks.