Leveraging Transformer Models for Abstractive Summarization of Hindi Text
摘要
Abstractive text summarization in Hindi using transformer models is an important solution to the need to get concise summaries coherent in vernacular languages. The study exploits the advanced capabilities of the transformer models in handling long-range dependencies and understanding contextual information in generating summaries, capturing the essential inputs from the original texts, yet maintaining linguistic and cultural nuances. It is trained on the Aaj Tak and Kaggle datasets; a lot of preprocessing steps are applied to the data to clean and normalize the text. Moreover, FastText embeddings are used to let the model know the structure of Hindi text. Moreover, some key elements of the transformer architecture—positional encoding, multi-headed attention, and masking techniques—will also be applied in its methodology for proposed abstraction, important in modelling the contextual nuances necessary for effective summarization. The performance of the model was measured using the ROUGE score, proving its effectiveness in generating an accurate and coherent summary. Results are much better, proving the potential of transformer-based models in improving the quality and accessibility of Hindi text summarization for enhanced comprehension and information retrieval.