A Novel Method for Spotting and Recognizing Texts in Odia ChitraKavyas
摘要
ChitraKavya is a fusion of poetry and art, where the poetic text flows within artistic images having architectural forms, geometric shapes, or depictions of living and non-living objects. The characters embedded in complex patterns pose major challenges for automated text recognition. This study focuses on Odia ChitraKavyas and aims to develop a robust method for spotting and recognizing text in such complex artistic layouts.
Methods:We propose a novel ChitraKavya Text Spotting and Recognition Framework (CTSRF), a unified hybrid framework that integrates dataset augmentation, character spotting, and character recognition within a single pipeline. CTSRF combines a Generative Adversarial Network (GAN) based augmentation module with a multi-stage, script-aware character spotting pipeline based on Connected Component Analysis (CCA), Maximally Stable Extremal Regions (MSER), Non-Maximum Suppression (NMS), and Intersection over Union (IoU) refinement. As part of CTSRF, we introduce OdiaOCRNet, a dedicated character recognition model designed for Odia scripts, built on a ConvNeXt backbone and augmented with a Convolutional Block Attention Module (CBAM) to enhance discriminative feature learning for complex Odia character forms. The proposed framework is evaluated against state-of-the-art scene-text detectors and object-detection-based baselines, including YOLO, which are shown to be inadequate for the highly curved and ornamentally embedded text layouts characteristic of ChitraKavyas.
Results:On Odia ChitraKavya images, the proposed CTSRF framework achieves up to 35% higher character-level spotting accuracy than Google Vision, Segment Anything Model, and CRAFT, and improves OCR accuracy by up to 55% over Google Vision. It also outperforms fine-tuned Vision Transformer (ViT-B16), Data-efficient Image Transformer (DeiT), and Class-Attention Image Transformer (CaiT) models by up to 4.5%.
Conclusions:The proposed hybrid framework significantly improves text spotting and recognition in Odia ChitraKavyas. The approach establishes a foundation for OCR in pictorial poem manuscripts and can be extended to other artistic and non-linear text domains.