Extracting information from text within images is essential for numerous real-world applications. However, conventional methods often struggle to effectively leverage both text and image to improve accuracy and performance. This research introduces a novel model that overcomes these limitations by integrating graph attention networks, convolutional neural networks, and transformers. The proposed approach constructs detailed graphs from text regions and seamlessly combines image features extracted by convolutional neural networks with text features processed through DistilBERT. Experimental results demonstrate that the proposed model outperforms existing methods, delivering exceptional performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Information Extraction from Scanned Image Using Model Combining Convolution Neural Network and Graph Attention Network

  • Bui Thanh Hung,
  • Ho Vo Hoang Duy

摘要

Extracting information from text within images is essential for numerous real-world applications. However, conventional methods often struggle to effectively leverage both text and image to improve accuracy and performance. This research introduces a novel model that overcomes these limitations by integrating graph attention networks, convolutional neural networks, and transformers. The proposed approach constructs detailed graphs from text regions and seamlessly combines image features extracted by convolutional neural networks with text features processed through DistilBERT. Experimental results demonstrate that the proposed model outperforms existing methods, delivering exceptional performance.