In a document, Different Graphical elements can be recognized by technologies like Optical Character Recognition (OCR) and Optical Mark Recognition (OMR). While OCR is meant to detect and identify text regions, OMR is mainly used to detect and identify selection markings like ticks, bubbles, or checkmarks. Though OCR and OMR technologies have advanced significantly in recent years, further research is required to determine how selection marks relate to text in order to improve OCR’s capabilities. In this study, we present a novel method to associate the relevant text detected by OCR with the selection marks identified by OMR. To identify text components and selection marks from a document image, we employ an OCR pipeline (OCR with OMR capability). Next, using the structure of the graph network as a guide, we construct the selection mark to text association as an optimization problem and use bipartite network algorithms to match the selection marks with their associated text. Our proposed method correctly connects selection marks with their corresponding text in a variety of document types across different domains, according to experimental results. Our analysis of ten different document types from various industry domains yielded an average F1-score of 95.95%. Our suggested method can be combined with any OCR pipeline to improve its performance without adding to its complexity. This could lead to a rise in office automation and Robotic Process Automation (RPA) for tasks involving document processing.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Bipartite Graph Approach to Linking Selection Marks and Text

  • Amit Agarwal,
  • Srikant Panda,
  • Kulbhushan Pachauri

摘要

In a document, Different Graphical elements can be recognized by technologies like Optical Character Recognition (OCR) and Optical Mark Recognition (OMR). While OCR is meant to detect and identify text regions, OMR is mainly used to detect and identify selection markings like ticks, bubbles, or checkmarks. Though OCR and OMR technologies have advanced significantly in recent years, further research is required to determine how selection marks relate to text in order to improve OCR’s capabilities. In this study, we present a novel method to associate the relevant text detected by OCR with the selection marks identified by OMR. To identify text components and selection marks from a document image, we employ an OCR pipeline (OCR with OMR capability). Next, using the structure of the graph network as a guide, we construct the selection mark to text association as an optimization problem and use bipartite network algorithms to match the selection marks with their associated text. Our proposed method correctly connects selection marks with their corresponding text in a variety of document types across different domains, according to experimental results. Our analysis of ten different document types from various industry domains yielded an average F1-score of 95.95%. Our suggested method can be combined with any OCR pipeline to improve its performance without adding to its complexity. This could lead to a rise in office automation and Robotic Process Automation (RPA) for tasks involving document processing.