Table detection recognizes and accurately determines the position of tables within document images. This task involves both classification and precise localization of these table elements. Conventional table detection methods usually depend on extensive labeled data, creating a challenge in generating high-quality labels for training. To address this, many semi-supervised approaches are proposed. These methods utilize either CNN-based networks, which rely on anchor generation and NMS (Non-Maximum Suppression), or employ transformer-based models with performance linked to the quality of object queries. In this paper, we propose a transformer-based semi-supervised approach that improves the quality of object queries. We take high-level query features from unlabeled images and find similarities with decoder original queries by an enhanced query selection network. It provides high-quality, refined queries, allowing the model to make precise predictions or classifications with minimal labeled data. Results on benchmarks such as Publaynet, DocBank, PubTables, and ICDAR 19 have demonstrated that this innovative approach significantly outperforms traditional supervised and semi-supervised methods. On just 1% label data, our approach obtains 98.1% mAP, 96.4% mAP, and 82.8% mAP on PubTables, PubLayNet, and DocBank datasets, respectively. The state-of-the-art results show the effectiveness of our approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SemiTabDETR: End-to-End Semi-supervised Table Detection with Transformer-Based Enhanced Query Approach

  • Tahira Shehzadi,
  • Didier Stricker,
  • Muhammad Zeshan Afzal

摘要

Table detection recognizes and accurately determines the position of tables within document images. This task involves both classification and precise localization of these table elements. Conventional table detection methods usually depend on extensive labeled data, creating a challenge in generating high-quality labels for training. To address this, many semi-supervised approaches are proposed. These methods utilize either CNN-based networks, which rely on anchor generation and NMS (Non-Maximum Suppression), or employ transformer-based models with performance linked to the quality of object queries. In this paper, we propose a transformer-based semi-supervised approach that improves the quality of object queries. We take high-level query features from unlabeled images and find similarities with decoder original queries by an enhanced query selection network. It provides high-quality, refined queries, allowing the model to make precise predictions or classifications with minimal labeled data. Results on benchmarks such as Publaynet, DocBank, PubTables, and ICDAR 19 have demonstrated that this innovative approach significantly outperforms traditional supervised and semi-supervised methods. On just 1% label data, our approach obtains 98.1% mAP, 96.4% mAP, and 82.8% mAP on PubTables, PubLayNet, and DocBank datasets, respectively. The state-of-the-art results show the effectiveness of our approach.