Skills extraction is crucial for understanding labor market trends and aligning workforce capabilities with industry demands, but existing methods often lack generalizability and struggle with domain-specific skill taxonomy. This research introduces a novel methodology for skills extraction that identifies and maps skills from unstructured text to a predefined skill database or taxonomy. Our approach consists of three key steps: (1) employing BERT-based span extractors to identify skill mentions, (2) using sentence embedding models for semantic mapping to an existing skills taxonomy, and (3) applying a re-ranking model to assess skill importance based on relevance. In addition, we implemented several optimizations to enhance inference speed without compromising performance. Experimental results confirm that our optimized approach improves skills extraction accuracy and processing efficiency across domains, offering a replicable framework for internal taxonomies.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Skills Extraction for Domain-Specific Taxonomy Mapping

  • Yee Sen Tan,
  • Daryl Low,
  • Sarah Toh,
  • Zhaoxia Wang

摘要

Skills extraction is crucial for understanding labor market trends and aligning workforce capabilities with industry demands, but existing methods often lack generalizability and struggle with domain-specific skill taxonomy. This research introduces a novel methodology for skills extraction that identifies and maps skills from unstructured text to a predefined skill database or taxonomy. Our approach consists of three key steps: (1) employing BERT-based span extractors to identify skill mentions, (2) using sentence embedding models for semantic mapping to an existing skills taxonomy, and (3) applying a re-ranking model to assess skill importance based on relevance. In addition, we implemented several optimizations to enhance inference speed without compromising performance. Experimental results confirm that our optimized approach improves skills extraction accuracy and processing efficiency across domains, offering a replicable framework for internal taxonomies.