The expansion of AI and Data Science has led to a higher demand for data science related professionals. This surge has created a need to identify the knowledge, skills, and tools required for these roles. This paper proposes a data-driven approach that employs classification models to analyze job postings and extract key competencies. The analysis is based on data from the Polish job market. The methodology involves feature selection using a large language model to extract keywords representing skills, tools, and knowledge from job advertisements. A neural network classifier is then trained to predict job titles based on these features. Feature importance analysis, utilizing permutation importance, is conducted to identify the most influential factors in the classification. The findings from weight magnitude analysis and occlusion sensitivity analysis provide insights into the distinct characteristics of Data Analyst, Data Engineer, and Data Scientist roles as reflected in job postings. The analysis reveals the core competency requirements for each job position, contributing to a clearer understanding of the evolving demands within the data science field.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Extracting Key Features from Data Science Related Job Offers: A Data-Driven Approach

  • Artur Skoczylas,
  • Agnieszka Rosa,
  • Ryszard Zygała,
  • Wiesława Gryncewicz

摘要

The expansion of AI and Data Science has led to a higher demand for data science related professionals. This surge has created a need to identify the knowledge, skills, and tools required for these roles. This paper proposes a data-driven approach that employs classification models to analyze job postings and extract key competencies. The analysis is based on data from the Polish job market. The methodology involves feature selection using a large language model to extract keywords representing skills, tools, and knowledge from job advertisements. A neural network classifier is then trained to predict job titles based on these features. Feature importance analysis, utilizing permutation importance, is conducted to identify the most influential factors in the classification. The findings from weight magnitude analysis and occlusion sensitivity analysis provide insights into the distinct characteristics of Data Analyst, Data Engineer, and Data Scientist roles as reflected in job postings. The analysis reveals the core competency requirements for each job position, contributing to a clearer understanding of the evolving demands within the data science field.