Exploratory Data Analysis (EDA) is a critical, yet time-consuming, and labor-intensive process, especially for novice analysts who face a steep learning curve due to the high barrier to coding. Large Language Models (LLMs) have shown promise in reducing these challenges by enabling automatic chart generation and insight discovery through natural language interfaces. However, automating too much of the EDA process risks removing the analyst from the loop, leading to misaligned insights and diminished analyst independent thinking. This paper introduces InsightLab, an interactive system that streamlines the EDA process by integrating its key stages into a cohesive workflow. InsightLab uses a modular approach that balances automation and human control, offering three workflows with varying levels of AI assistance. A between-subjects study with 27 participants revealed that each workflow creates different effectiveness patterns based on user expertise. Automation-focused tools efficiently handle routine tasks but provide limited assistance for insight generation, prompt-driven interfaces enhance analytical thinking among experienced users while overwhelming beginners, and more generative systems serve both novices and experts effectively, but risk reducing analytical engagement. These results highlight the importance of adaptive design in AI-assisted analytical tools.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

InsightLab: A Lower-Barrier EDA Workflow Using LLMs for Insight Discovery

  • Allaine Ricci Tan,
  • Lorenzo Gerard Pangan,
  • Richelle Ann Juayong

摘要

Exploratory Data Analysis (EDA) is a critical, yet time-consuming, and labor-intensive process, especially for novice analysts who face a steep learning curve due to the high barrier to coding. Large Language Models (LLMs) have shown promise in reducing these challenges by enabling automatic chart generation and insight discovery through natural language interfaces. However, automating too much of the EDA process risks removing the analyst from the loop, leading to misaligned insights and diminished analyst independent thinking. This paper introduces InsightLab, an interactive system that streamlines the EDA process by integrating its key stages into a cohesive workflow. InsightLab uses a modular approach that balances automation and human control, offering three workflows with varying levels of AI assistance. A between-subjects study with 27 participants revealed that each workflow creates different effectiveness patterns based on user expertise. Automation-focused tools efficiently handle routine tasks but provide limited assistance for insight generation, prompt-driven interfaces enhance analytical thinking among experienced users while overwhelming beginners, and more generative systems serve both novices and experts effectively, but risk reducing analytical engagement. These results highlight the importance of adaptive design in AI-assisted analytical tools.