Evaluating LLM Performance in TRIZ-Based System Forecasting: A Study Using 9-Windows
摘要
Large language models (LLMs) show promise for structured foresight tasks but struggle with coherence and methodological consistency. This study assesses seven LLMs in generating TRIZ system operator tools (SOTs) across five systems and three prompt types. Performance drops in complex or vague contexts, especially in trend and supersystem areas. Expert reviews and semantic metrics show that breaking down prompts improves output quality. Findings suggest current LLMs need human–AI collaboration and tailored prompting for advanced foresight.