Main Parameters of Value (MPVs) are core indicators in the Trends of Engineering System Evolution (TESE) framework, representing the performance attributes that drive technological adoption. Yet, MPVs are often abstract and inconsistently articulated in patent texts, making their automated identification a complex task. This study benchmarks seven AI-powered and traditional approaches for MPV extraction from patent titles and abstracts, including TF-IDF, spaCy NER, KeyBERT with SciBERT, BERT-base, PatentSBERTa, GPT-4, and DeepSeek-R1. Using a semi-automated gold standard aligned with TRIZ/TESE principles, we evaluate these models on a curated USPTO dataset of wound care medical device patents. Results show that instruction-tuned LLMs (GPT-4 and DeepSeek-R1) achieve the highest precision (0.93 +) and F1 scores (0.94), accurately capturing value dimensions with strong contextual awareness. Despite their computational cost, these models outperform others in semantic generalization and MPV diversity. This work illustrates how large language models can power scalable, TESE-compliant analysis for strategic foresight in medical innovation and calls for developing cost-effective alternatives that replicate their accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

AI-Powered Identification of Main Parameters of Value (MPVs) for Trends of Engineering System Evolution (TESE): Benchmarking Language Models on Wound Care Medical Device Patents

  • Mostafa Ghane,
  • Denis Cavallucci,
  • Nadra Najiha Binti Barakathulla

摘要

Main Parameters of Value (MPVs) are core indicators in the Trends of Engineering System Evolution (TESE) framework, representing the performance attributes that drive technological adoption. Yet, MPVs are often abstract and inconsistently articulated in patent texts, making their automated identification a complex task. This study benchmarks seven AI-powered and traditional approaches for MPV extraction from patent titles and abstracts, including TF-IDF, spaCy NER, KeyBERT with SciBERT, BERT-base, PatentSBERTa, GPT-4, and DeepSeek-R1. Using a semi-automated gold standard aligned with TRIZ/TESE principles, we evaluate these models on a curated USPTO dataset of wound care medical device patents. Results show that instruction-tuned LLMs (GPT-4 and DeepSeek-R1) achieve the highest precision (0.93 +) and F1 scores (0.94), accurately capturing value dimensions with strong contextual awareness. Despite their computational cost, these models outperform others in semantic generalization and MPV diversity. This work illustrates how large language models can power scalable, TESE-compliant analysis for strategic foresight in medical innovation and calls for developing cost-effective alternatives that replicate their accuracy.