Humans possess an innate ability to infer others’ intentions from ambiguous utterances based on the observation of contextual cues and past actions. Conversely, machines typically necessitate explicit instructions, thereby increasing the temporal cost of human-AI interaction. To mitigate this, we propose the Intuition Estimation and Knowledge-Based Planning (IEKP) method, which augments human-AI collaboration under ambiguous directives. IEKP encompasses three principal components: 1) Associative Reasoning based Goal Recognition (ARGoal) utilizes large language model to form an initial estimation of human goals and refines this estimation through associative mechanisms; 2) Finite State Machine Guided Decision Pruning (FDPrune) constructs state machines based on task types, pruning illegitimate action outputs to enhance the robustness of language models in long-term decision processes; 3) Knowledge-Enhanced Searching System (K-Search) leverages co-occurrence relationships between objects and environments to improve the agent’s efficiency in environmental searches. Our approach markedly enhances performance on the HandMeThat task, increasing the success rate by 65.42% and the average score by 88.03 compared to previous state-of-the-art methods, even surpassing human performance. This underscores the efficacy of IEKP in advancing human-AI collaboration through superior comprehension and execution of under-specified instructions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Intuition Estimation and Knowledge-Based Planning for Human-AI Collaboration

  • Zihan Ding,
  • Jinyu Chen,
  • Si Liu,
  • Shifeng Zhang

摘要

Humans possess an innate ability to infer others’ intentions from ambiguous utterances based on the observation of contextual cues and past actions. Conversely, machines typically necessitate explicit instructions, thereby increasing the temporal cost of human-AI interaction. To mitigate this, we propose the Intuition Estimation and Knowledge-Based Planning (IEKP) method, which augments human-AI collaboration under ambiguous directives. IEKP encompasses three principal components: 1) Associative Reasoning based Goal Recognition (ARGoal) utilizes large language model to form an initial estimation of human goals and refines this estimation through associative mechanisms; 2) Finite State Machine Guided Decision Pruning (FDPrune) constructs state machines based on task types, pruning illegitimate action outputs to enhance the robustness of language models in long-term decision processes; 3) Knowledge-Enhanced Searching System (K-Search) leverages co-occurrence relationships between objects and environments to improve the agent’s efficiency in environmental searches. Our approach markedly enhances performance on the HandMeThat task, increasing the success rate by 65.42% and the average score by 88.03 compared to previous state-of-the-art methods, even surpassing human performance. This underscores the efficacy of IEKP in advancing human-AI collaboration through superior comprehension and execution of under-specified instructions.