Large Language Models (LLMs) have demonstrated remarkable capabilities in complex reasoning and fact verification tasks, yet their performance remains constrained by inherent uncertainties in multi-step reasoning processes. Although the Multi-Agent Debate (MAD) framework significantly enhances reasoning accuracy through collaborative interactions among agents, these agents often generate divergent answers to the same question, which may inadvertently propagate incorrect responses. In such scenarios, greater priority should be granted to agents that consistently provide accurate answers. To address this challenge, this paper proposes a novel Dynamic Weighted Consensus Framework for LLM Multi-Agent Debate (DWC-MAD). This framework integrates real-time confidence quantification (derived from agents’ iterative responses) and longitudinal accuracy metrics (based on agents’ historical performance). By employing a dynamic weight allocation algorithm, DWC-MAD assigns differentiated weights to agent inputs, thereby constructing an optimized multi-agent debate system.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dynamic Weighted Consensus Framework for LLM Multi-agent Debate

  • Yi Li,
  • Congcong Zhu,
  • MingHao Wang,
  • Mengyang Wu,
  • MingLu Zhu,
  • Xin Hu

摘要

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex reasoning and fact verification tasks, yet their performance remains constrained by inherent uncertainties in multi-step reasoning processes. Although the Multi-Agent Debate (MAD) framework significantly enhances reasoning accuracy through collaborative interactions among agents, these agents often generate divergent answers to the same question, which may inadvertently propagate incorrect responses. In such scenarios, greater priority should be granted to agents that consistently provide accurate answers. To address this challenge, this paper proposes a novel Dynamic Weighted Consensus Framework for LLM Multi-Agent Debate (DWC-MAD). This framework integrates real-time confidence quantification (derived from agents’ iterative responses) and longitudinal accuracy metrics (based on agents’ historical performance). By employing a dynamic weight allocation algorithm, DWC-MAD assigns differentiated weights to agent inputs, thereby constructing an optimized multi-agent debate system.