Assessing the Robustness of LLMs in Predicting Supports and Attacks
摘要
In recent years, Large Language Models (LLMs) have shown an impressive capability to exchange natural language with a human user. In this paper, we explore their capacity to construct a support and an attack relation from input arguments. To do so, we propose an evaluation method based on the Twelve Angry Men example. Then, we discuss the results as well as the discrepancy in accuracy among the different models. Finally, we propose future works.