Natural Language Inference (NLI) represents a foundational task within Natural Language Processing (NLP) that aims to determine the inferential relationship between pairs of sentences. While substantial progress has been made in English through the construction of large-scale, multi-genre resources, Spanish NLI datasets remain limited in both scale and genre diversity, and seldom capture explicit causal relationships. In this work, we introduce ESNLIR, a novel Spanish NLI dataset spanning multiple genres and explicitly annotating causal relationships. Leveraging automated extraction methodologies inspired by existing scientific NLI benchmarks, we construct an enriched corpus and evaluate baseline performance using BERT-based models. Our experimental results indicate that incorporating genre diversity enhances model generalization, and that explicit causal labeling reveals additional challenges for current architectures. ESNLIR aims to provide a new benchmark for Spanish NLI research and supports further investigations into model robustness and the mitigation of annotation artifacts. The complete dataset and code can be found in the following Zenodo repository: https://zenodo.org/records/15002575 .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ESNLIR: Expanding Spanish NLI Benchmarks with Multi-genre and Causal Annotation

  • Johan R. Portela,
  • Nicolás Pérez-Terán,
  • Rubén Manrique

摘要

Natural Language Inference (NLI) represents a foundational task within Natural Language Processing (NLP) that aims to determine the inferential relationship between pairs of sentences. While substantial progress has been made in English through the construction of large-scale, multi-genre resources, Spanish NLI datasets remain limited in both scale and genre diversity, and seldom capture explicit causal relationships. In this work, we introduce ESNLIR, a novel Spanish NLI dataset spanning multiple genres and explicitly annotating causal relationships. Leveraging automated extraction methodologies inspired by existing scientific NLI benchmarks, we construct an enriched corpus and evaluate baseline performance using BERT-based models. Our experimental results indicate that incorporating genre diversity enhances model generalization, and that explicit causal labeling reveals additional challenges for current architectures. ESNLIR aims to provide a new benchmark for Spanish NLI research and supports further investigations into model robustness and the mitigation of annotation artifacts. The complete dataset and code can be found in the following Zenodo repository: https://zenodo.org/records/15002575 .