Suicide is a major health and social problem worldwide; and, therefore, family members and friends of people who have suicidal ideation, or just people seeking for information, require a simple access to reliable and useful sources of information about suicide. This information can be provided by means of chatbot tools; however, the reliability and topicality of the chatbots’ answers should be ensured. In order to reach that goal, it is necessary to have datasets that are able to provide a ground truth for a proper evaluation, as well as contain reliable and unbiased information for the purpose of fine-tuning these chatbots. In this work, we present the creation of three question-answering datasets about suicide in Spanish and the methodology followed in their creation. In particular, we have created three datasets with three quality levels: bronze, automatically generated; silver, derived from bronze but verified by professionals; and gold, manually generated by professionals. This is a first step towards building reliable chatbots that answer questions about suicide; and, additionally, it can serve as a basis for other contexts where it is necessary to access to verified and reliable information.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Methodology to Build Spanish Trustworthy Question-Answer Datasets for Suicide Information

  • Pablo Ascorbe,
  • María S. Campos,
  • César Domínguez,
  • Jónathan Heras,
  • Magdalena Pérez,
  • Ana Rosa Terroba-Reinares

摘要

Suicide is a major health and social problem worldwide; and, therefore, family members and friends of people who have suicidal ideation, or just people seeking for information, require a simple access to reliable and useful sources of information about suicide. This information can be provided by means of chatbot tools; however, the reliability and topicality of the chatbots’ answers should be ensured. In order to reach that goal, it is necessary to have datasets that are able to provide a ground truth for a proper evaluation, as well as contain reliable and unbiased information for the purpose of fine-tuning these chatbots. In this work, we present the creation of three question-answering datasets about suicide in Spanish and the methodology followed in their creation. In particular, we have created three datasets with three quality levels: bronze, automatically generated; silver, derived from bronze but verified by professionals; and gold, manually generated by professionals. This is a first step towards building reliable chatbots that answer questions about suicide; and, additionally, it can serve as a basis for other contexts where it is necessary to access to verified and reliable information.