Due to the emergence of powerful Large Language Models (LLMs), many open-domain generative educational chatbots have evolved in the past few years, with many more to be expected as best practices and reliable methods emerge. In this paper, we consider a particular best practice that has not received much attention yet: the handling of student questions that are sensitive, politically inappropriate, or contain vulgar language. Although handling such questions wrong can have negative consequences and decrease the trust of users, parents, and teachers, our survey of papers introducing open-domain chatbots reveals that only a small percentage of papers consider them explicitly. In our survey (N = 55 papers), we make a case for why this problem should receive more attention, how it is currently being handled, and which steps future research should take. Moreover, our survey is, to the best of our knowledge, the most complete one considering only open-domain chatbots.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Where’s the F***ing Filter? A Survey on Handling Problematic and Sensitive Questions in Open Educational Chatbots

  • Thilo I. Dieing,
  • Lea Cohausz

摘要

Due to the emergence of powerful Large Language Models (LLMs), many open-domain generative educational chatbots have evolved in the past few years, with many more to be expected as best practices and reliable methods emerge. In this paper, we consider a particular best practice that has not received much attention yet: the handling of student questions that are sensitive, politically inappropriate, or contain vulgar language. Although handling such questions wrong can have negative consequences and decrease the trust of users, parents, and teachers, our survey of papers introducing open-domain chatbots reveals that only a small percentage of papers consider them explicitly. In our survey (N = 55 papers), we make a case for why this problem should receive more attention, how it is currently being handled, and which steps future research should take. Moreover, our survey is, to the best of our knowledge, the most complete one considering only open-domain chatbots.