The Evaluation of the LLM-Based Chatbot Application on Chinese Learning
摘要
SLA is very important to improve the intercommunication among the people from different cultural regions. For the individual, SLA can effectively expand the individual social circle. The real-time interaction practice is still important to SLA. But relative to the number of students, the teachers or assistants are usually not enough to support the real-time interaction practices. In this chapter, we proposed a study about evaluating the availability and effectiveness of the LLM-based chatbot applying on the SLA. This study focused on the Chinese learning for the non-native students. We design an application scenario of real-time interaction practice by the Bing Chat based on the Microsoft Large Language Model (LLM). And our results show that the LLM-based chatbot, which partially replace the teacher to perform one-to-one on-line real-time interaction practice, is with effectiveness and availability to some degree in SLA. On the other hand, the results show the improvements of LLM-based chatbot are still needed for SLA purpose.