Viability of Open Source Assistants for Adaptive Learning Systems
摘要
The paper aims to test the viability of a small number of open-source Large Language Models for the role of a live learning assistant integrated into an adaptive learning system. Several models were selected for testing which are based on variants of Meta’s Llama and were fine-tuned by Open-Assistant with high-quality human feedback data. The models were tested against a previous-generation LLM (a variant of GPT2) and a current generation LLM (GPT3.5-Turbo). The quality of the generated text was analyzed, as well as the general performance and running cost. The open-source models were found to be acceptable and had the added advantages of increased control (over a commercial solution) and being available for an on-prem installation, with the notable caveat that they had significantly higher running costs.