How Large Language Models Work
摘要
This question describes Large Language Models (such as ChatGPT). It includes a discussion of how they work and the kind of information they use (and that they ignore) in writing texts. It further discusses the kinds of errors is likely to make and how they affect the evaluation and use of LLM-written documents. In particular, we argue that LLMs do not answer questions, they just produce documents that look like answers to the question.