This chapter explores other methods for Large Language Model (LLM) interaction, focusing on Active Learning, Imitation Learning, Model Surgery, and Interaction Message Fusion. Active Learning is discussed as a method for efficiently selecting and labeling data to enhance model performance, with a focus on query strategies and oracles. Imitation Learning is presented as an approach where models learn by mimicking expert behavior, with applications in both offline and online settings. Model Surgery is introduced as a suite of post-training targeted interventions that enable precise and efficient modification of an LLM’s knowledge or behavior–such as updating, correcting, or removing specific knowledge–without the need for full retraining. This includes techniques like knowledge editing and machine unlearning. The chapter also introduces Interaction Message Fusion, a comprehensive framework for integrating external information into language models, categorized along three dimensions: data, model, and training. Each method is examined for its potential to improve the adaptability and effectiveness of language models in interactive scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Other Methods

  • Zekun Wang,
  • Ge Zhang,
  • Ning Shi,
  • Jie Fu

摘要

This chapter explores other methods for Large Language Model (LLM) interaction, focusing on Active Learning, Imitation Learning, Model Surgery, and Interaction Message Fusion. Active Learning is discussed as a method for efficiently selecting and labeling data to enhance model performance, with a focus on query strategies and oracles. Imitation Learning is presented as an approach where models learn by mimicking expert behavior, with applications in both offline and online settings. Model Surgery is introduced as a suite of post-training targeted interventions that enable precise and efficient modification of an LLM’s knowledge or behavior–such as updating, correcting, or removing specific knowledge–without the need for full retraining. This includes techniques like knowledge editing and machine unlearning. The chapter also introduces Interaction Message Fusion, a comprehensive framework for integrating external information into language models, categorized along three dimensions: data, model, and training. Each method is examined for its potential to improve the adaptability and effectiveness of language models in interactive scenarios.