Few-Shot Learning for Syndrome Differentiation with Two Prompts
摘要
Currently, the majority of approaches to syndrome differentiation in Traditional Chinese Medicine (TCM) conceptualize this endeavor as a text classification challenge. The state-of-the-art technique in text classification is the few-shot fine-tuning approach grounded in large language models. This approach minimizes the need for extensive manual annotation while yielding remarkable classification outcomes with a limited number of labeled samples. In this paper, we propose a few-shot fine-tuning approach that integrates two distinct types of prompts tailored for the syndrome differentiation task. One type of prompt directly inquires about the syndrome type, while the other indirectly seeks to infer the syndrome type. Specifically, our approach initially adopts the prefix-tuning approach, which utilizes two prefix vectors to combine these two types of prompts. Subsequently, we fine-tune the prefix-related parameters and combine the results from the two prefix fine-tunings to generate the final output. Experimental results demonstrate the superiority of our proposed approach.