A Study on AI Model Identification Based on Ability Differences: An Initial Approach Using Semantic Understanding Ability
摘要
As AI models become central to societal functions, they inevitably attract the attention of malicious actors, resulting in the proliferation of counterfeit AI models. Therefore, identity verification, similar to user recognition, is essential for AI models. However, owing to probabilistic variability in outputs, particularly in large language models (LLMs), and continuous ability enhancement through autonomous learning, the typical user recognition method of enrolling and presenting the same information cannot be directly applied. To address these issues, this study proposes identifying AI models by “assessing the abilities of AI models.” The identification method based on this concept is called the Completely Automated Public Test to Tell Ability of Artificial Intelligence (CAPT-AI). To examine the feasibility of our proposed method, we conduct a preliminary study focusing on LLMs, serving as a foundational experiment for CAPT-AI.