Detecting texts generated by Large Language Models (LLMs) remains highly dependent on the availability of comprehensive training datasets. In response to NLPCC 2025 Shared Task 1, this paper introduces a low-cost yet effective detection system that combines traditional machine learning techniques with GECScore-based grammar correction. Our method demonstrates strong performance across both unseen domains and attacked data, all without the need for data augmentation, achieving an average F1 score of 94.94%. Key features used in our approach include entropy, perplexity, Chinese-English code-switching, special character usage, clause length, repetition, sentiment polarity, and grammar correction. Among the models evaluated, Random Forest emerged as the top performer. The proposed solution is both cost-efficient and resilient, offering reliable detection of LLM-generated content.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LOW-COST-AI-DETECTOR: An Efficient and Cost-Effective LLM-Generated Chinese Text Detection Model for NLPCC2025 Shared-Task 1

  • Yu Wang,
  • Zhirui Chen,
  • Xinyan Yu,
  • Shaohui Yang

摘要

Detecting texts generated by Large Language Models (LLMs) remains highly dependent on the availability of comprehensive training datasets. In response to NLPCC 2025 Shared Task 1, this paper introduces a low-cost yet effective detection system that combines traditional machine learning techniques with GECScore-based grammar correction. Our method demonstrates strong performance across both unseen domains and attacked data, all without the need for data augmentation, achieving an average F1 score of 94.94%. Key features used in our approach include entropy, perplexity, Chinese-English code-switching, special character usage, clause length, repetition, sentiment polarity, and grammar correction. Among the models evaluated, Random Forest emerged as the top performer. The proposed solution is both cost-efficient and resilient, offering reliable detection of LLM-generated content.