Scholarlink

<p>To address the growing size of AI model training data and the lack of a universal data selection methodology–factors that significantly drive up training costs–this paper presents the General Information Metrics Evaluation (GIME) method. GIME leverages general information metrics from Objective Information Theory (OIT), including <i>volume</i>, <i>delay</i>, <i>scope</i>, <i>granularity</i>, <i>variety</i>, <i>duration</i>, <i>sampling rate</i>, <i>aggregation</i>, <i>coverage</i>, <i>distortion</i>, and <i>mismatch</i> to optimize dataset selection for training purposes. Comprehensive experiments conducted across diverse domains, such as CTR Prediction, Civil Case Prediction, and Weather Forecasting, demonstrate that GIME effectively preserves model performance while substantially reducing both training time and costs. Additionally, applying GIME within the Judicial AI Program led to a remarkable 39.56% reduction in total model training expenses, underscoring its potential to support efficient and sustainable AI development.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

General information metrics for improving AI model training efficiency

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年7月2日

查看全文
  • Jianfeng Xu,
  • Congcong Liu,
  • Xiaoying Tan,
  • Xiaojie Zhu,
  • Anpeng Wu,
  • Huan Wan,
  • Weijun Kong,
  • Chun Li,
  • Hu Xu,
  • Kun Kuang,
  • Fei Wu

摘要

To address the growing size of AI model training data and the lack of a universal data selection methodology–factors that significantly drive up training costs–this paper presents the General Information Metrics Evaluation (GIME) method. GIME leverages general information metrics from Objective Information Theory (OIT), including volume, delay, scope, granularity, variety, duration, sampling rate, aggregation, coverage, distortion, and mismatch to optimize dataset selection for training purposes. Comprehensive experiments conducted across diverse domains, such as CTR Prediction, Civil Case Prediction, and Weather Forecasting, demonstrate that GIME effectively preserves model performance while substantially reducing both training time and costs. Additionally, applying GIME within the Judicial AI Program led to a remarkable 39.56% reduction in total model training expenses, underscoring its potential to support efficient and sustainable AI development.