<p>Cell culture bioprocess data are typically collected across many timepoints and batches, where numerous analytes covary with each other and, critically, with elapsed process time. This time dependence can inflate performance metrics and compromise the validity of multivariate models. We introduce time-adjusted performance evaluation (TAPE), a regression-agnostic validation technique that quantifies and separates time-driven from time-independent predictivity. TAPE pairs leave-one-group-out cross-validation with per-timepoint centering to decompose performance into between-timepoint (time-dependent) and within-timepoint (time-decoupled) parts by comparing predicted and observed deviations from each timepoint mean. Applying TAPE to orthogonal partial least squares models across five Chinese hamster ovary cell culture datasets (three Raman spectroscopy, one metabolomics, and one transcriptomics), several ostensibly strong models’ predictivity was largely explained by timepoint means alone. After removing between-timepoint variation, only models with sample–response relationships independent of time retained good predictivity. For Raman, only models for Raman-active analytes (glucose, lactate) remained predictive, whereas Raman-inactive ones (K<sup>+</sup>, NH<sub>4</sub><sup>+</sup>) did not. In the omics studies, the models for titer, viable cell density, growth rate, and death rates were predominantly time-driven. By quantifying time’s contribution to model performance, TAPE helps prevent misleadingly good performance metrics and supports more reliable multivariate modeling of time-series bioprocess data.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Time-adjusted performance evaluation (TAPE) of predictive multivariate models for bioprocess data

  • Andreas Eriksson,
  • Rafael Machleid,
  • Anne Richelle,
  • Johan Trygg,
  • Henrik Antti,
  • Izabella Surowiec,
  • Olivier Cloarec,
  • Pär Jonsson

摘要

Cell culture bioprocess data are typically collected across many timepoints and batches, where numerous analytes covary with each other and, critically, with elapsed process time. This time dependence can inflate performance metrics and compromise the validity of multivariate models. We introduce time-adjusted performance evaluation (TAPE), a regression-agnostic validation technique that quantifies and separates time-driven from time-independent predictivity. TAPE pairs leave-one-group-out cross-validation with per-timepoint centering to decompose performance into between-timepoint (time-dependent) and within-timepoint (time-decoupled) parts by comparing predicted and observed deviations from each timepoint mean. Applying TAPE to orthogonal partial least squares models across five Chinese hamster ovary cell culture datasets (three Raman spectroscopy, one metabolomics, and one transcriptomics), several ostensibly strong models’ predictivity was largely explained by timepoint means alone. After removing between-timepoint variation, only models with sample–response relationships independent of time retained good predictivity. For Raman, only models for Raman-active analytes (glucose, lactate) remained predictive, whereas Raman-inactive ones (K+, NH4+) did not. In the omics studies, the models for titer, viable cell density, growth rate, and death rates were predominantly time-driven. By quantifying time’s contribution to model performance, TAPE helps prevent misleadingly good performance metrics and supports more reliable multivariate modeling of time-series bioprocess data.