Scholarlink

<p>On modern GPUs, dynamic optimization is currently limited by sensitivity computations that require information from full forward and adjoint wave fields. Since forward and adjoint solutions are computed in opposing time directions, the forward solution must be stored, requiring substantial memory even with checkpointing or data compression techniques. As a result, the problem is memory bound rather than bound by wall clock time when working with modern GPU-based implementations that have limited memory capacity. To overcome this limitation, we introduce a new approach to approximating sensitivity computations based on the adjoint method (for self-adjoint problems, thus excluding attenuating effects) that relies on the principle of superposition. The approximation allows an iterative computation of the sensitivity, reducing the memory burden to that of the solution at a small number of time steps, i.e., to the number of degrees of freedom. This enables sensitivity computations for problems with billions of degrees of freedom on current GPUs, such as the A100 from NVIDIA<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(^{{\circledR }}\)</EquationSource> <EquationSource Format="MATHML"><math> <mmultiscripts> <mrow /> <mrow /> <mo>®</mo> </mmultiscripts> </math></EquationSource> </InlineEquation> (from 2020). We demonstrate the approach on full waveform inversion and transient acoustic topology optimization problems, relying on a highly efficient finite difference forward solver implemented in CUDA<InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(^{{\circledR }}\)</EquationSource> <EquationSource Format="MATHML"><math> <mmultiscripts> <mrow /> <mrow /> <mo>®</mo> </mmultiscripts> </math></EquationSource> </InlineEquation>. Phenomena such as damping cannot be considered, as the approximation technique is limited to self-adjoint problems.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A memory-efficient adjoint method to enable billion parameter optimization on a single GPU in dynamic problems

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年2月19日

查看全文
  • Leon Herrmann,
  • Tim Bürchner,
  • László Kudela,
  • Stefan Kollmannsberger

摘要

On modern GPUs, dynamic optimization is currently limited by sensitivity computations that require information from full forward and adjoint wave fields. Since forward and adjoint solutions are computed in opposing time directions, the forward solution must be stored, requiring substantial memory even with checkpointing or data compression techniques. As a result, the problem is memory bound rather than bound by wall clock time when working with modern GPU-based implementations that have limited memory capacity. To overcome this limitation, we introduce a new approach to approximating sensitivity computations based on the adjoint method (for self-adjoint problems, thus excluding attenuating effects) that relies on the principle of superposition. The approximation allows an iterative computation of the sensitivity, reducing the memory burden to that of the solution at a small number of time steps, i.e., to the number of degrees of freedom. This enables sensitivity computations for problems with billions of degrees of freedom on current GPUs, such as the A100 from NVIDIA \(^{{\circledR }}\) ® (from 2020). We demonstrate the approach on full waveform inversion and transient acoustic topology optimization problems, relying on a highly efficient finite difference forward solver implemented in CUDA \(^{{\circledR }}\) ® . Phenomena such as damping cannot be considered, as the approximation technique is limited to self-adjoint problems.