<p>In this paper, we introduce a novel generalized subsampling Newton method designed to effectively address finite-sum optimization problems. This method is particularly effective for iterative techniques aimed at solving a system of linear inequalities in the form of <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41060_2025_832_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="57" /> </InlineMediaObject> <EquationSource Format="TEX">\(Ax \le b\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>A</mi> <mi>x</mi> <mo>≤</mo> <mi>b</mi> </mrow> </math></EquationSource> </InlineEquation>, especially when the objective function is not necessarily twice differentiable. The implementation of this method significantly impacts increasing speed, saving resources, and optimizing system memory usage, thereby improving algorithm performance, especially on large-scale problems. The convergence of the mentioned method is proven under the conditions of convexity and Lipschitz continuity of the objective function’s gradient. Preliminary numerical experiments on large-scale generated random problems and various datasets from the UCI benchmark datasets and Netlib repositories provide empirical evidence supporting our theoretical findings of the proposed method compared to similar methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Generalized subsampled Newton methods for optimization and its application

  • Ali Shahmoradi Moghaddam,
  • Saeed Ketabchi

摘要

In this paper, we introduce a novel generalized subsampling Newton method designed to effectively address finite-sum optimization problems. This method is particularly effective for iterative techniques aimed at solving a system of linear inequalities in the form of \(Ax \le b\) A x b , especially when the objective function is not necessarily twice differentiable. The implementation of this method significantly impacts increasing speed, saving resources, and optimizing system memory usage, thereby improving algorithm performance, especially on large-scale problems. The convergence of the mentioned method is proven under the conditions of convexity and Lipschitz continuity of the objective function’s gradient. Preliminary numerical experiments on large-scale generated random problems and various datasets from the UCI benchmark datasets and Netlib repositories provide empirical evidence supporting our theoretical findings of the proposed method compared to similar methods.