<p>In the adaptive ProbeTop<InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(K\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>K</mi> </math></EquationSource> </InlineEquation> problem, given a collection of mutually independent random variables <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(X_1, \ldots , X_n\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>X</mi> <mn>1</mn> </msub> <mo>,</mo> <mo>…</mo> <mo>,</mo> <msub> <mi>X</mi> <mi>n</mi> </msub> </mrow> </math></EquationSource> </InlineEquation>, our goal is to design an adaptive probing policy to sample these variables in a sequence of <i>T</i> stages, with the objective of maximizing the expected sum of the <i>K</i> highest rewards sampled. In spite of its stylized formulation, this setting captures numerous technical hurdles inherent to stochastic optimization, related to both information structure and efficient computation. For these reasons, special cases and variants of this problem have served as a test bed for a multitude of algorithmic methods, and concurrently as a popular teaching tool in courses and tutorials dedicated to recent trends in optimization under uncertainty. The main contribution of this paper consists in proposing a novel method for upper-bounding the expected reward of optimal adaptive probing policies, based on a simple Min-Max problem. Equipped with this method, we devise a purely combinatorial algorithms for deterministically computing feasible sets whose vicinity to the adaptive optimum is analyzed through prophet inequality ideas. Consequently, this approach allows us to establish improved constructive adaptivity gaps for the ProbeTop<InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(K\)</EquationSource> <EquationSource Format="MATHML"><math> <mi>K</mi> </math></EquationSource> </InlineEquation> problem in its broadest form, where <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(X_1, \ldots , X_n\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>X</mi> <mn>1</mn> </msub> <mo>,</mo> <mo>…</mo> <mo>,</mo> <msub> <mi>X</mi> <mi>n</mi> </msub> </mrow> </math></EquationSource> </InlineEquation> are general random variables, making further advancements when <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(X_1, \ldots , X_n\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>X</mi> <mn>1</mn> </msub> <mo>,</mo> <mo>…</mo> <mo>,</mo> <msub> <mi>X</mi> <mi>n</mi> </msub> </mrow> </math></EquationSource> </InlineEquation> are continuous.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A prophet inequality based approach to the adaptive ProbeTop\(\varvec{K}\) problem

  • Guillermo Gallego,
  • Danny Segev

摘要

In the adaptive ProbeTop \(K\) K problem, given a collection of mutually independent random variables \(X_1, \ldots , X_n\) X 1 , , X n , our goal is to design an adaptive probing policy to sample these variables in a sequence of T stages, with the objective of maximizing the expected sum of the K highest rewards sampled. In spite of its stylized formulation, this setting captures numerous technical hurdles inherent to stochastic optimization, related to both information structure and efficient computation. For these reasons, special cases and variants of this problem have served as a test bed for a multitude of algorithmic methods, and concurrently as a popular teaching tool in courses and tutorials dedicated to recent trends in optimization under uncertainty. The main contribution of this paper consists in proposing a novel method for upper-bounding the expected reward of optimal adaptive probing policies, based on a simple Min-Max problem. Equipped with this method, we devise a purely combinatorial algorithms for deterministically computing feasible sets whose vicinity to the adaptive optimum is analyzed through prophet inequality ideas. Consequently, this approach allows us to establish improved constructive adaptivity gaps for the ProbeTop \(K\) K problem in its broadest form, where \(X_1, \ldots , X_n\) X 1 , , X n are general random variables, making further advancements when \(X_1, \ldots , X_n\) X 1 , , X n are continuous.