<p>The player called “Skeptic” bets <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\$1\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="normal">$</mi> <mn>1</mn> </mrow> </math></EquationSource> </InlineEquation> against the simple null hypothesis that a random sample <i>X</i> will be drawn from a distribution of probability density function <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(f_{0}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>f</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>, knowing that it will otherwise be drawn from a distribution of probability density function <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(f_{1}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>f</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>. Skeptic also knows the prior probability of the null hypothesis to be <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\pi _{0}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>π</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>, a number in <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\left[ 0,1\right] \)</EquationSource> <EquationSource Format="MATHML"><math> <mfenced close="]" open="["> <mn>0</mn> <mo>,</mo> <mn>1</mn> </mfenced> </math></EquationSource> </InlineEquation>. In return for the <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\$1\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="normal">$</mi> <mn>1</mn> </mrow> </math></EquationSource> </InlineEquation>, Skeptic chooses to receive the payout that is log-optimal according to the prior predictive distribution of probability density function <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(f=\pi _{0}f_{0}+\left( 1-\pi _{0}\right) f_{1}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>f</mi> <mo>=</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> <msub> <mi>f</mi> <mn>0</mn> </msub> <mo>+</mo> <mfenced close=")" open="("> <mn>1</mn> <mo>-</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> </mfenced> <msub> <mi>f</mi> <mn>1</mn> </msub> </mrow> </math></EquationSource> </InlineEquation>. That payout is the e-variable <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(E=f\left( X\right) /f_{0}\left( X\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>E</mi> <mo>=</mo> <mi>f</mi> <mfenced close=")" open="("> <mi>X</mi> </mfenced> <mo stretchy="false">/</mo> <msub> <mi>f</mi> <mn>0</mn> </msub> <mfenced close=")" open="("> <mi>X</mi> </mfenced> </mrow> </math></EquationSource> </InlineEquation>. With <i>x</i> as the observed sample, the e-value that realizes <i>E</i> is <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\(e=f\left( x\right) /f_{0}\left( x\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>e</mi> <mo>=</mo> <mi>f</mi> <mfenced close=")" open="("> <mi>x</mi> </mfenced> <mo stretchy="false">/</mo> <msub> <mi>f</mi> <mn>0</mn> </msub> <mfenced close=")" open="("> <mi>x</mi> </mfenced> </mrow> </math></EquationSource> </InlineEquation>, where <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(f\left( x\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>f</mi> <mfenced close=")" open="("> <mi>x</mi> </mfenced> </mrow> </math></EquationSource> </InlineEquation> is known as a marginal likelihood. Considering <i>e</i> as the degree to which the null hypothesis is disproven resolves certain pathologies in evidence theory while reflecting the prior probability of the null hypothesis. To generalize that, let <InlineEquation ID="IEq11"> <EquationSource Format="TEX">\(E_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>E</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </math></EquationSource> </InlineEquation> denote any e-variable that tests a simple or composite null hypothesis, and let <InlineEquation ID="IEq12"> <EquationSource Format="TEX">\(e_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>e</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </math></EquationSource> </InlineEquation> be its e-value for <InlineEquation ID="IEq13"> <EquationSource Format="TEX">\(X=x\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>X</mi> <mo>=</mo> <mi>x</mi> </mrow> </math></EquationSource> </InlineEquation>. The corresponding Bayes e-variable is <InlineEquation ID="IEq14"> <EquationSource Format="TEX">\(E_{\pi _{0}}=\pi _{0}+\left( 1-\pi _{0}\right) E_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>E</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> <mo>+</mo> <mfenced close=")" open="("> <mn>1</mn> <mo>-</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> </mfenced> <msub> <mi>E</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </mrow> </math></EquationSource> </InlineEquation>, and its realization, the Bayes e-value, is <InlineEquation ID="IEq15"> <EquationSource Format="TEX">\(e_{\pi _{0}}=\pi _{0}+\left( 1-\pi _{0}\right) e_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>e</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> <mo>+</mo> <mfenced close=")" open="("> <mn>1</mn> <mo>-</mo> <msub> <mi>π</mi> <mn>0</mn> </msub> </mfenced> <msub> <mi>e</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </mrow> </math></EquationSource> </InlineEquation>. The special case of <InlineEquation ID="IEq16"> <EquationSource Format="TEX">\(E_{\left( 0\right) }=f_{1}\left( X\right) /f_{0}\left( X\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>E</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> <mo>=</mo> <msub> <mi>f</mi> <mn>1</mn> </msub> <mfenced close=")" open="("> <mi>X</mi> </mfenced> <mo stretchy="false">/</mo> <msub> <mi>f</mi> <mn>0</mn> </msub> <mfenced close=")" open="("> <mi>X</mi> </mfenced> </mrow> </math></EquationSource> </InlineEquation> and the resulting Bayes factor <InlineEquation ID="IEq17"> <EquationSource Format="TEX">\(e_{\left( 0\right) }=f_{1}\left( x\right) /f_{0}\left( x\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>e</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> <mo>=</mo> <msub> <mi>f</mi> <mn>1</mn> </msub> <mfenced close=")" open="("> <mi>x</mi> </mfenced> <mo stretchy="false">/</mo> <msub> <mi>f</mi> <mn>0</mn> </msub> <mfenced close=")" open="("> <mi>x</mi> </mfenced> </mrow> </math></EquationSource> </InlineEquation> yield <InlineEquation ID="IEq18"> <EquationSource Format="TEX">\(E_{\pi _{0}}=E\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>E</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <mi>E</mi> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq19"> <EquationSource Format="TEX">\(e_{\pi _{0}}=e\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>e</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <mi>e</mi> </mrow> </math></EquationSource> </InlineEquation>, respectively. In another special case, arguably important in many scientific applications, including testing a Bayesian model known to be false, is <InlineEquation ID="IEq20"> <EquationSource Format="TEX">\(\pi _{0}=0\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>π</mi> <mn>0</mn> </msub> <mo>=</mo> <mn>0</mn> </mrow> </math></EquationSource> </InlineEquation>, leading to <InlineEquation ID="IEq21"> <EquationSource Format="TEX">\(E_{\pi _{0}}=E_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>E</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <msub> <mi>E</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq22"> <EquationSource Format="TEX">\(e_{\pi _{0}}=e_{\left( 0\right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>e</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> <mo>=</mo> <msub> <mi>e</mi> <mfenced close=")" open="("> <mn>0</mn> </mfenced> </msub> </mrow> </math></EquationSource> </InlineEquation>. By contrast, the posterior probability of the null hypothesis would in that case be 0 regardless of the data, rendering it useless for data analysis. For <InlineEquation ID="IEq23"> <EquationSource Format="TEX">\(\pi _{0}&gt;0\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>π</mi> <mn>0</mn> </msub> <mo>&gt;</mo> <mn>0</mn> </mrow> </math></EquationSource> </InlineEquation>, as is suitable for many applications in psychology, biomedicine, genetics, and genomics, <InlineEquation ID="IEq24"> <EquationSource Format="TEX">\(e_{\pi _{0}}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>e</mi> <msub> <mi>π</mi> <mn>0</mn> </msub> </msub> </math></EquationSource> </InlineEquation> is regularized toward 1 to the extent that the null hypothesis has high prior probability.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Bayes e-Value: Testing by Betting Given a Prior Probability of the Null Hypothesis

  • David R. Bickel

摘要

The player called “Skeptic” bets \(\$1\) $ 1 against the simple null hypothesis that a random sample X will be drawn from a distribution of probability density function \(f_{0}\) f 0 , knowing that it will otherwise be drawn from a distribution of probability density function \(f_{1}\) f 1 . Skeptic also knows the prior probability of the null hypothesis to be \(\pi _{0}\) π 0 , a number in \(\left[ 0,1\right] \) 0 , 1 . In return for the \(\$1\) $ 1 , Skeptic chooses to receive the payout that is log-optimal according to the prior predictive distribution of probability density function \(f=\pi _{0}f_{0}+\left( 1-\pi _{0}\right) f_{1}\) f = π 0 f 0 + 1 - π 0 f 1 . That payout is the e-variable \(E=f\left( X\right) /f_{0}\left( X\right) \) E = f X / f 0 X . With x as the observed sample, the e-value that realizes E is \(e=f\left( x\right) /f_{0}\left( x\right) \) e = f x / f 0 x , where \(f\left( x\right) \) f x is known as a marginal likelihood. Considering e as the degree to which the null hypothesis is disproven resolves certain pathologies in evidence theory while reflecting the prior probability of the null hypothesis. To generalize that, let \(E_{\left( 0\right) }\) E 0 denote any e-variable that tests a simple or composite null hypothesis, and let \(e_{\left( 0\right) }\) e 0 be its e-value for \(X=x\) X = x . The corresponding Bayes e-variable is \(E_{\pi _{0}}=\pi _{0}+\left( 1-\pi _{0}\right) E_{\left( 0\right) }\) E π 0 = π 0 + 1 - π 0 E 0 , and its realization, the Bayes e-value, is \(e_{\pi _{0}}=\pi _{0}+\left( 1-\pi _{0}\right) e_{\left( 0\right) }\) e π 0 = π 0 + 1 - π 0 e 0 . The special case of \(E_{\left( 0\right) }=f_{1}\left( X\right) /f_{0}\left( X\right) \) E 0 = f 1 X / f 0 X and the resulting Bayes factor \(e_{\left( 0\right) }=f_{1}\left( x\right) /f_{0}\left( x\right) \) e 0 = f 1 x / f 0 x yield \(E_{\pi _{0}}=E\) E π 0 = E and \(e_{\pi _{0}}=e\) e π 0 = e , respectively. In another special case, arguably important in many scientific applications, including testing a Bayesian model known to be false, is \(\pi _{0}=0\) π 0 = 0 , leading to \(E_{\pi _{0}}=E_{\left( 0\right) }\) E π 0 = E 0 and \(e_{\pi _{0}}=e_{\left( 0\right) }\) e π 0 = e 0 . By contrast, the posterior probability of the null hypothesis would in that case be 0 regardless of the data, rendering it useless for data analysis. For \(\pi _{0}>0\) π 0 > 0 , as is suitable for many applications in psychology, biomedicine, genetics, and genomics, \(e_{\pi _{0}}\) e π 0 is regularized toward 1 to the extent that the null hypothesis has high prior probability.