In the previous chapter, we showed the concentration of sample average in the Hoeffding inequality. The asymptotic results like law of large numbers and central limit theorem are also about the sample average. If we look into the proof of these results, we can find that these results rely on the additive formality of the sample mean. So we have the impression that the concentration principle works for the average, but does it cover other statistics? In fact, we have many nonlinear estimators in statistics and machine learning. Can we expect that a general statistic \(f(X_1, \ldots , X_n)\) concentrates to its expectation? The answer is positive. Sample mean is not special.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Sub-exponential Random Variables

  • Junwei Lu

摘要

In the previous chapter, we showed the concentration of sample average in the Hoeffding inequality. The asymptotic results like law of large numbers and central limit theorem are also about the sample average. If we look into the proof of these results, we can find that these results rely on the additive formality of the sample mean. So we have the impression that the concentration principle works for the average, but does it cover other statistics? In fact, we have many nonlinear estimators in statistics and machine learning. Can we expect that a general statistic \(f(X_1, \ldots , X_n)\) concentrates to its expectation? The answer is positive. Sample mean is not special.