<p>We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable, answering a 2010 question of Bobkov and Madiman [<CitationRef CitationID="CR1">1</CitationRef>]. This gives a sharp reversal of the celebrated entropy maximization theorem due to Boltzmann, in the log-concave case. We apply this result to derive upper bounds on capacities of additive noise channels with log-concave noise. We also improve constants in the reverse entropy power inequalities for log-concave random variables.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Minimum entropy of a log-concave variable with fixed variance

  • James Melbourne,
  • Piotr Nayar,
  • Cyril Roberto

摘要

We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable, answering a 2010 question of Bobkov and Madiman [1]. This gives a sharp reversal of the celebrated entropy maximization theorem due to Boltzmann, in the log-concave case. We apply this result to derive upper bounds on capacities of additive noise channels with log-concave noise. We also improve constants in the reverse entropy power inequalities for log-concave random variables.