Scholarlink

In this chapter, we introduce the concepts of semantic relative entropy and semantic mutual information. First three measures of semantic relative entropies are defined and the relationship between these measures and the classic counterpart are discussed. Unlike the classic mutual information, it is noted that we use two measures to indicate semantic mutual information, such as the up semantic mutual information and the down semantic mutual information. In addition, the chain rule of semantic mutual information is addressed.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Semantic Relative Entropy and Mutual Information

  • 章节

  • 出版模式：

    开放获取

  • 发表日期：

    2025年

查看全文
  • Kai Niu,
  • Ping Zhang

摘要

In this chapter, we introduce the concepts of semantic relative entropy and semantic mutual information. First three measures of semantic relative entropies are defined and the relationship between these measures and the classic counterpart are discussed. Unlike the classic mutual information, it is noted that we use two measures to indicate semantic mutual information, such as the up semantic mutual information and the down semantic mutual information. In addition, the chain rule of semantic mutual information is addressed.