<p>This paper presents a new method for calculating similarity. It's called the unit dot product similarity method. The proposed method, unlike the traditional dot product method, can maintain the similarity of equally scaled vectors and get a bounded similarity results. We develop and compare the proposed method in the attention-based encoder-decoder structure. The proposed method brings further improvement to the recognition results. For the end-to-end speech recognition model, we select greedy soup instead of the average model parameters in WeNet. We proposed a dynamic parallel greedy soup optimization algorithm to increase computational speed. The experiments show the importance of proposed method and optimization algorithm. The effectiveness is also proved on multiple corpora.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

New unit dot product similarity method and parallelized greedy soup algorithm in the end-to-end automatic speech recognition

  • Wei Liu,
  • Zifan Wang,
  • Yiming Sun,
  • Chunyi Chen

摘要

This paper presents a new method for calculating similarity. It's called the unit dot product similarity method. The proposed method, unlike the traditional dot product method, can maintain the similarity of equally scaled vectors and get a bounded similarity results. We develop and compare the proposed method in the attention-based encoder-decoder structure. The proposed method brings further improvement to the recognition results. For the end-to-end speech recognition model, we select greedy soup instead of the average model parameters in WeNet. We proposed a dynamic parallel greedy soup optimization algorithm to increase computational speed. The experiments show the importance of proposed method and optimization algorithm. The effectiveness is also proved on multiple corpora.