<p>As an alternative model of the convolutional neural network (CNN), the matrix-product neural network (MPNN) constructed on account of two-dimensional discrete matrix-product operation (TDDMPO) is not only better than the CNN in recognition performance, but also smaller in calculation and faster in convergence speed than the CNN. In order to further perfect the MPNN, compared with the discrete convolutional operation and CNN, this paper proposes one-dimensional discrete matrix-product operation (ODDMPO) and its corresponding one-dimensional matrix-product neural network (ODMPNN). Experimental results on MNIST, Fashion_MNIST, CIFAR10, and FLOWER17 datasets show that ODMPNNs improve the performance by 0.62<InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10044_2025_1457_Article_IEq1.gif" Format="GIF" Height="13" Rendition="HTML" Resolution="72" Type="Linedraw" Width="19" /> </InlineMediaObject> <EquationSource Format="TEX">\(-\)</EquationSource> </InlineEquation>7.38% over the corresponding one-dimensional convolutional neural networks (ODCNNs), and the calculation amount of one-dimensional matrix-product layers of ODMPNNs obtains 5<InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10044_2025_1457_Article_IEq2.gif" Format="GIF" Height="13" Rendition="HTML" Resolution="72" Type="Linedraw" Width="19" /> </InlineMediaObject> <EquationSource Format="TEX">\(\times\)</EquationSource> </InlineEquation>-79<InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10044_2025_1457_Article_IEq2.gif" Format="GIF" Height="13" Rendition="HTML" Resolution="72" Type="Linedraw" Width="19" /> </InlineMediaObject> <EquationSource Format="TEX">\(\times\)</EquationSource> </InlineEquation> less than that of the corresponding one-dimensional convolutional layers of ODCNNs. Therefore, it shows again that the MPNN is a potentially important model to replace the CNN.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

One-dimensional matrix-product neural networks

  • Chuanhui Shan,
  • Hu Li,
  • Chao Han

摘要

As an alternative model of the convolutional neural network (CNN), the matrix-product neural network (MPNN) constructed on account of two-dimensional discrete matrix-product operation (TDDMPO) is not only better than the CNN in recognition performance, but also smaller in calculation and faster in convergence speed than the CNN. In order to further perfect the MPNN, compared with the discrete convolutional operation and CNN, this paper proposes one-dimensional discrete matrix-product operation (ODDMPO) and its corresponding one-dimensional matrix-product neural network (ODMPNN). Experimental results on MNIST, Fashion_MNIST, CIFAR10, and FLOWER17 datasets show that ODMPNNs improve the performance by 0.62 \(-\) 7.38% over the corresponding one-dimensional convolutional neural networks (ODCNNs), and the calculation amount of one-dimensional matrix-product layers of ODMPNNs obtains 5 \(\times\) -79 \(\times\) less than that of the corresponding one-dimensional convolutional layers of ODCNNs. Therefore, it shows again that the MPNN is a potentially important model to replace the CNN.