Mathematical symbols and words vary so much, it can be quite difficult to read a mathematical expression or equation from an image. In this instance, reading an equation in mathematics is understood to be the process of composing a textual explanation of the equation. We present the MED model, a creative complete trainable deep neural network-based approach that learns to produce a textual description for mathematical equation images. MED was created by the natural picture captioning challenge in computer vision. Two neural networks are implemented in our model: a RNN with an focus mechanism that creates descriptions related to the input mathematical equation images, and a CNN that works as an encoder, extracting features from the input mathematical expression images.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

NLP Mathematical Descriptor Using Deep Learning: A CNN -Based Approach

  • Pujari Sreya,
  • Bandinakallu Gayathri,
  • Balusu Pavani,
  • T. Sampradeepraj

摘要

Mathematical symbols and words vary so much, it can be quite difficult to read a mathematical expression or equation from an image. In this instance, reading an equation in mathematics is understood to be the process of composing a textual explanation of the equation. We present the MED model, a creative complete trainable deep neural network-based approach that learns to produce a textual description for mathematical equation images. MED was created by the natural picture captioning challenge in computer vision. Two neural networks are implemented in our model: a RNN with an focus mechanism that creates descriptions related to the input mathematical equation images, and a CNN that works as an encoder, extracting features from the input mathematical expression images.