Emotion identification from voice and music is an essential component of human–computer interaction, which creates opportunities for entertainment, mental health monitoring, and intelligent personal assistants. This paper explores a hybrid deep learning strategy that combines convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) to efficiently detect emotions expressed through audio signals. Spatial features are extracted from audio spectrogram using CNNs, whereas the temporal dynamics which are present in sequential data are extracted by LSTMs. The extraction of Mel-frequency Cepstral Coefficients (MFCCs), spectrograms of raw data is processed, emotions like happy, sad, angry, and neutral were classified. The public available datasets like CREMA-D and RAVDESS are used for real-world emotion recognition, the robustness and scalability are demonstrated.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Emotion Identification Using Artificial Neural Networks from Speech and Songs

  • T. Srinivasa Reddy,
  • Subramani Roychoudri,
  • J Britto Dennis,
  • S. Vatchala,
  • C. Yogesh,
  • A. Sathish

摘要

Emotion identification from voice and music is an essential component of human–computer interaction, which creates opportunities for entertainment, mental health monitoring, and intelligent personal assistants. This paper explores a hybrid deep learning strategy that combines convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) to efficiently detect emotions expressed through audio signals. Spatial features are extracted from audio spectrogram using CNNs, whereas the temporal dynamics which are present in sequential data are extracted by LSTMs. The extraction of Mel-frequency Cepstral Coefficients (MFCCs), spectrograms of raw data is processed, emotions like happy, sad, angry, and neutral were classified. The public available datasets like CREMA-D and RAVDESS are used for real-world emotion recognition, the robustness and scalability are demonstrated.