Thai speech emotion recognition (THAI-SER) corpus
摘要
We present the first sizable corpus of Thai speech emotion recognition, THAI-SER, comprising 41 h and 36 min (27,854 utterances) across 100 recordings recorded in different environments: Zoom and two studio setups. The recordings contain both scripted and improvised sessions, acted by 200 professional actors (112 females and 88 males, aged 18 to 55) and were directed by professional directors. There are five primary emotions: neutral, angry, happy, sad, and frustrated, assigned to the actors when recording utterances. The utterances are annotated with an emotional category using crowdsourcing. To quality control the annotation process, we also design an extensive filtering and quality control scheme to ensure that the majority agreement score remains above 0.71. We evaluate our annotated corpus using two metrics: inter-annotator reliability and human recognition accuracy. Inter-annotator reliability score was calculated using Krippendorff’s alpha, where our corpus, after filtering, achieved an alpha score of 0.692, higher than the recommended score of 0.667. For human recognition accuracy, our corpus scored up to 0.772 post-filtering. We also provide the results of the model trained on the corpus evaluated on both in-corpus and cross-corpus setups. The corpus is publicly available under a Creative Commons BY-SA 4.0 (On Github Release - https://github.com/vistec-AI/dataset-releases/releases/tag/v1 On HuggingFace - https://huggingface.co/datasets/airesearch/thai-ser) as well as our codes for the experiments (https://github.com/tann9949/thaiser-experiments).