Adaptive frequency-aware network for action quality assessment
摘要
Action Quality Assessment (AQA) aims to assess the standard proficiency of individuals in specific actions. Existing AQA datasets focus mostly on fast-paced scenarios, limiting the study of slow, nuanced actions. Therefore, we introduce the first fine-grained Baduanjin (BDJ) AQA dataset to address this gap. Baduanjin, a traditional Chinese fitness exercise known as the Eight-Section Brocade, involves slow and finely nuanced action sequences, challenging AQA models to assess fine motor skills. The dataset comprises 920 videos, each 12 to 19 s long, featuring eight distinct actions. Furthermore, we propose a new AQA model, Adaptive Frequency-Aware Network (AFA). This model is the inaugural attempt to introduce the frequency domain into AQA tasks that explore detailed differences between video clips, treating them as interrelated groups rather than independent entities. Adaptive weights are assigned to reflect the varying importance of movements, and score probabilities are predicted through uncertainty-aware distribution learning. AFA achieves outstanding performance on two long-term action datasets, Rhythmic Gymnastics, Fis-V, and our proposed short-term BDJ dataset.