The Unfinished Race: Bridging the Gap Between AI Vision Models and Human Motion Perception
摘要
Despite rapid advances in computer vision, AI systems are inherently constrained in their capacity to interpret dynamic visual scenes—a domain where human vision excels. Human vision can easily deal with occlusions, motion blur, and fast object displacements due to the brain’s highly integrated processing of motion, shape, and spatial context. State-of-the-art vision models, however, falter when presented with stimuli in which motion contains essential perceptual information. To investigate this gap, we used kinematograms—visual stimuli that decouple motion from shape—as a controlled gold standard for dynamic perception. Conventional motion estimation techniques such as Farneback and Horn-Schunck optical flow could not derive meaningful spatiotemporal information. Even new methods such as RAFT showed only partial efficacy. This highlights that current AI vision pipelines lack the biological synergy between motion and object recognition. In response, we designed a two-stage cognitive pipeline inspired by human vision. In the first stage, dense optical flow detected regions with the highest motion, which were translated into enriched RGB motion representations. In the second stage, advanced video classification models (ResNet18, Video Swin Transformers, MotionLLM) processed these enriched frames. However, these models achieved only 0–5% accuracy when applied directly. To improve performance, we proposed a biologically inspired filter—selecting frames containing the strongest motion content—and classified these using YOLOv8, repurposing object detection as dynamic video classification. This hybrid approach achieved 47.22% accuracy across 36 kinematogram videos, a significant improvement over baseline models like MotionLLM (0–5%) and ResNet18 (18.5%). This work uncovers that AI vision models, even in their current form, are still fundamentally disconnected from the way human perception dynamically integrates motion, shape, and spatial reasoning into a unified perceptual experience. This bridge between machine vision and biological perception has the potential to unlock transformative advances in robotics and cognitive augmentation technologies.