SDFMD: Spatial Domain Filtering for Accelerating Video Analysis
摘要
The exponential growth of video data necessitates more efficient video analysis systems. Many prior studies focused on accelerating video analysis, and one representative method among them is frame filtering. However, traditional frame filtering methods focus on the temporal domain, neglecting the spatial domain. We introduce SDFMD, a lightweight system that filters frames spatially, enhancing processing speed over models like DETR. SDFMD operates in three stages: spatial frame filtering, feature extraction via a Transformer encoder, and analysis using a Transformer decoder to output categories and detection boxes. Experiments indicate SDFMD doubles the encoding and decoding speed of videos, increases video analysis throughput by 9.43%, at a sacrifice of less than 20% reduction in video analysis accuracy.