Machine-To-Machine Comparisons
摘要
This chapter delves into Machine-to-Machine (M2M) evaluation frameworks, pivotal in assessing single object tracking (SOT) algorithms. It introduces foundational methodologies like One-Pass Evaluation (OPE), Temporal Robustness Evaluation (TRE), and Spatial Robustness Evaluation (SRE), emphasizing their contributions to robust tracking assessment. Enhancements, such as Restart-Based One-Pass Evaluation (R-OPE), address limitations like initialization bias and improve evaluation consistency. Key metrics, including Precision (PRE), Normalized Precision (N-PRE), Success Rate (SR), Expected Average Overlap (EAO), and F-score, are explored for their roles in evaluating spatial accuracy, robustness, and temporal stability. Benchmark analyses of OTB100, TrackingNet, and GOT-10k demonstrate significant progress in SOT algorithms, attributed to innovations in autoregressive designs, attention mechanisms, and visual prompting. The chapter concludes by identifying challenges, such as dataset biases and limited real-world diversity, and proposes future research directions to enhance the relevance and scalability of evaluation frameworks.