From Expert Practices to Intelligent Agents: Autonomy in Interactive Video Retrieval
摘要
The Video Browser Showdown (VBS) is an international competition evaluating systems for interactive video retrieval across large datasets. In VBS 2026, we present SnapMind, the next generation of SnapSeek, which introduces an LLM-based Planner acting as an AI agent to support both expert and novice users. Given a query and the registry of retrieval components (e.g., text, image, OCR, ADL, object), the Planner generates candidate execution plans describing how these components can be combined. Users may select, edit, or discard plans, while the system executes them incrementally with normalization and fusion strategies. By embedding this AI agent into the loop, the system demonstrates agentic AI behavior: it can propose strategies, adapt to feedback, with the user controlling its participation via three autonomy levels. This design helps novices transform vague ideas into executable retrieval strategies while allowing experts to retain fine-grained control.