TapesVRy: Immersive Panoramic Exploration in Large-Scale Video Retrieval
摘要
Efficient video discovery and retrieval remains a significant challenge, especially in massive video archives that can contain thousands of hours of content. Traditional browsing methods, such as timeline previews or metadata-based searches, only allow users to access content sequentially. This makes it difficult to get a comprehensive view or quickly identify the required content. Inspired by the concept of Video Tapestry, we present TapesVRy, a system that enables interactive, immersive video discovery. Instead of presenting frames in a flat layout, our system arranges and blends keyframes and short clips into a 360 \(^\circ \) panoramic tapestry that users can explore with Meta Quest VR headsets. Videos are automatically clustered by semantic similarity using multimodal AI models, grouping related videos into thematic “universes”. In each universe, users can freely navigate the 360 \(^\circ \) space, zooming in or out to adjust the density of the content. By directly interacting with the image areas, they can immediately access the original video segments. This approach transforms passive video viewing into an active exploration process, allowing users to browse and intuitively grasp multiple videos in a short time.