In this chapter, we would like to generalize the concepts of video grounding definition. This includes generalizing (i) the query, the query in Video Grounding usually refers to a natural language sentence and (ii) the reference, which refers to the untrimmed video in Video Grounding. Meanwhile, the query and reference can be extended to more modalities, such as language, audio, and vision, and they are not restricted to grounding one single sentence with the reference of a video. Furthermore, the query could be generalized to an event and we will demonstrate how to connect such event-based generalized grounding with other video-and-language tasks, such as video question answering.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Generalized Video Grounding

  • Xin Wang,
  • Xiaohan Lan,
  • Wenwu Zhu

摘要

In this chapter, we would like to generalize the concepts of video grounding definition. This includes generalizing (i) the query, the query in Video Grounding usually refers to a natural language sentence and (ii) the reference, which refers to the untrimmed video in Video Grounding. Meanwhile, the query and reference can be extended to more modalities, such as language, audio, and vision, and they are not restricted to grounding one single sentence with the reference of a video. Furthermore, the query could be generalized to an event and we will demonstrate how to connect such event-based generalized grounding with other video-and-language tasks, such as video question answering.