This study demonstrates how scene graphs can be used to find a specific clip using natural language queries from a collection of road scene clips. A framework has been developed to locate the desired clip from a pool of road scene clips. This framework includes scene graph generation, understanding the scene using a resultant scene graph function, summarizing the information from the resultant scene graph function, and finding the cosine similarity between the summarized information and the natural language query provided by the user. The framework was applied to locate the required clip from the collection of clips. The results highlight the need for improvement in summarization model, object detection, and to decrease number of frames between first and last frame from which resultant scene graph data is extracted.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Road Scenario Extraction Using Natural Language Query

  • Hardik Gohel,
  • R. Sridharan,
  • Udaya Unnikrishnan,
  • Sarath Mohan

摘要

This study demonstrates how scene graphs can be used to find a specific clip using natural language queries from a collection of road scene clips. A framework has been developed to locate the desired clip from a pool of road scene clips. This framework includes scene graph generation, understanding the scene using a resultant scene graph function, summarizing the information from the resultant scene graph function, and finding the cosine similarity between the summarized information and the natural language query provided by the user. The framework was applied to locate the required clip from the collection of clips. The results highlight the need for improvement in summarization model, object detection, and to decrease number of frames between first and last frame from which resultant scene graph data is extracted.