DiscoverTalking Papers PodcastCristian Rodriguez-Opazo - DORi
Cristian Rodriguez-Opazo -  DORi

Cristian Rodriguez-Opazo - DORi

Update: 2022-01-05
Share

Description

Paper title:
"DORi: Discovering Object Relationships for Moment Localization of a Natural Language Query in a Video"

Authors:  Cristian Rodriguez-Opazo, Edison Marrese-Taylor, Basura Fernando, Hongdong Li, Stephen Gould

Abstract:
This paper studies the task of temporal moment localization in a long untrimmed video using natural language query. Given a query sentence, the goal is to determine the start and end of the relevant segment within the video. Our key innovation is to learn a video feature embedding through a language-conditioned message-passing algorithm suitable for temporal moment localization which captures the relationships between humans, objects and activities in the video. These relationships are obtained by a spatial subgraph that contextualized the scene representation using detected objects and human features. Moreover, a temporal sub-graph captures the activities within the video through time. Our method is evaluated on three standard benchmark datasets, and we also introduce YouCook II as a new benchmark for this task. Experiments show our method outperforms state-of-the-art methods on these datasets, confirming the effectiveness of our approach

RESOURCES
-----------------
Cristian's page: https://crodriguezo.github.io/

Code:
https://github.com/crodriguezo/DORi

Related papers:
"Proposal free temporal moment localization" : https://bit.ly/3EX1qCM
"Action Genome: Actions As Compositions of Spatio-Temporal Scene Graphs" :  https://bit.ly/3zt4aXA

Subscribe to the podcast:  https://talking.papers.podcast.itzikbs.com
Subscribe to our mailing list: http://eepurl.com/hRznqb
Follow us on Twitter: https://twitter.com/talking_papers
YouTube Channel: https://bit.ly/3eQOgwP

CONTACT:
-----------------
If you would like to be a guest, sponsor or just share your thoughts, feel free to reach out via email: talking.papers.podcast@gmail.com

Recorded on March, 26th 2021.

Comments 
Download from Google Play
Download from App Store
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Cristian Rodriguez-Opazo -  DORi

Cristian Rodriguez-Opazo - DORi

Itzik Ben-Shabat