Play video on original page
Now Playing
Improving Vision-and-Language Navigation with Web…
TexMesh: Reconstructing Human Texture and…
Are Labels Necessary for Neural…
SoundSpaces: Audio-Visual Navigation in 3D…
2:00
End-to-End Object Detection with Transformers
ECCV 2020
Improving Vision-and-Language Navigation with Web Image-Text Pairs
August 24, 2020
Following a navigation instruction such as ‘Walk down the stairs and stop at the brown sofa’ requires embodied AI agents to ground referenced scene elements referenced (e.g. ‘stairs’) to visual content in the environment (pixels corresponding to ‘stairs’). We ask the following question – can we leverage abundant ‘disembodied’ web-scraped vision-and-language corpora (e.g. Conceptual Captions) to learn the visual groundings that improve performance on a relatively data-starved embodied perception task (Vision-and-Language Navigation)? (Read more)
Areas
ARTIFICIAL INTELLIGENCE
COMPUTER VISION
MACHINE LEARNING
NATURAL LANGUAGE PROCESSING & SPEECH
Share
All The Latest
Filter by
Series
October 14, 2020
Developing tools, technologies and expertise to evolve the way we design
October 14, 2020
Innovation comes through exploration and challenging our assumptions
September 8, 2020
Bringing together different functions to find new perspective and achieve design excellence
August 31, 2020
TexMesh: Reconstructing Human Texture and Geometry from Monocular Video
August 31, 2020
Are Labels Necessary for Neural Architecture Search?
August 31, 2020
TextCaps: a Dataset for Image Captioning with Reading Comprehension
August 24, 2020
Giving people the support and autonomy they need
August 24, 2020
Improving Vision-and-Language Navigation with Web Image-Text Pairs
August 21, 2020
SoundSpaces: Audio-Visual Navigation in 3D Environments
Additional Resources
Videos
Downloads & Projects
Visiting Researchers & Postdocs
Visit Our Other Blogs
Engineering
Facebook AI
Oculus
Tech@
RSS Feed
About
Careers
Privacy
Cookies
Terms
Help
Facebook © 2021
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy