World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models

Ziqiao Ma, Jiayi Pan, Joyce Chai
May, 2023
Go to Project Site PDF Cite Code
Featured

Abstract

Ziqiao Ma*, Jiayi Pan*, Joyce Chai. ⭐️ ACL 2023 Outstanding Paper.

We study grounding and bootstrapping in open-world language learning through Grounded Open Vocabulary Acquisition. Our visually-grounded language model, OctoBERT, excels in learning grounded words quickly and robustly, particularly with unseen words.

Type
Conference paper
Publication
The 61st Annual Meeting of the Association for Computational Linguistics
Jiayi Pan
Jiayi Pan
潘家怡