논문명 | Query Generation for Multimodal Documents |
---|---|
개최일 | 2021.04.21 |
학술회의명 | Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics |
책임교수 | |
구분 | 구두발표 |
제1저자 | kyungho kim |
교신저자 | Seung-won Hwang |
공동저자 | Kyungjae Lee, Seung-won Hwang, Young-In Song and seungwook lee |
국내/국외 | 국외 |
개최국가 | UA |
주관기관 | |
"This paper studies the problem of generating likely queries for multimodal documents with images. Our application scenario is enabling efficient “first-stage retrieval” of relevant documents, by attaching generated queries to documents before indexing. We can then index this expanded text to efficiently narrow down to candidate matches using inverted index, so that expensive reranking can follow. Our evaluation results show that our proposed multimodal representation meaningfully improves relevance ranking. More importantly, our framework can achieve the state of the art in the first-stage retrieval scenarios." |