Publications
CONFERENCE (INTERNATIONAL) Overview of the NTCIR-13 OpenLiveQ Task
Makoto P. Kato (Kyoto Univ.), Takehiro Yamamoto (Kyoto Univ.), Tomohiro Manabe, Akiomi Nishida and Sumio Fujita
The 13th NTCIR Conference (NTCIR-13)
December 05, 2017
This is an overview of the NTCIR-13 OpenLiveQ task. This task aims to provide an open live test environment of Yahoo Japan Corporation’s community question-answering service (Yahoo! Chiebukuro) for question retrieval systems. The task was simply defined as follows: given a query and a set of questions with their answers, return a ranked list of questions. Submitted runs were evaluated both offline and online. In the online evaluation, we employed optimized multileaving, a multileaving method that showed high efficiency over the other methods in our preliminary experiment. We describe the details of the task, data, and evaluation methods, and then report official results at NTCIR-13 OpenLiveQ.
Paper :
Overview of the NTCIR-13 OpenLiveQ Task
(external link)