Publications
WORKSHOP (INTERNATIONAL) Overview of the NTCIR-14 OpenLiveQ-2 Task
Makoto P. Kato (Kyoto univ.), Akiomi Nishida, Tomohiro Manabe, Sumio Fujita, Takehiro Yamamoto (Hyougo pref. univ.)
The 14th NTCIR Conference Evaluation of Information Access Technologies (NTCIR-14)
June 11, 2019
This is an overview of the NTCIR-14 OpenLiveQ-2 task. This task aims to provide an open live test environment of Yahoo Japan Corporation's community question-answering service (Yahoo! Chiebukuro) for question retrieval systems. The task was simply de ned as follows: given a query and a set of questions with their answers, return a ranked list of questions. Submitted runs were evaluated both oine and online. In the online evaluation, we employed pairwise preference multileaving, a multileaving method that showed high eciency over the other methods in a recent study.We describe the details of the task, data, and evaluation methods, and then report ocial results at NTCIR-14 OpenLiveQ-2.