Publications
カンファレンス (国際) Obtaining Rephrased Microtask Questions from Crowds
Ryota Hayashi (U. of Tsukuba), Nobuyuki Shimizu and Atsuyuki Morishima (U. of Tsukuba)
8th International Conference on Social Informatics (Socinfo 2016)
2016.11.14
We present a novel method for obtaining and ranking rephrased questions from crowds, to be used as a part of instructions in microtask-based crowdsourcing. Using our method, we are able to obtain questions that differ in expression yet have the same semantics with respect to the crowdsourcing task. This is done by generating tasks that give a hint and elicit instructions from workers. We conduct experiments with data used for a real set of gold standard questions submitted to a commercial crowdsourcing platform and compared the results with those of a direct-rewrite method. The results show that extracted questions are semantically ranked at high precision and we identify cases where each method is effective.
Paper :
Obtaining Rephrased Microtask Questions from Crowds
（外部サイト）