Publications
CONFERENCE (INTERNATIONAL) Test-retest Reliability on Movement Times and Error Rates in Target Pointing
The ACM SIGCHI Conference on Designing Interactive Systems (DIS 2022)
June 13, 2022
Target-selection tasks have been frequently conducted to evaluate novel input devices and pointing-facilitation techniques. Recently, Sharif et al. showed that a unified metric to evaluate the pointing performance, called throughput TP, was not stable across two sessions performed by the same participant group, which indicates poor test-retest reliability. Because there are cases in which using TP is inappropriate depending on the research topic, we extend their finding to two other metrics: movement time MT and error rate ER. We demonstrated that, even for the participants who kept their TPs across two sessions stable, they would exhibit unstable MTs and ERs. Thus, if time allows, researchers should design their experiments to run multiple sessions for obtaining the central tendency of user performance, which increases the validity of their user studies.
Paper :
Test-retest Reliability on Movement Times and Error Rates in Target Pointing
(external link)