The Comparison of Accuracy Scores on the Paper and Pencil Testing vs. Computer-Based Testing

ABSTRACT

This study aimed to compare the accuracy of the test scores as results of Test of English Proficiency (TOEP) based on paper and pencil test (PPT) versus computer-based test (CBT). Using the participants’ responses to the PPT documented from 2008-2010 and data of CBT TOEP documented in 2013-2014 on the sets of 1A, 2A, and 3A for the Listening and Reading section, the researcher estimated the reliability estimation results using classical test theory and the value of information function and on the item response theory on PPT are then compared with CBT, which has the greater reliability and the value of information functions is said to be more accurate. The study shows that with the classical test theory approach, the reliability coefficients between the scores of the results of PPT and those of CBT are almost the same, and using the  item response theory, it was found that although the value of the information function on PPT and CBT relatively similar in several subtests, there is a tendency for participants with the moderate ability that CBT is more accurate than PPT, and for the low and high ability of  participants, PPT tends to be more accurate than CBT.