We are developing a Reading Skill Test (RST), which measures basic language skills relevant to reading (reading skills). In order to make the test maximally useful, we are developing it primarily as a tablet app. To examine the potential effects that tablet-based tests may have in comparison with paper-andpencil- based tests, we conducted an experiment in which 45 undergraduate students were divided into two groups and one group took the tablet-based test and the other a paper-and-pencil test. The results show no statistical difference between the tablet test and the paper-and-pencil test, which indicates that the RST can be effectively delivered as a tablet app.