Researchers have raised questions regarding the connection between learner familiarity with computers and performance on computerized tests virtually since interest arose in studying the applicability of computers for assessment purposes. However, despite this longstanding attention, at present, there has been a surprising lack of research that explores the connection between computer familiarity and performance on computerized tests that fall outside of the traditional multiple-choice discrete-point tests that have historically predominated in the fielf of testing and assessment. The current study aims to address this gap in previous research by examining the relationship between computer familiarity and computer-based test performance on a computer-based test of second language reading that is integrative rather than discrete-point. The study investigated the online reading ability of ESL students from one secondary school in a large city in western Canada (61 females and 59 males in the sample, ages 13-19, M=15.73). The students responded to a questionnaire about their computer familiarity and then completed an online multiple-choice cloze test. Contrary to other most other findings based on discrete-point tests, the results revealed that the familiarity variables do account for a small but significant amount of the variability in the computer-based test scores.