Paper vs. Computer Tests: Which is Better for Student Success?

In the digital age, it is not surprising that students are increasingly swapping pencils for pixels in the classroom. The driving force behind this change is the belief that testing students with computers rather than pencils will better prepare them for a technology-centric future.

But as computer-based testing becomes more prevalent, questions arise about the wider impact it will have on children.

Given the recent NAPLAN results in Australia, for example, these questions become all the more important as the data seems to suggest that fundamental skills in English and mathematics are being neglected.

The dilemma of computer-based testing

A team of researchers decided to delve deeper into the subject. A recent study comprehensively reviewed and evaluated 43 studies from 18 countries, including Australia, the United States, Germany, and the United Kingdom. Fourteen of these studies focused on school-age children.

Before we delve into these intriguing findings, let’s briefly discuss the concept of “working memory.” This term refers to our brain’s temporary memory systems – the systems that hold information while they are in use.

In the context of computer-based testing, this can mean students juggling the multiple tasks of understanding a question, formulating an answer, and navigating a digital platform.

Memory Mechanisms

Interestingly, analysis of the studies revealed a pattern where younger students with rudimentary computer skills scored better on paper tests.

This effect diminished as students got older. Moreover, multi-step tasks led to lower scores on computer-based tests. Why?, one might ask.

Engaging in these complex challenges overloads students’ working memory, often resulting in a “high cognitive load.”

Imagine an overloaded computer. Too many programs running at the same time make the computer run slowly.

This seems to suggest that the test mode itself may increase the cognitive load on students during an exam session.

Computer vs. Paper Tests

In a 2023 study, researchers were able to observe this phenomenon in action. They compared the scores of ninth graders on computer-based and paper-based tests.

Although these students were familiar with the technology used in science tests, the results were quite surprising.

These students performed better on the computer-based exam on relatively easy questions (about 7%).

However, they performed better on the more complex questions on the paper-based exam (about 12%). An interesting question is, how can we close this gap?

The Key to Balance

As part of their study of ninth-graders, the researchers also looked at these students’ working memory capacity. This was accomplished by asking them to memorize increasingly longer lists of numbers.

After using statistical measures to control for this factor, a surprising finding emerged: assuming all students have the same working memory capacity, there was no difference in test scores between paper and computer.

This finding suggests that it is students with poor working memory capacity who are most disadvantaged in computer-based tests.

This may particularly affect students who have been diagnosed with Attention Deficit/Hyperactivity Disorder (ADHD) and who often have problems with working memory.

Rethinking Digital Testing

So what’s the next step? Should we eliminate computers in the classroom? Certainly not. There’s no denying the important role of technology in modern education.

However, taking a test on a computer is clearly a different experience to taking a test on paper.

Schools might consider making some adjustments to improve the learning environment. Giving students more time to complete complex tasks and tests on the computer can significantly improve their performance.

Early word processing training helps students develop good typing and computer navigation skills. Additionally, minimizing digital distractions such as pop-ups, multiple tabs, and online games can create a more focused and productive atmosphere during tests and class.

Parents can also do their part by encouraging their children to use the computer for everyday tasks such as composing emails, messaging, and shopping lists. This will help your child gradually master the keyboard and improve computer security.

Finally, the key point is that while computers are certainly part of the future, we must continue to find ways to incorporate them into education without hurting student performance or widening the achievement gap.

Let’s continue the conversation about how best to prepare our students for the future so that they acquire essential skills, become technically literate, and remain engaged and enthusiastic learners.