Concept

A tool can change how you go about a task and how well it turns out.

Issue

Finishing a document, filling a page with notes or finding an answer can still leave an important part of the job undone.

Solutions

Learn to judge what kind of work your tool supports, then compare one tool or routine.

Say you’ve just read a work policy on screen. You can repeat its main rule, but you can’t explain the exception. Would printing it help? Or did the way you read it skip a step?

That question gives you something specific to look at. Whatever you read it on, you need to connect the rule with its exception. Reaching the end of the page tells you where your reading stopped. Being able to explain it correctly tells you whether you got what you needed.

A tool might change the steps you take, the result you get, or both. That doesn’t mean it changes how you think in other situations. The research below helps you keep these questions apart.

This module is for working adults choosing between optional tools for everyday reading, note-taking or searching for information.

What you’ll get from this module

In this module

By the end of this module, you’ll know to decide what a good result looks like before you choose a tool. Reviews of reading and note-taking research, reading experiments and a way of thinking about search will show why both the task and your routine matter. You’ll pick a situation from daily life and finish with a plan to compare two approaches, a reason to keep what you do now, or a clear question you still need to answer.

What changes when you change a tool?

Research review: what you read on can affect how well you understand.

Pablo Delgado and colleagues’ 2018 review compared how well people understood similar texts read on paper and on digital devices. Across studies in schools and colleges, readers understood slightly more, on average, when they read on paper.

The pattern depended on the task. In studies that compared separate groups of readers, paper’s advantage was bigger when reading time was limited. It showed up in studies using factual texts, or a mix of facts and stories. In studies using stories alone, it wasn’t reliable enough to count.

Why it matters: So the kind of reading is part of the explanation. A finding about understanding factual material under time pressure doesn’t tell you what to read every book on. Paper is worth considering for demanding factual reading, when it’s a practical option.

Read the review of reading medium and comprehension.

Research review: reading stories sets a limit on that finding.

Annika Schwabe and colleagues’ 2022 review looked at how well people understood stories and other narrative texts. Across 32 studies with 2,239 participants, it found no reliable overall difference in understanding between screen and paper. Studies using plain digital text, with no added features, found no reliable difference either.

Why it matters: These results don’t support a blanket claim that screens make reading worse. Not finding a reliable difference doesn’t prove that screen and paper are the same. But it does mean that a rule favoring paper for every kind of reading goes further than these findings.

Read the review of narrative reading on screen and paper.

Research review: how much you write down and how well you do are different things.

Abraham E. Flanigan and colleagues’ 2024 review looked at college lecture notes across 24 studies in 21 published papers. It included experiments and less tightly controlled comparisons. The studies gave students different chances to review their notes, and used different tests.

When the results were combined, students who wrote notes by hand did better in their courses, while students who typed took more notes. Those are two different outcomes: how much students wrote down, and what they could do with what they learned.

Why it matters: Don’t let one quietly stand in for the other. If you need a complete record, missing a necessary detail matters. If you need to explain a decision, a longer transcript doesn’t show that you understand the reason behind it.

Read the review of lecture notes and college achievement.

Research review: note-taking research doesn’t name a winner for everyone.

Daniel Voyer and colleagues’ 2022 review looked at handwritten and digital notes in learning situations, while taking distractions into account. Across the studies, the overall difference in performance was close to zero and wasn’t reliable.

That’s different from Flanigan and colleagues’ finding in favor of handwriting. The two reviews included different studies and combined the results in different ways. They didn’t test exactly the same comparison, and the results available don’t explain exactly why they disagree.

Why it matters: The disagreement matters when you choose a tool. There’s some evidence that handwriting helps people do better, but don’t assume it improves every task. And a difference close to zero doesn’t prove the two methods work equally well everywhere.

Read the review of note-taking methods and performance.

Does one tool win every time?

Controlled experiments: how you read matters too.

Tirza Lauterman and Rakefet Ackerman’s 2014 experiments had engineering students read texts on paper or on screen. They looked at practice, and at a routine where students waited before writing keywords that summed up a text. Then the students took a test later on.

In the first experiment, practice made up for the screen’s disadvantage only for people who preferred reading on screen. At the start of the second experiment, no difference was found between paper and screen scores. Later, screen readers who preferred paper still scored lower, but the gap wasn’t reliable.

The second experiment changed both the keyword routine and the timing at once. So it can’t tell us what the keywords would do on their own. Taken together, the experiments show why the reading routine and the reader’s preference belong in the explanation of these results.

Why it matters: This gives you another option besides swapping out a useful tool. You can look at whether the way you use it supports the thinking the task needs. How you read deserves attention as well as what you read on.

Read the experiments on reading procedures and medium.

Try a new way of reading first

Conceptual framework: finding something and understanding it are different goals.

Gary Marchionini’s 2006 paper separates three kinds of search: looking something up, learning, and investigating. They can overlap, but each one asks something different of the person searching.

Finding one specific answer can finish a lookup. Learning and investigating need more work, such as making sense of what you find or comparing explanations. This is a way of thinking about search goals. It isn’t an experiment measuring lasting changes in how people think.

Why it matters: It helps you ask the question behind choosing a tool: what result would actually finish this job? An answer you’ve found may be exactly what you need. Or it may be material you still need to work through.

Read the framework for exploratory search.

What this means for you

Judge a tool together with the task and the routine you use. The research gives you reasons to check particular results. Because its findings are mixed, it’s a poor idea to start out assuming any tool is the winner.

Define the result before choosing the tool

Write down what you need to produce, in words you can check. For the made-up policy task, that means a correct explanation of the rule, the exception and the reason behind them. Getting to the bottom of the document isn’t what counts as done.

For notes from a briefing, you might need the decision, its reason and a question that’s still open. Check whether the notes are complete separately from whether the explanation is right. That way you keep the details you need without treating word count as understanding.

For search, decide whether you need a quick lookup or a real investigation. A trustworthy source may settle a simple lookup. A comparison may need relevant evidence, an explanation of why sources disagree and a note of what’s still unsettled.

The standard should fit the real job. You don’t need to turn every lookup into a research project, or every set of notes into a transcript.

Name the thinking step you want to observe

Name a step you can actually watch for: selecting, copying, comparing, explaining, finding your way around or checking. Then ask which step your usual way of working lets you skip, and whether the task needs it.

In the policy example, the suspected problem is missing the link between a rule and its exception. Jumping between headings might play a part, but that’s something to watch for. It isn’t a known fact about all screen reading.

Before you try another approach, write down what you expect to happen. You might expect to miss fewer exceptions with a different medium, or with a deliberate checking routine. Also write what would show you were wrong, such as explanations that are just as accurate with your original approach.

Now you have a result to look for, and a result that would challenge your prediction. One disappointing session can’t show that a tool has changed how you think in general.

Compare a feasible alternative or a different routine

For demanding factual reading, paper can be an option when you can use it. Keep any accessibility features you rely on, and only compare options that meet your needs. Printing costs, or documents that keep changing, may make trying paper impractical.

You can also stay on screen and try writing a short account of what the document claims and what supports it. Check whether that extra work improves the result you need enough to be worth the time.

For notes, being more selective might help you capture the reason for a decision. But it could also leave out a fact you need. Keep the essential records, and check both completeness and the explanation. If being selective helps, try the same rule while typing before you give handwriting the credit.

Keeping the checking routine the same helps you see whether the device itself explains the difference. If the difference disappears, you have less reason to credit or blame the medium on its own.

Make a fair comparison for this task

Use similar material you haven’t seen before, the same access and the same amount of time. Decide on a simple scoring rule or answer key in advance. If you don’t have a reliable way to check the answer, note that gap before you pick a winner. For the policy example, check whether each explanation keeps the main rule, the exception and the reason behind them.

Don’t reread the same document in the other medium and treat it as a fresh comparison. You’d know the document better, as well as having changed the tool. For recorded briefings, keep the same chances to replay and review.

Repeat the comparison on other days, and change which approach goes first. Record the time it took, the hassle and the steps you actually used, as well as how good the result was. Different material, tiredness and expectations can still affect the comparison, so if a result is uncertain, keep it uncertain.

Keep a change when the benefit you saw is worth its cost for that task. If the results are mixed, or the alternative adds work without a useful benefit, keep your current approach or work out what you still need to check.

Choosing what works for this kind of task is enough. You don’t need to decide it’s best for everyone, or draw conclusions about a change in your mind.

What is your task really asking of you?

How about your daily life?

When does finishing something leave you unsure whether you did what it was for? Think about reading a policy, taking notes from a briefing, or searching to compare explanations that disagree.

Which result matters: keeping hold of an exception, explaining a reason, recording the details you need or understanding a disagreement?

Write down situations you’d like to look at. One good idea is enough.

A situation in my daily lifeThe result I need
________________________________________
________________________________________

Choose one reading, note-taking or search task that comes up again and again, where the tool is up to you. You can change your choice if an alternative would take away access you need or put essential records at risk.

My chosen situation: ____________________

Take this situation into the comparison below. Choosing it doesn’t mean your current tool needs replacing.

Compare one tool or routine

Start with the situation you chose. If you came straight here, choose an everyday reading, note-taking or search task where you could compare an optional tool or routine.

Keep any accessibility features you need and any essential records. If an alternative can’t meet those needs, keep the support you need and choose a different comparison, or note the limit.

  1. Define a result you can check. Write what finishing the task requires. For a policy, this could be explaining its rule, its exception and the reason behind them. For notes, check the details you need separately from whether you can explain a reason.
    Required result and checking rule: ____________________
  2. Name what you suspect. Pick a thinking step your usual way of working encourages or lets you skip. Predict a difference you could see with another approach, and say what would show your prediction was wrong.
    Thinking step, prediction and result that would challenge it: ____________________
  3. Choose a feasible comparison. Try another medium, or a different routine with the tool you have. Use similar material you haven’t seen before, the same access and time, and a scoring rule or answer key you prepare in advance.
    If you can’t reliably check the result, note what’s missing and leave the comparison open. For recorded briefings, keep the same chances to replay and review. Don’t use the same familiar document as if it were a fresh second try.
    Approaches, material and equal conditions: ____________________
  4. Observe and compare. Save what you produce and check it against your rule. Record what you missed, how good the explanation was, the time, the hassle and the thinking steps you used. Repeat on other days, changing which approach comes first.
    Observed differences and remaining uncertainties: ____________________
  5. Choose what to do for this task. Keep a change if its benefit for this task is worth its cost. If the result is unclear, keep your current approach, or write down the specific question you still need to look into.
    Keep, change or investigate further—and why: ____________________

Ask Jing

Become a Jingius.

Test one tool or routine fairly

Loading interactive tool…

Your next step

Finish with a comparison plan, or a choice backed by what you saw, including what’s still uncertain. An unresolved result is useful too. It doesn’t show a lasting change in how you think.

A note on the evidence

The reading studies looked at particular tasks of reading for understanding, and the note-taking reviews reach different conclusions about performance. To apply those findings to a work document or a briefing, you need to think about your own task and conditions. The search framework makes goals clearer; it doesn’t measure the effects of a change.

How we prepared this module

This module brings together reviews of reading and note-taking research, controlled reading experiments and a way of thinking about search. Made-up policy and briefing examples show how to define a result before you compare tools. The written exercise helps you look at one everyday task.

Sources