Say you’re reading a procedure you want to learn. With the instructions in front of you, every step seems clear. Then you close the page and realize you don’t know what comes next.
With the page open, you were following someone else’s explanation. With it closed, you had to come up with the steps yourself. That’s the part you need to practice if you want to remember the procedure later.
That doesn’t mean you should struggle through every task. Sometimes a worked example gives you what you need to get started. The useful question is what the effort makes you practice, and whether you have enough help to learn from it.
This module is for adults learning facts, ideas or procedures they want to remember and use later. You need enough background or help to make an attempt, and a reliable way to check your answers.
What you’ll get from this module
In this module
By the end of this module, you’ll know how to choose useful practice and when to make it easier. You’ll learn what to try, how to check your answer and when to come back to it. Then you’ll pick something from your daily life and use a written exercise to plan your practice. We’ll draw on lab experiments, reviews that combine the findings of many studies, a review of complex learning and a classroom study of definition and application questions.
Ask Jing
Become a Jingius.
What makes effort useful for learning?
Lab experiments: what helps you remember now may not help you remember later.
Henry L. Roediger III and Jeffrey D. Karpicke’s 2006 study compared rereading with trying to remember information without looking. In their first experiment, 120 Washington University undergraduates read short passages of prose. Then they either studied them again or wrote down what they remembered.
After five minutes, rereading led to better recall: 81% versus 75%. After one week, the result flipped. Students who had first practiced recalling remembered 56%, compared with 42% after rereading. A test after two days also favored recall practice.
Rereading helped students remember more five minutes later. But that early advantage didn’t show which method would help them remember more a week later. How easy studying feels now can be a poor guide to what you’ll keep.
Why it matters: In a second experiment, students felt more confident after studying the passages again and again. Yet a week later they remembered less than students who had tested themselves again and again. These were experiments with students and prose passages. They show why feeling ready and a later memory test can give different answers.
Read the experiments on testing and later retention.
Review of many studies: spreading practice out can help you remember words.
What you do during practice matters, and so does when you come back to it. Nicholas J. Cepeda and colleagues’ 2006 review brought together studies of spaced practice: returning to material after a gap. The tasks involved remembering words, such as lists of words and pairs of words learned together.
Across the studies the review compared, average recall was 36.7% after practice packed into one session and 47.3% after spaced practice. That’s a difference of 10.6 percentage points. Study time was the same, so the advantage didn’t simply come from spending more time with the material.
The review also looked at how long to wait between study sessions. The best gap depended on how long people needed to remember the information. Waiting longer wasn’t always better.
Why it matters: This gives you a reason to save some practice for later instead of doing it all at once. The average mixes different tasks and delays, so it can’t predict how much you’ll improve. The useful choice is a later session when you can still work with what you’re learning.
Read the synthesis of distributed verbal practice.
Lab experiment: a wrong guess can help when the answer follows.
You might hold back from trying before you know the answer. Nate Kornell, Matthew Jensen Hays and Robert A. Bjork’s 2009 experiments looked at what happens when learners try to answer before they see the correct answer.
In Experiment 5, 30 UCLA undergraduates learned pairs of words that were loosely connected. Sometimes they saw the first word and tried to guess its partner before seeing it. Other times they read both words together. Each pair got the same total time.
After an average of 38 hours, people remembered a pair better when they had guessed wrong and then seen the answer than when they had only read it. Pairs they guessed correctly at first were left out of that comparison.
Why it matters: A wrong first answer didn’t stop people remembering better later. But they saw the correct answer after trying. The result supports a quick attempt followed by the answer. It gives no reason to keep guessing without being corrected.
Read the experiments on unsuccessful attempts followed by answers.
Review of many studies: mixing practice helps with some material more than other material.
Sometimes you need to choose which answer or method fits. Matthias Brunmair and Tobias Richter’s 2019 review compared mixed practice, called interleaving, with blocked practice. Mixed practice brings different related categories together. Blocked practice keeps examples from one category together.
Across the studies, mixed practice helped with paintings and math tasks. For words, blocked practice worked better. For texts that explain things, the results were unclear. How similar the categories were also mattered.
Practicing one type of problem lets you repeat the same method. Mixing related types makes you choose the method as well. Switching between unrelated subjects doesn’t give you that same choice to practice.
Why it matters: Use this finding when telling similar options apart is part of what you need to learn. Mixing everything just to make practice harder misses the point.
Read the synthesis of interleaved learning and its conditions.
Research review: too much difficulty can get in a beginner’s way.
Choosing useful effort also means knowing when you need help. Ouhao Chen and colleagues’ 2018 review discusses learning tasks with many parts that you have to keep in mind at the same time.
The review describes cases where studying a worked example helped more than adding a problem to solve. A worked example shows how someone reaches a solution. The authors argue that how demanding a task is depends on two things: how many parts you must handle at once, and what you already know.
That puts a practical limit on difficulty. Someone who understands the parts may be able to learn by trying to solve the problem. Someone who can’t make a real start may need an explanation or a worked example first.
Why it matters: The lesson is to choose help that lets you start learning how the parts fit together. A harder task isn’t automatically a better one for learning.
Read the review of difficulty and complex learning.
Classroom experiment: knowing a definition and applying an idea are different goals.
Once you can make an attempt, it still needs to practice what you want to learn. Steven C. Pan and colleagues’ 2019 study looked at online quizzes on technical terms, with feedback on the answers, in a course on the structure of the nervous system.
Experiment 1 involved 85 master’s and doctoral students in occupational therapy. Each student took quizzes on one topic but not the other, and which topic was quizzed differed from student to student. The later practice exam came about 12 weeks after the last quiz on sensation and six weeks after the last quiz on movement.
The definition questions repeated questions from the quizzes. The conceptual questions, about applying ideas, hadn’t been in the quizzes.
On definition questions, students scored better on quizzed material: 53% versus 43%. On conceptual questions, the overall scores were 41% versus 37%. That difference wasn’t statistically significant, which means the result was too uncertain to show a benefit on those questions. It also doesn’t show that the quizzes had no benefit for them.
The study didn’t compare quizzing with spending the same time studying the material again. It clearly showed better scores on definitions, while the overall result for conceptual questions stayed uncertain. Knowing what a term means doesn’t by itself show that you can use the idea in a new problem.
Why it matters: That’s why your practice plan needs to match what you want to do later. If you need both to remember a definition and to apply it, check each one separately.
Read the classroom study of definition and conceptual questions.
What this means for you
Start with what you want to remember or do later. Choose practice that asks you to do that, with enough help to get started and a reliable way to check. Then leave room to try again later.
Decide whether this task is for learning or for getting done
Ask what you want to remember, explain or do once the lesson is over. “Understand this procedure” can become “explain the steps without the page” or “choose the right procedure for a new example.”
Those are different goals. Explaining the steps checks whether you remember them. Choosing a procedure checks whether you know when to use it. Naming your goal helps you pick practice that actually tests it.
Not every task needs to become a learning exercise. If you just need to get the work done and you have reliable help, using a reference can be a sensible choice. If you want to keep the skill, save a chance to do the important part yourself.
Try something manageable, then check it
Read or study enough to get started. Then hide the answer and answer a question, explain the steps or try the next part. Compare what you came up with against a reliable source, and fix any mistakes or gaps.
Trying gives you an answer to look at. It doesn’t tell you whether that answer is right. Compare your answer with the correct one to find what you missed or got wrong.
If you can’t make a real start, get more help. Study an example with notes, or try a smaller step before taking on the whole task. You need a starting point you can learn from, so you can see how the parts fit together.
Say you’re learning a spreadsheet procedure. If you can’t explain why the example uses a particular formula, study that explanation before you hide it. Then try explaining the choice or doing one step yourself. If you can follow the example but can’t make that choice, the choice is the part to practice.
Come back after a gap you can adjust
Save some practice for later instead of using it all at once. Decide when to come back by thinking about when you’ll need what you’re learning. For something you need next week, tomorrow and again just before you use it can be a first plan.
When you come back, try to remember the material before you check it. If you keep failing to remember it, relearn what’s missing or shorten the gap. The gap should give you another useful attempt, not leave you stuck again and again.
Keep the effort of answering, explaining or choosing for yourself. You can still make the page easier to read and use reminders to bring you back.
Mix related options when choosing matters
If you need to choose a method, include practice that asks which method fits. Mix related types of problem and explain why you chose each method. Make sure you understand each type before you try to tell them apart.
In the made-up spreadsheet example, repeating one formula can mean the choice of formula is already made for you. A mixed set makes you choose it. Explaining why it fits makes the choice itself part of the attempt.
Don’t mix unrelated topics just for variety. The research findings depend on the material, and practicing one type at a time can still be the right call. Mix when there’s a useful choice to practice, then check how you handle that choice later.
Check what you can do later, including using the idea
Before a later attempt, write down what you expect to remember or do. Try a similar task in the conditions you expect when you use the skill, including the help you’ll have. Then check it and compare the result with your prediction.
If you can remember a definition but can’t apply it, change your next practice question so it asks you to apply it. If you understand the task but miss a step, fix that gap and come back to a similar attempt later.
One result doesn’t prove you’ve mastered something. Use it to choose your next practice step. If you need to use what you know in a different situation, check that separately.
Now you can answer the question raised by the open page: what can you do once the explanation is no longer giving you the answer?
How about your daily life?
Where would you like to remember something after the instructions are gone? You might pick a procedure you keep rereading, an idea you want to explain or types of problem you need to tell apart.
Write down a few possibilities if that helps you choose. One good idea is enough.
| Something I want to remember or do later | What I want to improve |
|---|---|
| ____________________ | ____________________ |
| ____________________ | ____________________ |
Which situation would be most useful to explore now?
My chosen situation: ____________________
Pick something you’re learning to use later, where you have enough background or help to try it and a reliable way to check. You can change your choice. Take this situation into the exercise below.
Plan one useful learning attempt
Start with your chosen situation. If you came straight here, pick a fact, an idea or a procedure you want to remember and use later. You need enough background or help to attempt it, and a reliable source to check against.
If either is missing, work out which explanation, worked example or reliable answer you need before you go on. Naming that next step clearly can be your useful result. If today you just need to get the job done, you can keep using the reference and choose a different situation for learning.
- Name what you want to learn. Write what you want to remember, explain or do later. Say where you’ll use it and what help you expect to have.
What I want to do later, and under what conditions: ____________________ - Choose an attempt that practices it. Study enough to get started, then hide the answer and try it yourself. If you need to choose between methods, include related options and explain which one fits. If you need to use an idea, include a question that asks you to apply it.
If you can’t make a real start, study a worked example or break the task into a smaller step. Keep the help you need, but make the answer your own.
My attempt and any support needed: ____________________ - Check and correct. Compare your answer with a correct answer or a reliable source. Find mistakes and gaps, then fix them. If you can’t find out the correct answer, get reliable feedback before you count the attempt as a success.
Where I will check, and what needs fixing: ____________________ - Plan when to come back. Choose another time to practice that fits when you’ll need to use what you’re learning. Before that attempt, write down what you expect to manage. Try a similar task in those conditions, then check it.
When I will return and what I expect to do: ____________________ - Use the result to choose your next practice. Compare the later attempt with your prediction. If you keep failing to remember, relearn it or shorten the gap. If you can’t get started, add an example or a smaller step.
If you can remember a definition but can’t apply it, practice applying it on its own. If choosing between methods is the hard part, mix related types of problem so you practice making that choice. One attempt tells you what to try next. It doesn’t prove you’ve mastered the skill.
What happened and my next practice choice: ____________________
Ask Jing
Become a Jingius.
Your next step
You have a usable plan when it says what you want to learn, what you’ll try, how you’ll check it and when you’ll come back. After you come back, write down your next practice choice or the help you still need.
A note on the evidence
These studies looked at particular memory tasks and learning settings. When you apply their findings to something new, think about what that task asks you to remember or do.
Remembering an answer, applying an idea and finishing a task with help are different achievements. Keep the help that makes learning possible, and check what you actually need to do later.
How we prepared this module
This module brings together experiments, reviews of many studies and a review of complex learning to explain practical choices about how to practice. Made-up procedure and spreadsheet examples show those choices in action. The written exercise helps you plan and review one learning attempt.
Sources
- Henry L. Roediger III and Jeffrey D. Karpicke. (2006-03). Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention. Psychological Science, 17(3), 249–255. Published article; Experiment 1 method and results, pp.250–251; Experiment 2 questionnaire and final tests, pp.252–253.
- Nicholas J. Cepeda, Harold Pashler, Edward Vul, John T. Wixted, and Doug Rohrer. (2006-05). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132(3), 354–380. Published article; abstract p.354; Table 1 and following discussion, p.359.
- Nate Kornell, Matthew Jensen Hays, and Robert A. Bjork. (2009-07). Unsuccessful Retrieval Attempts Enhance Subsequent Learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4), 989–998. Published article; Experiment 4 procedure and Experiment 5 method/results, pp.994–995.
- Matthias Brunmair and Tobias Richter. (2019-11). Similarity matters: A meta-analysis of interleaved learning and its moderators. Psychological Bulletin, 145(11), 1029–1052. Accepted manuscript, not the copy of record; abstract, manuscript p.2.
- Ouhao Chen, Juan C. Castro-Alonso, Fred Paas, and John Sweller. (2018-08-13). Undesirable Difficulty Effects in the Learning of High-Element Interactivity Materials. Frontiers in Psychology, 9:1483. Published full-text HTML; Abstract; “Cognitive Load Theory and Human Cognitive Architecture”; testing-effect and worked-example discussions.
- Steven C. Pan, James Cooke, Jeri L. Little, Mark A. McDaniel, Erin R. Foster, Lisa Tabor Connor, and Timothy C. Rickard. (2019, Winter). Online and Clicker Quizzing on Jargon Terms Enhances Definition-Focused but Not Conceptually Focused Biology Exam Performance. CBE—Life Sciences Education, 18(4):ar54. Published article; Experiment 1 participants and procedure, pp.3–4; “Practice Exam,” p.5.
