Say you have saved another spreadsheet tutorial. The demonstration makes sense. You can picture the finished summary. But you have not yet tried to make one yourself.
So what has changed? You may have gathered useful preparation. Whether you can make the summary is a separate question. To answer it, start with the purpose of your learning, then find something relevant you can actually check.
This module is for self-directed learning or work goals where you have a safe, relevant way to try what you are learning.
What you’ll get from this module
In this module
By the end of this module, you’ll know what your learning has helped you do and what you still need to try. Research on watching, taking courses, tracking progress and making plans shows why these are different questions. You’ll explore practical choices, pick a situation from your own life and complete a short written check. You’ll leave able to say where you are, choose a next step you can take, or name an obstacle to clear.
Ask Jing
Become a Jingius.
What shows progress beyond taking in information?
Laboratory experiment: feeling ready and showing a skill are different.
Michael Kardas and Ed O’Brien (2018) tested whether watching something many times changed the scores people expected and the scores they got. University students watched a dart-throwing video once or 20 times. Some then predicted their score. Others threw a dart.
People who watched more predicted higher scores. Among those who threw a dart, the statistical test did not show a clear improvement from the extra viewing. The people who predicted and the people who threw were different people. So the study did not track the same person growing more confident and then missing the target.
Why it matters: Watching more raised people’s expectations. It did not show a clear improvement in their scores. Feeling ready, then, was not enough to show what they could do. The result does not prove that watching teaches nothing.
Read the experiment on watching and expected skill.
Systematic review: watching can still help you learn.
That does not make watching worthless. Julian Rudisch and colleagues (2024) reviewed 18 studies of fairly young adults. The studies looked at learning to adjust reaching movements when the task changed.
The review found that people could adapt by watching another person, without practising the movement themselves. The gains were generally smaller than with physical practice, though direct comparisons were limited. The evidence covers these particular movement tasks.
Why it matters: Together, these findings explain how watching can be useful without proving you can do what you watched. People can learn by watching. Their expectations can still run ahead of what they show. What matters is the particular task, and what the result tells you.
Read the review of learning reaching movements through observation.
Course study: finishing a course needs a purpose.
Justin Reich (2014) looked at surveys and activity logs from nine HarvardX online courses. People described different intentions. Some were browsing, some planned to do a few activities, some wanted a certificate. People who intended to finish were more likely to finish.
The people who answered the survey were more active than other people who had signed up. So the results do not stand for everyone enrolled equally. The link also does not show that stating an intention caused anyone to finish.
Why it matters: The useful lesson is about choosing your measure. A certificate records that you finished a course. It does not capture every benefit of taking part. And an unfinished course, on its own, cannot tell you whether you learned what you came for.
Read the study of course completion and learner intentions.
Review of experiments: tracking progress can help people reach goals.
Benjamin Harkin and colleagues (2016) brought together 138 studies. In each, people were put at random into different groups. The studies compared ways of encouraging people to track their progress with groups that got no such encouragement. On average, encouraging people to track progress helped them reach their goals.
Most of the studies were about health goals. The estimated benefit was smaller once the analysis allowed for studies that might never have been published. Using these findings for self-directed learning means borrowing evidence from a different setting.
Why it matters: Tracking progress means checking where you are against your goal. For learning, that means looking for a change that matters to what you want to do. Counting tutorials tells you how many you have. Checking an attempt tells you something about what you can do.
Read the review of progress monitoring and goal attainment.
Field experiments: a plan is still not the same as finishing.
René F. Kizilcec and colleagues (2020) studied small interventions across 247 massive open online courses. The researchers tested planning prompts that asked learners to describe when and how they would get through the whole course.
Among committed learners who were fluent in English, the statistical tests did not show a clear improvement in finishing rates from those prompts. Some early gains in activity appeared, then faded as the course went on. The finding is about particular prompts and particular learners. It does not mean all planning is useless.
Why it matters: Making a plan tells you when you intend to act. It does not tell you what happened when you tried. Keep those two apart when you describe your progress: a scheduled attempt has not happened yet.
Read the field study of interventions in online courses.
What this means for you
Use your purpose to decide what counts as progress. Then separate what you have seen from what you expect. You can value useful preparation and still check what it has helped you do.
Name what you want from the material
You might want to learn the basics, do a task, finish a project, explore what is possible or simply enjoy something. Each of these calls for a different judgment.
If you want to make a spreadsheet summary, a usable summary or a relevant attempt gives you something to look at. If you are exploring, noticing a new distinction or working out what you prefer may be all you need. Enjoyment needs no finished product.
This is why an unfinished course is not automatically a problem. Ask what you wanted from it before you decide whether finishing matters. You do not have to complete material that no longer serves you just because you already have it.
Choose a small check that answers the real question
When your purpose involves doing something, pick one small part of the task to try. For the spreadsheet example, use a practice copy. If the task needs equipment, access or supervision you do not have, write down that obstacle instead of forcing an attempt.
The basics and worked examples may be the preparation you need first. If a check would be too advanced, work out what you need to learn first, or ask for feedback. A useful check shows what you can do now and where you need help. One attempt does not prove lasting mastery.
Say you try making the summary in a practice copy and get stuck at one step. You now have a specific question for the tutorial. Find that instruction and go back to the attempt. Now you know what help you need from the tutorial.
You can also explain an idea without looking, then check it. Or look at a decision that changed and the reason it changed. You do not need a public finished product.
Describe the result without turning it into a verdict on yourself
Keep a short record of what changed and why it matters. Use the description that fits the evidence you have:
| Description | What it means for your next choice |
|---|---|
| Progress shown | You can point to a relevant change, shown by a result or an attempt. Name what it shows and what is left to learn. |
| Useful preparation | The material is helping you learn the basics or get ready for a next step. Say what it prepares you for, then choose a later check when the time is right. |
| Not yet checked | You do not yet have enough information. Name a small check, or the obstacle in its way. |
| Attempt put off | A relevant step you could take is still undone. Work out what pushed it aside, and whether another resource would push it aside again. |
These descriptions help you tell different situations apart. They are not judgments about laziness or motives. If attempts keep being put off, look at the obstacles rather than assuming you are avoiding the work.
Pause extra resources when they put off something you can try
Use this rule only when all the conditions fit. You are about to get another optional resource for the same goal. You have a safe, relevant way to try what you are learning. And getting more information would put off that attempt.
Make one small attempt first. If now is not possible, name the next occasion that is. Then wait until the attempt before you get that optional resource. Scheduling an attempt is a commitment. It is not the attempt itself.
If the attempt shows that you need particular instruction or preparation first, get that help and come back to the attempt. You still get the instruction you need for the next step. You do not have to finish a whole course or get through your saved collection first.
When equipment, supervision, access, tiredness or other duties stop you from trying, say so. Use preparation that deals with the obstacle, if that helps. Pick a time to check again that fits the task. Then look at what actually happened.
How about your daily life?
Where have you gathered information for something you want to do? You might have tutorials for a work task, reading for a decision, or a course meant to build the basics.
What would you like to understand about that situation: what has changed, what preparation is still useful, or why an attempt has not happened?
List any situations worth exploring. One good idea is enough.
| Situation | What I want to understand |
|---|---|
| ____________________ | ____________________ |
| ____________________ | ____________________ |
My chosen situation: ____________________
Carry this situation into the exercise. Choosing it does not yet mean you should stop gathering information.
Check progress on one goal
Start with your chosen situation. If you have come straight here, choose one self-directed learning or work goal and the information you have been gathering for it.
Choose a small part of your task that you can try safely, such as a spreadsheet task in a practice copy. If you lack the equipment, access, supervision or basics you need, record the obstacle and seek the missing piece or some feedback instead.
- Name the purpose. Are you learning the basics, doing a task, finishing something, exploring or enjoying it? Exploring and enjoying need no finished product.
My purpose: ____________________ - Identify a relevant change. Describe a usable result, what an attempt revealed, or a decision that changed. Say why that change matters to your purpose. A count of resources on its own does not show the skill you are after.
What changed, and why it matters: ____________________ - Check what is still uncertain. Try a small part of the task. Or explain an idea without looking and then check it. Or look at what followed a changed decision. One attempt is limited evidence, not lasting mastery. If you cannot try it, name the obstacle and the preparation that would help.
Check and result, or obstacle: ____________________ - Describe your position. Choose progress shown, useful preparation, not yet checked or attempt put off. Add the reason. Do not read your motives into a delay.
Description and reason: ____________________ - Choose the next occasion and decide about resources. Name a next step you can take and when you will look at what happened. Use the pause on optional resources only when all these conditions hold. The optional resource serves the same goal. You have a safe, relevant way to try. Getting more information would put off that attempt.
Make the small attempt first, or schedule the next possible occasion and wait until the attempt before you get the optional resource. If the attempt shows that you need particular instruction or preparation first, get that help and come back. A scheduled attempt is still waiting to happen. You do not need to finish everything you own.
Next step, occasion and optional-resource decision: ____________________
Ask Jing
Become a Jingius.
Your next step
You have finished the check when you can describe your position with a reason and name a next action or an obstacle still in the way. Come back at your chosen occasion and record what actually happened.
A note on the evidence
What watching teaches depends on the task. Finishing a course, and meaning to take part, are not direct measures of everything someone learned. The evidence on tracking progress comes mostly from health settings. The planning findings concern particular online-course prompts and particular learners.
Use these distinctions to choose a relevant check and to read its result. Preparation can help before a finished output appears. A single attempt gives only a limited view of what you can do.
How we prepared this module
This module brings together experiments, reviews and a study of online courses to separate taking in information, preparing, and making progress towards a chosen purpose. A made-up spreadsheet example shows how an attempt can reveal a specific thing you need to find out. The exercise applies these distinctions to one situation.
Sources
- Michael Kardas and Ed O’Brien. (April 2018; online 16 February 2018). Easier Seen Than Done: Merely Watching Others Perform Can Foster an Illusion of Skill Acquisition.. Psychological Science 29(4), 521–536. Author-hosted published article. Supporting passage: Experiment 2, pp.525–526.
- Julian Rudisch, Luis K. H. Holzhauer, Karmen Kravanja, Fred H. Hamker, and Claudia Voelcker-Rehage. (3 October 2024). A systematic review of observational practice for adaptation of reaching movements.. npj Science of Learning 9, article 61. Publisher PDF. Supporting passage: Discussion and Reporting biases and certainty of evidence, pp.10–11.
- Justin Reich. (8 December 2014). MOOC Completion and Retention in the Context of Student Intent.. EDUCAUSE Review. Publisher web article. Supporting passage: Survey and Log Data; Measures; Intention and Completion.
- Benjamin Harkin, Thomas L. Webb, Betty P. I. Chang, Andrew Prestwich, Mark Conner, Ian Kellar, Yael Benn, and Paschal Sheeran. (February 2016; online 19 October 2015). Does Monitoring Goal Progress Promote Goal Attainment? A Meta-Analysis of the Experimental Evidence.. Psychological Bulletin 142(2), 198–229. Accepted manuscript. Supporting passage: Accepted manuscript pp.2,24,26,38.
- René F. Kizilcec, Justin Reich, Michael Yeomans, Christoph Dann, Emma Brunskill, Glenn Lopez, Selen Turkay, Joseph Jay Williams, and Dustin Tingley. (30 June 2020; online 15 June 2020). Scaling up behavioral science interventions in online education.. Proceedings of the National Academy of Sciences 117(26), 14900–14905. Author-hosted published early-edition PDF. Supporting passage: Early-edition PDF pp.2–3, Results and Planning Supports Short-Term Persistence.
