Quality Education / The Thing Being Measured

Learning is distributed across a life, not stored in a course

Whatever a graduate can do, the course is only part of the reason.

Ask what caused a person to become competent and the honest answer is a tangled list. The teaching contributed. So did the family that made study possible, the job that supplied practice, the colleague who explained the thing that the class had not, the earlier education that made the later education legible, and a temperament formed long before anyone enrolled. Attempting to isolate the contribution of the course from that tangle is not merely difficult, it is a task with no clean solution, because the contributions interact. The same teaching lands differently on a person with time to think than on a person working two jobs.

This entanglement is the reason comparisons between providers so often mislead. Two programs teaching similar content to differently situated cohorts will produce different figures on almost any measure, and the difference will be read as a difference in teaching quality when much of it is a difference in who walked through the door. Adjusting for this is possible in principle and treacherous in practice, because every adjustment embeds an assumption about which differences are the institution's responsibility and which are not, and that is a value judgement dressed as a technical one.

None of this means providers are not responsible for anything. It means their responsibility is for what they add, not for the total, and almost no common measure separates the two. A modest discipline follows: whenever a figure is used to compare institutions, somebody should be able to say out loud what would have happened to those same students elsewhere. Usually nobody can. Saying so is not defeatism, it is accuracy, and it changes how much weight the comparison can bear. A comparison that nobody can interpret is not neutral, because it will be interpreted anyway, and usually in whichever direction suits the person quoting it.