What Reading Comprehension Assessment Actually Means
Reading comprehension assessment is how a teacher finds out whether a student built meaning from a text, not just whether they can recall pieces of it. It separates the student who understood from the student who only recognized — and that distinction matters, because surface recall looks almost identical to comprehension until you ask the right question.
Here is the trap. A retell, a few quick questions, a “what was that about?” all feel like they measure comprehension, and sometimes they do. But a student can hand you a confident, complete-sounding answer built entirely on the salient bits: the bold words, the character names, the first and last lines. That doesn’t require understanding the text as a whole. It only requires noticing what stood out on the page.
Think of it like checking whether someone understood a movie by asking who was in it. They can list every actor and still have missed the plot. The cast is real information; it just isn’t the thing you were trying to measure. Comprehension assessment goes wrong the same way when the questions only ask students to retrieve what was easy to grab.
So a formative comprehension check has two jobs, not one. It has to surface what the student took away, and it has to probe past recall into meaning: can they explain it, infer from it, connect it to something else, notice when something doesn’t add up? A check that only does the first job will tell you a student “comprehended” right up until the moment that student hits a text where the bold print isn’t enough.
Why This Matters for Reading
Comprehension is the whole point of reading. A student who decodes every word perfectly and walks away with nothing has not read, in any sense that matters. That is why getting the assessment right is not a clerical task. It is how you find the students who are quietly slipping past you while their report cards say “meeting expectations.”
The Simple View of Reading helps explain why a surface check misses so much. Reading comprehension is the product of two things: the ability to decode the words and the ability to understand language. When a student can read the words aloud accurately and fluently but still can’t make meaning, the problem isn’t on the decoding side — it’s on the comprehension side, and no amount of more phonics will touch it.
If you want the full picture of how those pieces fit together, it’s worth understanding what reading comprehension actually is before you decide what your assessment is really measuring.
Here is the part most of us were never taught to watch for. When I was a reading interventionist teaching LLI, we were encouraged to assess students regularly with running records, and teachers gave the benchmark assessment at least three times a year. What teachers loved about that benchmark was that it seemed to give them everything at once: decoding, fluency, and comprehension, all in a single sitting.
It felt efficient. But even then, administering it myself, I kept circling back to one quiet doubt: was asking a student one or two direct questions and one or two inferential questions about the story ever really an adequate measure of whether they comprehended it? A handful of questions tells you whether a student caught those specific things. It does not tell you whether they understood the text. That was never a failing on any teacher’s part. It was a gap in the tools we were handed and trained to trust.
What This Looks Like in a Real Classroom
Go back to that fifth grader, but change only the question. Ask her to retell the chapter and she gives you a tidy summary that mirrors the headings, and it sounds like comprehension. Ask her instead to do something with the text, and the floor drops out. What does the legislative branch do that the judicial branch doesn’t? Why might the writers have split the power up that way? She stalls. The same reading that produced a confident retell a moment ago turns out to have been a list of labels with nothing underneath.
That second kind of question is the move. A strong formative comprehension check asks the student to explain in her own words, to infer something the text implies but doesn’t state, to connect this text to another, or to notice a contradiction. In a reading conference, that can be as small as stopping a student after a paragraph that conflicts with something stated earlier and asking, “Did you notice anything just now?” The student who is monitoring her own understanding catches it. The student who is reading on autopilot reads right past it, and now you can see the difference.
You’re also watching for the decoding-versus-comprehension signal while you do this. If a student reads the passage haltingly, stumbling over words, the breakdown may be downstream in word recognition, and that’s a different conversation. But when a student reads the words cleanly and still can’t do anything with the meaning, you’ve localized the problem. The assessment has done its job. It has told you where to look.
What this assessment does not do is tell you what to do next. Naming the gap and closing it are two different acts, and the instructional response, how to actually build the active processing this student is missing, lives in its own work. Assessment points you there. It diagnoses; it doesn’t prescribe.
