Once again, those of us on the technical side of large-scale assessment and educational measurement find ourselves behind the curve. In the 1990s, the public clamored for achievement levels and criterion-based results while we were comfortable reporting percentile ranks and grade equivalent scores. Just as we were “getting a handle” on standard setting and percentContinue reading “Slow Down, You Move Too Fast”
Category Archives: Measurement
The Ernie Scale
Based on a true story In the late 1980s and early 1990s, Rich Hill and Stuart Kahl led their little company that could, Advanced Systems, in reimagining, reinventing, and reshaping large-scale state testing. We were a ragtag band of young idealists who didn’t know any better. Our successes and failures were spectacular. Little that weContinue reading “The Ernie Scale”
Testonyms
In elementary school, first I learned about synonyms and antonyms. Synonym – Same; Antonym – Opposite; Got it. And synonym and antonym are such cool words – “and sometimes y.” It got a little more complicated with homonyms, which might be homophones (pronounced the same, differ in meaning or spelling), homographs (spelled the same, differContinue reading “Testonyms”
Matrix Sampling: Resurrected
It is impossible to read an article or hear a presentation about the future of large-scale state testing without some discussion of matrix sampling. If your primary concerns about large-scale testing are time and cost, the answer is matrix sampling. If your primary concern is coverage of comprehensive and complex standards like the Next GenerationContinue reading “Matrix Sampling: Resurrected”
Measuring Measures and Measurers
I have to confess that I fell down a rabbit hole while writing my blog post this week. My original plan was to comment on a Hechinger Report article published late last month, Standardized tests in their current format are ‘incredibly antiquated, with the gripping subtitle, ‘Some experts suggest using this moment to change theContinue reading “Measuring Measures and Measurers”
DIY DEI
As I observe our field’s nascent do-it-yourself (DIY) attempts to embrace, understand, and enact the concept of diversity, equity, and inclusion (DEI) what I have seen can best be described as akin to the enthusiasm and curiosity of a baby discovering its feet for the first time. And like the baby, I am sure thatContinue reading “DIY DEI”
Based on a True Story
The truth of the matter (and that’s the only context in which I’ll use the word truth when discussing the reporting of test scores) is that those five words in the title would provide much better guidance on the interpretation and use of test scores than any of our attempts at technically based explanations ofContinue reading “Based on a True Story”
Second Thoughts
Eugenics. It’s the original sin of measurement and testing. Our Curse of Cain. Our Cross to Bear. Of all of the controversies included in Historical and Conceptual Foundations, eugenics may be the one most directly related to testing and the use of tests. It is also the controversy that receives the most direct attention inContinue reading “Second Thoughts”
The Man in the Mirror
You may fool the whole world Down the pathway of years And get pat on your back as you pass But your final reward Will be heartaches and tears If you’ve cheated that guy in the glass. I will say upfront that among my favorite memories from my years in large-scale testing are the conversationsContinue reading “The Man in the Mirror”
Reliability: Measurement’s Middle Child
Validity. Reliability. Fairness. Reliability is one of the big three foundations of educational measurement and testing. It’s right up there with a chapter of its own in the Part 1 of the joint Standards along with Validity and Fairness. We’re supposed to love and respect them all the same. But we all know that ReliabilityContinue reading “Reliability: Measurement’s Middle Child”
You must be logged in to post a comment.