Measurement – Embrace the Absurd

Slow Down, You Move Too Fast

Once again, those of us on the technical side of large-scale assessment and educational measurement find ourselves behind the curve. In the 1990s, the public clamored for achievement levels and criterion-based results while we were comfortable reporting percentile ranks and grade equivalent scores. Just as we were “getting a handle” on standard setting and percentContinue reading “Slow Down, You Move Too Fast”

The Ernie Scale

Based on a true story In the late 1980s and early 1990s, Rich Hill and Stuart Kahl led their little company that could, Advanced Systems, in reimagining, reinventing, and reshaping large-scale state testing. We were a ragtag band of young idealists who didn’t know any better. Our successes and failures were spectacular. Little that weContinue reading “The Ernie Scale”

Testonyms

In elementary school, first I learned about synonyms and antonyms. Synonym – Same; Antonym – Opposite; Got it. And synonym and antonym are such cool words – “and sometimes y.” It got a little more complicated with homonyms, which might be homophones (pronounced the same, differ in meaning or spelling), homographs (spelled the same, differContinue reading “Testonyms”

Matrix Sampling: Resurrected

It is impossible to read an article or hear a presentation about the future of large-scale state testing without some discussion of matrix sampling. If your primary concerns about large-scale testing are time and cost, the answer is matrix sampling. If your primary concern is coverage of comprehensive and complex standards like the Next GenerationContinue reading “Matrix Sampling: Resurrected”

Measuring Measures and Measurers

I have to confess that I fell down a rabbit hole while writing my blog post this week. My original plan was to comment on a Hechinger Report article published late last month, Standardized tests in their current format are ‘incredibly antiquated, with the gripping subtitle, ‘Some experts suggest using this moment to change theContinue reading “Measuring Measures and Measurers”

DIY DEI

As I observe our field’s nascent do-it-yourself (DIY) attempts to embrace, understand, and enact the concept of diversity, equity, and inclusion (DEI) what I have seen can best be described as akin to the enthusiasm and curiosity of a baby discovering its feet for the first time. And like the baby, I am sure thatContinue reading “DIY DEI”

Based on a True Story

The truth of the matter (and that’s the only context in which I’ll use the word truth when discussing the reporting of test scores) is that those five words in the title would provide much better guidance on the interpretation and use of test scores than any of our attempts at technically based explanations ofContinue reading “Based on a True Story”

Second Thoughts

Eugenics. It’s the original sin of measurement and testing. Our Curse of Cain. Our Cross to Bear. Of all of the controversies included in Historical and Conceptual Foundations, eugenics may be the one most directly related to testing and the use of tests. It is also the controversy that receives the most direct attention inContinue reading “Second Thoughts”

The Man in the Mirror

You may fool the whole world Down the pathway of years And get pat on your back as you pass But your final reward Will be heartaches and tears If you’ve cheated that guy in the glass. I will say upfront that among my favorite memories from my years in large-scale testing are the conversationsContinue reading “The Man in the Mirror”

Reliability: Measurement’s Middle Child

Validity. Reliability. Fairness. Reliability is one of the big three foundations of educational measurement and testing. It’s right up there with a chapter of its own in the Part 1 of the joint Standards along with Validity and Fairness. We’re supposed to love and respect them all the same. But we all know that ReliabilityContinue reading “Reliability: Measurement’s Middle Child”