Measurement – Embrace the Absurd

Matrix Sampling: Resurrected

It is impossible to read an article or hear a presentation about the future of large-scale state testing without some discussion of matrix sampling. If your primary concerns about large-scale testing are time and cost, the answer is matrix sampling. If your primary concern is coverage of comprehensive and complex standards like the Next GenerationContinue reading “Matrix Sampling: Resurrected”

Measuring Measures and Measurers

I have to confess that I fell down a rabbit hole while writing my blog post this week. My original plan was to comment on a Hechinger Report article published late last month, Standardized tests in their current format are ‘incredibly antiquated, with the gripping subtitle, ‘Some experts suggest using this moment to change theContinue reading “Measuring Measures and Measurers”

DIY DEI

As I observe our field’s nascent do-it-yourself (DIY) attempts to embrace, understand, and enact the concept of diversity, equity, and inclusion (DEI) what I have seen can best be described as akin to the enthusiasm and curiosity of a baby discovering its feet for the first time. And like the baby, I am sure thatContinue reading “DIY DEI”

Based on a True Story

The truth of the matter (and that’s the only context in which I’ll use the word truth when discussing the reporting of test scores) is that those five words in the title would provide much better guidance on the interpretation and use of test scores than any of our attempts at technically based explanations ofContinue reading “Based on a True Story”

Second Thoughts

Eugenics. It’s the original sin of measurement and testing. Our Curse of Cain. Our Cross to Bear. Of all of the controversies included in Historical and Conceptual Foundations, eugenics may be the one most directly related to testing and the use of tests. It is also the controversy that receives the most direct attention inContinue reading “Second Thoughts”

The Man in the Mirror

You may fool the whole world Down the pathway of years And get pat on your back as you pass But your final reward Will be heartaches and tears If you’ve cheated that guy in the glass. I will say upfront that among my favorite memories from my years in large-scale testing are the conversationsContinue reading “The Man in the Mirror”

Reliability: Measurement’s Middle Child

Validity. Reliability. Fairness. Reliability is one of the big three foundations of educational measurement and testing. It’s right up there with a chapter of its own in the Part 1 of the joint Standards along with Validity and Fairness. We’re supposed to love and respect them all the same. But we all know that ReliabilityContinue reading “Reliability: Measurement’s Middle Child”

Know Thyself

To know thyself is the beginning of wisdom – Socrates Identity. That’s the first word that comes to mind when I think about the state of educational measurement and assessment in 2021. On so many levels, our field, and the individuals within it, are in search of an identity. Derek Briggs, our nominal and effectiveContinue reading “Know Thyself”

Best In Show

If you are like me – and it occurs to me that this may be the first time I have ever typed that phrase – your total exposure to dog shows consists of watching the National Dog Show that immediately follows the annual appearance of Santa at the Macy’s Thanksgiving Parade on NBC (and perhapsContinue reading “Best In Show”

Vive La Variance!

To educate is to change. Instruction and learning are about change. Educational measurement is defined by variance. Literally. The fundamental concepts in the field are expressed in terms of variance. One of the first techniques that we learn as eager young graduate students is analysis of variance. Without variance, our lives as psychometricians, much likeContinue reading “Vive La Variance!”