Measurement – Embrace the Absurd

Right Before Our Very Eyes

It’s time for educational measurement, or at least assessment specialists, to say goodbye to latent traits, hidden constructs, and true scores. They are useful concepts, in theory. In practice, well, they really haven’t helped us provide useful information to stakeholders, and that is the name of the game. Admit it, you were a bit skepticalContinue reading “Right Before Our Very Eyes”

Do Re Mi-ting Expectations

Let’s start at the very beginningA very good place to startWhen you read, you begin with A-B-CWhen you sing, you begin with Do-Re-Mi When you report state test results, you begin with … What do you begin with when reporting state test results? I know that testing begins with hopes, dreams, and aspirations (pernicious orContinue reading “Do Re Mi-ting Expectations”

So, you’re interested in a career in educational measurement

During the first pandemic summer I attended a virtual NCME session organized by Derek Briggs titled, “Teaching and Learning ‘Educational Measurement’: Defining the Discipline?” In that session distinguished panelists addressed the critical question, “What should it mean to be an educational measurement expert in the future?” Later in 2020, as president of NCME, Derek convened aContinue reading “So, you’re interested in a career in educational measurement“

I Blog, Therefore I Am

We live in a world where the gap in time between having a thought and sharing it with the world has been all but eliminated. Case in point, this is the 200th post I have published since launching my blog in 2015, with 141 of those (70%) coming in the three years since my retirementContinue reading “I Blog, Therefore I Am”

Slow Down, You Move Too Fast

Once again, those of us on the technical side of large-scale assessment and educational measurement find ourselves behind the curve. In the 1990s, the public clamored for achievement levels and criterion-based results while we were comfortable reporting percentile ranks and grade equivalent scores. Just as we were “getting a handle” on standard setting and percentContinue reading “Slow Down, You Move Too Fast”

The Ernie Scale

Based on a true story In the late 1980s and early 1990s, Rich Hill and Stuart Kahl led their little company that could, Advanced Systems, in reimagining, reinventing, and reshaping large-scale state testing. We were a ragtag band of young idealists who didn’t know any better. Our successes and failures were spectacular. Little that weContinue reading “The Ernie Scale”

Testonyms

In elementary school, first I learned about synonyms and antonyms. Synonym – Same; Antonym – Opposite; Got it. And synonym and antonym are such cool words – “and sometimes y.” It got a little more complicated with homonyms, which might be homophones (pronounced the same, differ in meaning or spelling), homographs (spelled the same, differContinue reading “Testonyms”

Matrix Sampling: Resurrected

It is impossible to read an article or hear a presentation about the future of large-scale state testing without some discussion of matrix sampling. If your primary concerns about large-scale testing are time and cost, the answer is matrix sampling. If your primary concern is coverage of comprehensive and complex standards like the Next GenerationContinue reading “Matrix Sampling: Resurrected”

Measuring Measures and Measurers

I have to confess that I fell down a rabbit hole while writing my blog post this week. My original plan was to comment on a Hechinger Report article published late last month, Standardized tests in their current format are ‘incredibly antiquated, with the gripping subtitle, ‘Some experts suggest using this moment to change theContinue reading “Measuring Measures and Measurers”

DIY DEI

As I observe our field’s nascent do-it-yourself (DIY) attempts to embrace, understand, and enact the concept of diversity, equity, and inclusion (DEI) what I have seen can best be described as akin to the enthusiasm and curiosity of a baby discovering its feet for the first time. And like the baby, I am sure thatContinue reading “DIY DEI”