Category Archives: Measurement

Seeking Comparability in an Incomparable Year

The past year has been a year like no other. We experienced a summer like no other, a World Series like no other, an election like no other, followed by a Thanksgiving, Christmas, Presidential Inauguration, and Super Bowl like no other. How can we possibly expect to produce comparable state test results in this schoolContinue reading “Seeking Comparability in an Incomparable Year”

Ninety-five Theses on State Testing

“Out of love for the truth and from desire to elucidate it, the Reverend Father Martin Luther, Master of Arts and Sacred Theology, and ordinary lecturer therein at Wittenberg, intends to defend the following statements and to dispute on them in that place. Therefore he asks that those who cannot be present and dispute withContinue reading “Ninety-five Theses on State Testing”

The Three Ps of State Testing

We are all familiar with the Three Rs, reading, writing, and ‘rithmetic, which have been the focus of federally-mandated assessment and accountability systems for the this first quarter of the 21st century. Those actually involved in education in the 21st century undoubtedly also have intimate knowledge of the Four Cs (critical thinking, communication, collaboration, creativity),Continue reading “The Three Ps of State Testing”

Assessment by Any Other Name, Please

Edy’s Pie, Ben’s Original Rice The Chicks, Lady A The Princeton School of Public and International Affairs The Washington Football Team The Altria Group, American Outdoor Brands Corp. WW, Dunkin’ One of the legacies of 2020 is a spate of name changes, most for the same underlying reason.  As demonstrated by final rows of theContinue reading “Assessment by Any Other Name, Please”

When it seems the magic slipped away

A blog year in review If there was ever a year in which it seems the magic of large-scale, K-12 testing had slipped away, 2020 was that year. Our field  found itself under attack for its racist past and a present in which tests produce outcomes that have a disproportionately negative impact on non-white and economicallyContinue reading “When it seems the magic slipped away”

Give NAEP A Chance

Followers of this blog over the past few years may recall that I have been just a tad critical of NAEP, on occasion, for their interminable process of analysis and reporting, and their obsessive clinging to a trendline that serves as both their raison d’etre and a noose around their necks.   In this through-the-looking-glass year,Continue reading “Give NAEP A Chance”

Measure Twice, Model Once

As states and their assessment contractors prepare for the possible resumption of state assessment programs in spring 2021, one critical question being considered is how, or even whether, to link results from the spring 2021 tests to the last-administered spring 2019 tests; or to put it more generally, what equating procedures should be used toContinue reading “Measure Twice, Model Once”

The Stakes are High, The Water’s Rough

In the wake of the events of 2020, the assessment and measurement community has made a commitment to do the right thing to ensure that tests are used appropriately.  The community has vowed to be more proactive in speaking out against policies and test uses that result in inequitable outcomes or consequences, while actively promotingContinue reading “The Stakes are High, The Water’s Rough”

Whose Job Is It, Anyway?

Whenever I come across the story Whose Job Is It, Anyway?, I cannot help but think of validity and K-12 large-scale assessment.  Who among us has not sat through countless TAC meetings where the mere mention of the lack of validity evidence in the technical report results in blank stares and handwringing; or in recent years, listenedContinue reading “Whose Job Is It, Anyway?”

The Butterfly Effect

This is the second in what unexpectedly became a series of posts on validity, validation, state tests, and state assessment programs. In these first two posts, I am focusing on the primary purpose of state tests and interpretation of student test scores as a measure of student performance on the state’s content standards; that is,Continue reading “The Butterfly Effect”