Assessment – Page 8 – Embrace the Absurd

A Case for Classifications

The question stuck in my craw this week is how we (i.e., the large-scale testing community) came to be so dependent on scaled scores, or scale scores if you prefer, as the primary method of reporting state test results. Test that are supposed to be providing criterion-referenced information. I could hold Andrew Ho, and DanContinue reading “A Case for Classifications”

Do I See What You See?

Perhaps it’s due to a disconnect between what’s assessed on the state test and what goes on in the school. Perhaps it’s just perspective. One group looking down at the state test results and the other group looking up. Whatever the reason, more than two decades into the NCLB era of assessment and accountability, itContinue reading “Do I See What You See?”

Revise or Reimagine the Joint Standards

Nothing lasts forever. All good things must come to an end. To everything there is a season. Ashes to ashes. Dust to dust. Whenever it’s time to revise or repair something, you have to ask yourself whether a revision is the best option or is it time for something more radical. Do I fix the transmissionContinue reading “Revise or Reimagine the Joint Standards”

Into The Great Known

In my last post, Right Before Our Very Eyes, I called on assessment specialists to focus their efforts on understanding and explaining observed scores. This post, which could have had the same title, is a reminder that, in general, educational assessment involves dealing with known quantities. The purpose of 99.9% of educational assessment is not toContinue reading “Into The Great Known”

Right Before Our Very Eyes

It’s time for educational measurement, or at least assessment specialists, to say goodbye to latent traits, hidden constructs, and true scores. They are useful concepts, in theory. In practice, well, they really haven’t helped us provide useful information to stakeholders, and that is the name of the game. Admit it, you were a bit skepticalContinue reading “Right Before Our Very Eyes”

A Christmas Carol (Testing Version)

State testing was dying; to begin with. There is no doubt whatever about that. The actions, or more aptly put, the inactions taken by the assessment community over the years had signed the death warrant. It seemed clear that all that remained was to wait for the bell to toll. Times up. Pencils down. ItContinue reading “A Christmas Carol (Testing Version)”

Gender – Our Achilles Heel

For as long as I can remember, gender has been a sore spot in large-scale assessment. Often overshadowed in the media and federal regulations by race and ethnicity, it is a difference in test results by gender that can cause the most trouble for those of us in testing. The problem, you see, is thatContinue reading “Gender – Our Achilles Heel”

Choosing Our Battles Wisely

We appear to be in a lull in the storm that has been battering large-scale assessment, in general, and state assessment programs, in particular, for the last several years. Knowing that the next band of thunderstorms is on the horizon, this may be a good time to assess our situation to determine what it isContinue reading “Choosing Our Battles Wisely”

Do Re Mi-ting Expectations

Let’s start at the very beginningA very good place to startWhen you read, you begin with A-B-CWhen you sing, you begin with Do-Re-Mi When you report state test results, you begin with … What do you begin with when reporting state test results? I know that testing begins with hopes, dreams, and aspirations (pernicious orContinue reading “Do Re Mi-ting Expectations”

That Ragged Old Item

Each year they arrive ready to change the game Developers and psychometricians with freshly minted degrees As eager to disrupt as we were eager to please. So, I wasn’t surprised when the bold one exclaimed with disdain, I remember that sandwich cut into six slices! Students deserve better items, no wonder we’re in crisis! IContinue reading “That Ragged Old Item”