Reply To: cogat testing scores valid w/out Accommodations

#115431
Dr. Eric
Participant

This explanation is a bit of an oversimplification, but the COGAT is a normed test.
This means that there really is no such thing as an accommodation that does not invalidate the scores.

There are two basic kinds of tests: criterion-based and normed.

Criterion-based is the basic, “Do you have this skill?” It can be reading, driving, law, etc.
These type of tests are based on a predetermined skill or criteria.
Therefore, accommodations make sense so long as the accommodation doesn’t fundamentally change what is being measured.
(Example, oral presentation versus written essay to prove you understand a history lesson.)

Normative assessments are based on a complex statistical analysis where the student given a test is compared to the performance on a large norm sample that is representative of the last census of same-age or same-grade peers WHO WERE GIVEN THE TEST IDENTICALLY. This is often referred to as standardized administration or similar terms.

For example, I have to read the test directions for these tests verbatim to the script provided.

How a test is started, ended, scored, administered, etc. all have to be identical. Otherwise, the test scores are invalid.

For your exact concern, it would need to be addressed by someone qualified who has the technical manual and experience with that specific assessment… which I do not.

The technical manual will address when you can deem an overall score invalid due to a processing deficit or an outlier result. It should also explain what should be done as a proxy when you cannot use the overall score. In some tests, this can be done by calculating an estimate using a prorated scale or using a different subscale as a proxy. However, this is specific to the test and highly technical based on how the test was developed.