Working with tests measuring computer skills requires constant reviews as to how the tests are distributed and if the item formats will meet the needs for a perceived assessment of high quality. Our aim when we developed the new item format – In-application – was to distribute an assessment that could generate a "true" picture of a person’s "true" knowledge within the computer skills’ field.

During the development process this new technology generated a lot of questions.

How could we conduct the scoring?

How could we give feedback to the students?

How stable is the technology?

Is the measurement distorted when the application can deliver online help, around the tasks?

The poster will cover a description as to the considerations that have to be taken from a test theoretical standpoint. It will also cover a description as to how the technique works for a student, as well as how the test developer must work to deliver the assessment.

The poster presentation will also describe the differences between the simulation item format, that is common in automated
testing of computer skills, and this new item format.