Each Candidate Receives a Different Question Set, Can I Still Compare their Results?

Yes, as long as you are comparing the scores of candidates who have completed the same test, assigned to the same norm group. For example, both candidates completed "Insights Numerical" set to the "Graduates, professionals, managers and executives" norm group.

Each question within an item bank has been calibrated using data from thousands of responses, meaning that each question has a precise difficulty measure. By administering questions that are targeted to the candidate’s performance, the tests can hone in on and produce a precise estimate of the candidate’s ability. This means that it is not necessarily the number of right or wrong answers that is important, but the difficulty of the questions administered and the candidate’s responses to them. For this reason, candidates can be assessed using different sets of questions from a common item bank, yet still produce results that can be compared to one another.


Article is closed for comments.