Saturday, August 11, 2012

FAQ on New Examination Scheme


What stays the same?
The most important thing that will stay the same is that the exams will still yield accurate, fair results for all candidates. The test will still have 150 total questions to be answered. Using pre­test items on an exam in no way impacts scoring or test taker performance, since test takers are unable to identify which questions are scored and which are not. Test takers shouldn't notice any difference at all. The minimum passing score will be calculated based on the 125 scored items. Each scored item will continue to be worth 1 point each. 

What is a pre-test question?
Pre-test questions are usually newly-written or recently revised questions.  These questions need to be vetted by the candidates before being approved.

What is the purpose of using pre-test questions?
Using pre-test items is a standard practice in the certification industry. It helps determine whether the new questions are valid, reliable and fair to be used for scoring on future exams.

Candidates will continue to be able to challenge every item on the test. When reviewing the challenges we receive on pre-test questions, we will easily find out whether those questions are misleading, unfair, or not written well. We will then be able to improve these questions before they appear on any exams again.  

In the long run, pre-testing will allow us to improve the overall quality of the exam questions and reduce the number of challenges received after each exam administration. 

Does the use of pre-test question impact how scoring works?
Absolutely not. Exams will be scored in terms of number of correct responses. The passing score will be based on a minimum number based on 125 items.  The use of pre-test items does not impact the overall exam difficulty or question difficulty in any way.

How will the passing score be comparable to the score required on the 150 item test?
API makes every effort to select questions that are equal in difficulty for every new examination we develop. However, sometimes there are slight variations in difficulty levels from one exam to the next. API will continue to use the “equating” method to establish comparable scores on the examinations. The equating process essentially adjusts the passing point of each examination to compensate for differences in the difficulty level of the two exams. Thus, the passing point always represents the minimum knowledge required and the absolute knowledge standard is held constant. The test results of candidates only reflect whether they have this minimum amount of knowledge or not. The equating process will take into account that there are only 125 test questions to score and establish an accordingly reduced passing grade for all exams.

Are exams marked on a curve?
No. Marking on a “curve” means comparing the scores of one candidate to all the other candidates who took the examination and assigning grades or passing status according to a fixed percentage. The implication is that whether an individual passes the examination or not might depend on the ability level (or preparation) of all the other candidates who took the examination. This would not be fair for a credentialing examination. 

0 comments:

Post a Comment