1995 OPEN FORUM Abstracts
COMPARISON ON THE USE OF THE MODIFIED NEDELSKY'S PROCEDURE PERFORMED BY RC EDUCATORS AND PRACTITIONERS
David W. Chang, EdD. RRT, Columbus College, Columbus, Georgia, Sandra Gaviola, RRT, Greater Johnstown Career and Technology Center, Johnstown, Pennsylvania.
INTRODUCTION: The modified Nedelsky procedure is commonly used to calculate the minimal passing indices (MPI) of questions in a multiplechoice exam. Since the procedure specifies use of a small group (less than 8) of subject matter experts but not the professional experience and background of these experts, we compared the use of the modified Nedelsky procedure by teaching RC educators (RCE) and non-teaching RC practitioners (RCP). We sought to determine whether the MPI and subsequently the cut score of an exam can be done by RCE alone. METHOD: Thirty current NBRC written RRT self-assessment questions were selected at random with 10 questions in each cognitive levels - recall, application, and analysis, Five RCE and six RCP (all RRT's) used the modified Nedelsky's procedure and evaluated all 150 responses in these 30 questions. Each response was scored between 0 and 2 points by consensus (3 or more RCE in agreement OR 4 or more RCP in agreement). Point assignments were done by consensus as follows: correct response (2 points), incorrect but plausible response (1 point), incorrect response (0 points). The MPI for each question was calculated by dividing the correct response (2 points) by the total possible points (ranges from 2 to 6 points). t-test was used to evaluate the difference of the MPI determined by RCE and RCP.
Results: The MPI of the 30 questions determined by RCE ranged from 0.33 to 1.0 (mean = 0.66, S.D. = 0.18) and that determined by RCP ranged from 0.4 to 1.0 (mean = 0.67, S.D. = 0.15). The calculated t was 0.214 and the table t 0.05 was 2.002.
Conclusions: There was no significant difference between the MPI determined by RCE or RCP. The subject matter experts specified by the modified Nedelsky procedure may consist of RCE, RCP or a combination of these two groups of experts. This study indicates that the MPI and cut score of an exam may be determined by RCE only without adding RCP to the panel of experts.