Psychometric Analysis of MCQs Used in Assessing the Students at Entrance to a Medical College

Objective: The study was performed to investigate the reliability and validity of MCQs paper administerred to the applicants of the first MBBS batch at Rawal Institute of Health Sciences Islamabad. Study Design: Analytical study. Material and Methods: 235 students were administered a questionnaire consisting of 100 MCQs of single best type with 5 options at the entrance to Rawal Institute of Health Sciences, Islamabad. The MCQs were generated by the subject specialists, vetted at departmental and central levels and were analyzed in terms of its reliability, validity and difficulty with discriminating indices. For reliability in terms of internal consistency Cronbach’s alpha was used and was 0.72. Difficulty and discriminating indices for the MCQs were collected from the computer generated marking sheets. Result: The MCQs showed satisfactory levels of reliability and validity and majority of the MCQs were within the acceptable level of difficulty index. A wellstructured and strict central vetting process ensures an acceptable standard MCQs. Conclusion: MCQ testing, the most efficient form of written assessment is both reliable and valid. Such testing of cognitive knowledge predicts and correlates well with overall competence and performance. MCQ ‘fairness’ is an increasingly important strategic concept to improve their validity.